Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tobit in pyspark #6

Open
ShajuVJ opened this issue Dec 12, 2022 · 0 comments
Open

Tobit in pyspark #6

ShajuVJ opened this issue Dec 12, 2022 · 0 comments

Comments

@ShajuVJ
Copy link

ShajuVJ commented Dec 12, 2022

Hi James
This code is really helpful. It runs well for 1 million rows. However it is not running if I load data for 30 million rows.

  1. Could you please advise if multiprocessing is possible for this code? will you be able to incorporate that in your code?
    OR
  2. Could you please provide a similar code for Tobit which runs in pyspark

Regards,
Shaju

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant