Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

overlay script latency #290

Open
kathys opened this issue Jul 27, 2020 · 4 comments
Open

overlay script latency #290

kathys opened this issue Jul 27, 2020 · 4 comments
Assignees
Labels
component:enhancement scaling, rescaling, enhancements

Comments

@kathys
Copy link
Collaborator

kathys commented Jul 27, 2020

The overlay.sh script can take a very long time to complete depending on the size of the image and the number and resolutions of the overlays that are chosen. However, just in general, with simple defaults, it still takes longer to complete than the production of, for instance, the G2G CONUS image set.

Any improvement in execution speed will be greatly appreciate by users.

@kathys kathys added the component:enhancement scaling, rescaling, enhancements label Jul 27, 2020
@djhoese
Copy link
Member

djhoese commented Mar 12, 2022

#303 added an optional caching functionality with limited speed improvement. I think the next option is to look into rewriting portions of the pycoast. There are probably optimizations that could be made just by restructuring the python code, but it also has a lot of logic that would benefit from moving to cython (a python-like language that can be compiled to C/C++ and importable into python).

@djhoese djhoese added this to the Polar2Grid 3.0 milestone Mar 12, 2022
@djhoese
Copy link
Member

djhoese commented Sep 6, 2022

I'm not sure we can dedicate the time to optimize add_coastlines.sh (and the pycoast package) for the Polar2Grid 3.0 release. @kathys what do you think about moving this to a Polar2Grid 3.1 milestone?

@kathys
Copy link
Collaborator Author

kathys commented Sep 6, 2022

Yes. Definitely a 3.1 milestone.

@djhoese djhoese modified the milestones: Polar2Grid 3.0, Polar2Grid 3.1 Sep 6, 2022
@kathys
Copy link
Collaborator Author

kathys commented Aug 13, 2024

We need to discuss this more before we decide if it is still needed and if so, if it is a 3.2 or other milestone.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component:enhancement scaling, rescaling, enhancements
Projects
None yet
Development

No branches or pull requests

2 participants