Use Redis Celery for data prep

[source-data]

No description provided.

[ariera]

not sure what you're doing, but I can tell you you are already maxing out the cpu without celery :P

[source-data]

Trying to prepare dataset with panel-level legends using CatStack embeddings… Will allow to retest OCR with CatStack. Takes ages and huge space. Maybe should generate embeddings on the fly from the text when training. Thought it would be smart to preprocess, but maybe not so smart…. :-( CatStack embedding bring a lot! Pretty cool. But can probably be compressed to be less heavy. T

…

On 5. Aug 2019, at 21:30, Alejandro Riera ***@***.***> wrote: not sure what you're doing, but I can tell you you are already maxing out the cpu without celery :P — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#38?email_source=notifications&email_token=AAAFYMTLYOHIII7L5F33UGTQDB5VDA5CNFSM4IJFZO2KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD3S2VEY#issuecomment-518367891>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAAFYMUHE5EEC4E24E5EJVLQDB5VDANCNFSM4IJFZO2A>.