Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No really, publishing tiny .tar.gz file stays in processing state for a long time! #67

Open
jeffhhk opened this issue Sep 22, 2021 · 1 comment

Comments

@jeffhhk
Copy link
Contributor

jeffhhk commented Sep 22, 2021

I hate to break it to you Richard, but I think #63 was not the result of an anomalous manual admin operation. I just repeated the same process with the same file (on the staging server, at your request). The File Set has now been in "processing" state for 10 minutes. It's one 0.25MB file!

https://kge-data-staging.starinformatics.ca/metadata?kg_id=test-tgz-upload&fileset_version=1.0&kg_name=test-tgz-upload

@jeffhhk
Copy link
Contributor Author

jeffhhk commented Sep 23, 2021

Repro same as #63:

create a new KG (I named mine test-tgz-upload)

create a .tar.gz file containing the first 10000 lines of each file in rtx-kg2. Contents:

 $ ls -l
 total 1668
 -rw-rw-r-- 1 jeff jeff 457784 Aug 20 14:38 rtx_kg2.edgeprop.tsv
 -rw-rw-r-- 1 jeff jeff 364168 Aug 20 14:38 rtx_kg2.edge.tsv
 -rw-rw-r-- 1 jeff jeff 727841 Aug 20 14:44 rtx_kg2.nodeprop.tsv
 -rw-rw-r-- 1 jeff jeff 154579 Aug 20 14:41 rtx_kg2.node.tsv
 $ wc -l *
   10000 rtx_kg2.edgeprop.tsv
   10000 rtx_kg2.edge.tsv
   10000 rtx_kg2.nodeprop.tsv
   10000 rtx_kg2.node.tsv
   40000 total

Register new fileset, version 1.0.

Select "nodes". Upload the .tar.gz file prepared above.

After uploading, select "Done Uploading" (performed at around Sep 20 11:20am PST.)

Result: File set has had "status": "Processing" for over an hour.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant