Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Frequency command causes allocated memory exhausted message on csv file with many fields #330

Open
excel4 opened this issue Oct 26, 2023 · 1 comment

Comments

@excel4
Copy link

excel4 commented Oct 26, 2023

xsv is a great utility - thanks much for creating this very useful program!

Attached is a csv file with 333 fields. The frequency command works before indexing the file. However, after indexing, the frequency command immediately reports many "allocated memory exhausted" error messages.

FYI, the stats and count commands works fine after indexing. I have not tried many of the commands so I don't know if other commands also fail.

I am running xsv version 0.13.0 on Windows 10:
[xsv-0.13.0-x86_64-pc-windows-gnu.zip]gnu.zip)

all_100k.csv

@janxkoci
Copy link

Just to clarify - this issue only happens with index, right?

You can try if the new fork qsv fixed the issue, as here the development has stalled. Other alternatives include miller and csvtk, but those, albeit still fast, don't use index.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants