Skip to content

sort.sh needs too much memory #34

@derhuerst

Description

@derhuerst

Because of #27, I switched to Miller, but it just needs too much memory to sort the CSV files.

I aborted sorting stop_times.txt of the 2021-03-19 DELFI dataset after 1h and >12gb of memory usage.

Are there more efficient tools that can sort CSV files?

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedExtra attention is needed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions