Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support compressed pcap ingest #159

Open
alfred-landrum opened this issue Apr 28, 2020 · 0 comments
Open

support compressed pcap ingest #159

alfred-landrum opened this issue Apr 28, 2020 · 0 comments

Comments

@alfred-landrum
Copy link

alfred-landrum commented Apr 28, 2020

This issue was originally created before Brimcap existed and the specific draft proposal below for implementation is probably no longer relevant. However, since the Brim+Brimcap workflow still includes "dragging a pcap into the app", the question of what could be done if the pcap is compressed still seems relevant.


Add support to the pcap ingest api in zqd to support compressed pcaps. Since we need an uncompressed pcap to support slicing, the implementation for this should create an uncompressed form of the pcap that is stored in the space's data directory, along with the pcap index. The uncompressed pcap should get deleted when the space itself is deleted.

For Brim users with large compressed pcaps, this will cause some increased storage space, but I think this is where the slice-to-pcap feature is most useful.

@philrz philrz transferred this issue from brimdata/super Sep 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants