Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace BufferBuilder<u8> with Vec<u8> #13867

Open
jayzhan211 opened this issue Dec 21, 2024 · 2 comments
Open

Replace BufferBuilder<u8> with Vec<u8> #13867

jayzhan211 opened this issue Dec 21, 2024 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@jayzhan211
Copy link
Contributor

jayzhan211 commented Dec 21, 2024

Is your feature request related to a problem or challenge?

The functionality we need from BufferBuilder<u8> can be handled by Vec<u8>. Switching to Vec will simplify things, and maybe faster (?

  • ArrowBytesMap
  • ByteGroupValueBuilder
  • regex replace

Describe the solution you'd like

  1. Replace with Vec<u8>
  2. Run the benchmark to see the performance impact

No response

Describe alternatives you've considered

No response

Additional context

Performance should not downgrade.

Suggested by apache/arrow-rs#6909 (comment)

@jayzhan211 jayzhan211 added the enhancement New feature or request label Dec 21, 2024
@poweihuang0817
Copy link

take

@alamb
Copy link
Contributor

alamb commented Dec 22, 2024

Thanks @jayzhan211 and @poweihuang0817 -- sounds like a good change

Maybe we can do it as a few PRs (for example, start with ArrowBytesMap) -- that will be faster to review and will ensure once we have the pattern we can easily apply it to the other structures

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants