-
Notifications
You must be signed in to change notification settings - Fork 3
Open
Description
Summary
Currently, when extracting SQLite3 Time type data via ActiveRecord, the conversion from string to Arrow's Time64 type is performed in Ruby.
Ideally, this should be handled natively by Apache Arrow C++ Compute Functions (e.g., strptime or a future "time of day" extraction function) for zero-copy, high-performance conversion. However, such functionality is not yet available in Arrow.
Related Work
- Prototype implementation in Arrow C++: Addition of Time String Parsing Features:
ParseTimeSinceMidnightandparse_time_to_time64kazu-2020/arrow#1 - Future plan: add a Compute Function to Arrow core for direct Time type conversion
TODO
- Replace Ruby-side conversion with Arrow C++ Compute Function when available
- Track progress and updates in this issue
For now, the Ruby conversion will remain in use.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels