-
Notifications
You must be signed in to change notification settings - Fork 23
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
make compiled files mmap-compatible #119
base: main
Are you sure you want to change the base?
Conversation
For C++14-and-a-bit support, |
While we're in the business of speeding things up and breaking internal backwards compatibility, it would probably be a good idea to switch the datatype of |
And they are never removed out-of-order, leaving holes? |
There isn't any mechanism for removing states. Any operation that decreases the number of states is actually creating a copy and then swapping. |
5bcdbfa
to
3edf7c0
Compare
This PR adds a new binary format for transducers which is compatible with memory mapping and adds to
lt-proc
the ability to load it via mmap.It also makes the Python bindings link to the
.so
rather than recompiling the repo.TODO before merging:
trans_exe.h/cc
superseded bytransducer_exe.h/cc
node.h/cc
andmatch_node.h/cc
replaced by flat arraysmatch_state.h/cc
and renamematch_state2.h/cc
match_exe.h/cc
functionality is now part oftransducer_exe.h/cc
serialiser.h
anddeserialiser.h
and related functionsapertium-tagger
and will be contained in a single file in apertium going forwardcompression.h/cc
write functions and mark read functions as deprecatedpattern_list.h/cc
to apertiumlt-proc -e nno-nob.automorf.bin
is currently segfaulting