A Parsing-as-Deduction system implemented in Java that parses everything and some related tools for educational purposes.
Check the documentation in /doc/doc.md
for the list of currently supported
algorithms and formalisms and all implementation details.
It prints out full parsing traces along with applied rules and antecedence items. Use it to generate examples, play around with grammars etc.
If you just want to get parsing traces of the most common algorithms, please visit http://cl-taskbox.de/. You can insert grammar and input for all algorithms listed there, afterwards click Help > Solve Task to get the full trace.
If you want to tinker with the code, for me it worked like this:
- use your favorite IDE to clone/checkout the project
- add the dependencies to your classpath/build path, preferable with the build.gradle file
- run the JUnit tests in src.test to verify that everything is working. You should see some success messages and parsing outputs.
Logged-in GitHub users can download the latest jar from the Action tab.
See build.gradle.
Run it in your IDE.
If you downloaded or produced a jar, call with java -Dfile.encoding="UTF-8" -jar ... to correctly display special characters. Or call CL-Toolbox.bat (Windows) or CL-Toolbox.sh (Linux). They work with the same parameters, but you don't have to type in the encoding.
Video series about background and demonstration : English German
Examples:
java -jar CL-Toolbox.jar anbn.cfg "a a b b" cfg-topdown
true
1 | [S,0] | axiom | {} |
2 | [a b,0] | predict S -> a b | {1} |
3 | [a S b,0] | predict S -> a S b | {1} |
4 | [b,1] | scan | {2} |
5 | [S b,1] | scan | {3} |
6 | [a b b,1] | predict S -> a b | {5} |
7 | [a S b b,1] | predict S -> a S b | {5} |
8 | [b b,2] | scan | {6} |
9 | [S b b,2] | scan | {7} |
10 | [b,3] | scan | {8} |
11 | [a b b b,2] | predict S -> a b | {9} |
12 | [a S b b b,2] | predict S -> a S b | {9} |
13 | [ε,4] | scan | {10} |
Where anbn.cfg is:
N = {S}
T = {a, b}
S = S
P = {S -> a S b, S -> a b}
CL-Toolbox.bat ancb.tag "a c b" tag-cyk --success
true
1 | [β,.1⊤,0,-,-,1] | lex-scan a | {} |
3 | [α2,.1⊤,1,-,-,2] | lex-scan c | {} |
7 | [β,.2⊤,1,1,2,2] | foot-predict | {} |
12 | [α1,.2⊤,2,-,-,3] | lex-scan b | {} |
15 | [β,ε⊥,0,1,2,2] | move-binary | {1, 7} |
16 | [α2,ε⊥,1,-,-,2] | move-unary | {3} |
19 | [β,ε⊤,0,1,2,2] | null-adjoin | {15} |
21 | [α2,ε⊤,0,-,-,2] | adjoin α2[ε,β] | {16, 19} |
23 | [α1,.1⊤,0,-,-,2] | substitute α1[.1,α2] | {21} |
25 | [α1,ε⊥,0,-,-,3] | move-binary | {12, 23} |
27 | [α1,ε⊤,0,-,-,3] | null-adjoin | {25} |
Where ancb.tag is:
N = {S, T}
T = {a, b, c}
S = S
I = {α1 : (S T b), α2 : (T c)}
A = {β : (T a T*)}
- prints full traces or only successful traces
- automatically transforms grammars into more expressive formalisms
- can convert grammars to fit the algorithm
- displays derivated trees for all algorithms
- for TAG displays item trees on mouseover