THANOS is an advancement in HAN (Hierarchical Attention Network) architecture. Here we use Tree LSTM to obtain the embeddings for each sentence. It has a hierarchical struture which captures the hierarchical structure of a document. Two level of attention is applied both at sentence and word level. Natural language exhibits syntactic properties that would naturally combine words to phrases. Hence, we experimented by using Tree LSTMs instead of normal LSTMs. Batching is difficult with Tree LSTMs therefore we used SPINN algorithm (Stack Augmented Parser-Interpreter Neural Network). SPINN model helps in batching with Tree LSTM and provides computational Speed-up. THANOS performnace was comparable with HAN algorithm. For data preprocessing, we used Stanford Core NLP library which create a binarized tree.
-
Notifications
You must be signed in to change notification settings - Fork 1
surbhardwaj/THANOS-Tree-Augmented-Hierarchical-Attention-Network-with-Operator-Reduce-Parsing-
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
THANOS is a modification in HAN (Hierarchical Attention Network) architecture. Here we use Tree LSTM to obtain the embeddings for each sentence.
Topics
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published