Skip to content

Context Compressive Encoder in Large Language Models

Notifications You must be signed in to change notification settings

sudy-super/Co-Encoder

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

38 Commits
 
 
 
 
 
 

Repository files navigation

Co-Encoder: Context Compressive Encoder in Large Language Models

Designing and implementing the Co-Encoder architecture compatible with the Transformers library, including its end-to-end training pipeline and associated components.

Important

NOTE: This repository is currently under active design and development, and the architecture and implementation are subject to frequent changes. Please note that the stability and performance of the code cannot be guaranteed at this stage, so we kindly ask that you use it with this understanding in mind.

Architecture

Co-Encoder overall architecture

Connector architecture

About

Context Compressive Encoder in Large Language Models

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages