Milestone 7, Segment II: Improve computational efficiency
We will build on our successful migration of NLP pipelines to the cloud in year 2 with a specific focus on developing robust CI/CD pipelines to automate quality assurance and deployment of the various components. This milestone aligns with the Consortium's Translator Release Process milestone. While we have made use of CI during our initial development, o…
We will build on our successful migration of NLP pipelines to the cloud in year 2 with a specific focus on developing robust CI/CD pipelines to automate quality assurance and deployment of the various components. This milestone aligns with the Consortium's Translator Release Process milestone. While we have made use of CI during our initial development, our CD capabilities are lacking. We will also work towards processing all newly published articles/abstracts on a daily basis. Our infrastructure has been designed with a daily update in mind, however there may be challenges to overcome regarding incremental updates of knowledge graphs. We propose implementation of daily processing, and automated incremental updates of KGs during Segment II.