-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Updated Priorities #16
Open
cbizon
wants to merge
3
commits into
main
Choose a base branch
from
Sprint5
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
+34
−12
Open
Changes from 2 commits
Commits
Show all changes
3 commits
Select commit
Hold shift + click to select a range
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -16,15 +16,20 @@ Note that ARAs will be required to implement at least one of MCQ, Pathfinder, or | |
# Develop Pathfinder Query | ||
## Pre-development work: | ||
- Implement automated tests | ||
- Establish performance goals | ||
## Guppy (CI) work: | ||
- Continue to improve results | ||
- ARAs Pass TRAPI validation | ||
- Non-responding ARAs return 501(or 405 - double check) | ||
- ARS to test merging of Pathfinder responses | ||
- ARAs implement Constraints | ||
|
||
# MultiCURIE Query (MCQ) | ||
## Fugu (TEST) work: | ||
- Develop UI. UI must be developed in a way that the build could be pushed to PROD with or without MCQ enabled | ||
- Manual MCQ testing once the UI is developed | ||
- Go / No-go decision on releasing MCQ to PROD | ||
## Guppy (CI) work: | ||
- Genetics KP to deploy GeneSet Enrichment | ||
- Complete inferred mode MCQ in ARA | ||
- Non responding ARAs return 501(or 405 - double check) | ||
- Test results on example queries | ||
- ARS to test merging of MCQ responses | ||
- UI inspects inferred results; begins development | ||
|
||
# LLM Summarization | ||
## Pre-development work: | ||
|
@@ -36,23 +41,38 @@ Note that ARAs will be required to implement at least one of MCQ, Pathfinder, or | |
|
||
# Display Full KL/AT in the UI | ||
## Guppy (CI): | ||
- KPs complete implementation; reduce level of "unknown/not provided" | ||
- Complete QA of KP implementation | ||
## Fugu (TEST): | ||
- Initial UI implmentation | ||
- Initial UI implmentation; dependent on KP completion | ||
|
||
# Treats Refactor | ||
## Guppy (CI): | ||
- Clinical Trial KP deploys TRAPI endpoint; SmartAPI registration | ||
- KPs (SPOKE, KG2, MolePro, SP) to start removing Chembl Clinical Trial ingests | ||
|
||
Move to Sprint 6: | ||
- KP remove Chembl Clinical Trials ingests | ||
|
||
# Develop Automated Tests | ||
## Pre-Development | ||
- Run Benchmarking Suite | ||
- Run MCQ Suite | ||
- Develop Benchmarking Suite | ||
- Develop MCQ Suite | ||
- Develop Pathfinder Suite | ||
- Work on TRAPI Validation Runner | ||
- Address issues in the Test repo to improve the test cases | ||
- Programmatically address test case names and identifiers | ||
- Update Evaluation of Top Answer to move towards an absolute cutoff of 30 | ||
|
||
# Fix Failing Automated Tests | ||
## Guppy (CI): | ||
- Each ARA is expected to pass X tests from the Sprint 5 test suite | ||
- Each ARA is expected to pass 55 tests from the Top Answer Sprint 5 test suite | ||
- Each ARA is expected to pass 360 tests from the Never Show Sprint 5 test suite | ||
|
||
# Collect Feedback Issues | ||
## Fugu (TEST): | ||
- Each team must perform manual testing of the Fugu release in TEST and report issues to the Feedback repo | ||
between July 2 and July 9, 2024 | ||
between August 2 and August 9, 2024 | ||
- TAQA will review and prioritize the discovered issues | ||
|
||
# Fix Feedback issues | ||
|
@@ -65,6 +85,9 @@ between July 2 and July 9, 2024 | |
|
||
# CLEAN-UP EFFORT: Documentation | ||
## Pre-development | ||
- Each team closes Guppy documentation issues | ||
|
||
# Publications | ||
## Pre-development | ||
## Pre-development | ||
- Circulate Outline of proposed pub | ||
- Collect feedback and updates of outline | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This task has been completed.