Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARS and Subsystem performance frequently results in no scores #58

Open
sharatisrani opened this issue Oct 4, 2024 · 2 comments
Open
Assignees
Labels
showstopper Something essential isn't working

Comments

@sharatisrani
Copy link
Collaborator

sharatisrani commented Oct 4, 2024

As requested by TACT members: this is a tracking issue that subsumes many, including new vs old confidence scoring, and new novelty factor scores, analysis of grouping. ARS calls Appraiser which calls other scoring systems as in slide 2 of O&O flow diagram.

It is actually a showstopper issue until the scores flow with reasonable certainty, guessing 90%.

At the moment, there are two suspects for slowness - networking issues that affect the Appraiser-ARS link, and PubMed Reference performance in returning recency results to Novelty scoring.

@maximusunc
Copy link
Collaborator

Answer Appraiser has been updated to disable novelty scoring, as well as other performance enhancements. It is now returning the other scores within seconds instead of minutes. I say we run a few tests, but otherwise this is no longer an issue.

@bill-baumgartner
Copy link

Just a note regarding the Publication Metadata API -- it was designed to meet specs provided by the UI team and therefore may not be suitable for the recency filter calculations if the issue is speed. A dramatic speedup would likely require a different underlying architecture (probably in-memory) and trimming down the returned data to only include only PMID and date published.

In case it is useful for testing/developing the recency calculation, I have generated a mapping from PMID to year published in this file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
showstopper Something essential isn't working
Projects
None yet
Development

No branches or pull requests

6 participants