Implement caching in pymedx to prevent PubMed/PMC request blocking #25
Description
Description:
To avoid recurring blocking issues from NCBI (PubMed/PMC), we should implement request-level caching in the pymedx library.
Proposed plan:
- After retrieving all IDs from PubMed/PubMedCentral, check the cache (e.g., Memcached) for existing data and remove cached IDs from the query.
- Once new data is fetched, merge it with cached results.
- Use Memcached to support sharing cache between CI, staging, and possibly production environments.