medical by LAION

This repository will be a summary and outlook on all our open, medical, AI advancements. See the medical-general channel in the medical category on our discord server for more information!

Current projects

• fMRI to image

Project ideas

• Fine-tune clip for pathology images [1]
• Replicate PLOS paper with current image generation techniques

Datasets

• [1] image-text pairs of pathology images (~10k) Go to dataset
• TCGA Slide-caption pairs (~3K) with captions scraped from pathology reports Go to dataset Scraping methodology

Methods

• Fine-tuning existing CLIP models

Installation of development environment (for contributors)

• See dev_environment.md