Awesome Reasoning in MLLMs: Papers and Projects about learning to reason with MLLMs, including Chain-of-Thought (CoT), OpenAl o1, and DeepSeek-R1

Verifiers for LLM Reinforcement Learning

Witness the aha moment of VLM with less than $3.

Random maze environments with different size and complexity for reinforcement learning research.

A customizable framework to create maze and gridworld environments

A framework for few-shot evaluation of language models.

A fork to add multimodal model training to open-r1

LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning

A collection of materials for CS application

qpdf: A content-preserving PDF document transformer

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

A curated list of recent and past chart understanding work based on our IEEE TKDE survey paper: From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Mod…

🔽 Display any CSV (comma separated values) file as a searchable, filterable, pretty HTML table

Refine high-quality datasets and visual AI models

A project page template for academic papers. Demo at https://eliahuhorwitz.github.io/Academic-project-page-template/

[NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs

Label Studio is a multi-type data labeling and annotation tool with standardized output format

The AI Datastore for Schemas, BLOBs, and Predictions. Use with your apps or integrate built-in Human Supervision, Data Workflow, and UI Catalog to get the most value out of your AI Data.

Recent LLM-based CV and related works. Welcome to comment/contribute!

[NeurIPS 2024] 💫CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matching

A collection of resources on controllable generation with text-to-image diffusion models.

LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer