A collection of survey papers and resources related to Large Language Models (LLMs).
| Category | Title | Venue | Release Date | Links |
|---|---|---|---|---|
| Comprehensive | A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT | arXiv | 07 Mar 2023 | Paper |
| Language Model Behavior: A Comprehensive Survey | arXiv | 20 Mar 2023 | Paper | |
| A Survey of Large Language Models | arXiv | 31 Mar 2023 | Paper | |
| A Bibliometric Review of Large Language Models Research from 2017 to 2023 | arXiv | 03 Apr 2023 | Paper | |
| One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Era | arXiv | 04 Apr 2023 | Paper | |
| Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models | arXiv | 04 Apr 2023 | Paper | |
| ChatGPT: A Comprehensive Review on Background, Applications, Key Challenges, Bias, Ethics, Limitations and Future Scope | ScienceDirect | 14 Apr 2023 | Paper | |
| Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond | arXiv | 26 Apr 2023 | Paper | |
| Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey | arXiv | 30 May 2023 | Paper | |
| Several categories of Large Language Models (LLMs): A Short Survey | arXiv | 05 Jul 2023 | Paper | |
| ChatGPT in the Age of Generative AI and Large Language Models: A Concise Survey | arXiv | 09 Jul 2023 | Paper | |
| Large Language Models: A Comprehensive Survey of its Applications, Challenges, Limitations, and Future Prospects | TechRxiv | 10 Jul 2023 | Paper | |
| A Comprehensive Overview of Large Language Models | arXiv | 12 Jul 2023 | Paper | |
| Challenges and Applications of Large Language Models | arXiv | 19 Jul 2023 | Paper | |
| A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4 | arXiv | 04 Oct 2023 | Paper | |
| Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey | arXiv | 21 Nov 2023 | Paper | |
| ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up? | arXiv | 28 Nov 2023 | Paper | |
| Trustworthy | The Science of Detecting LLM-Generated Texts | arXiv | 04 Feb 2023 | Paper |
| Survey of Hallucination in Natural Language Generation | ACM | 03 Mar 2023 | Paper | |
| Practical and Ethical Challenges of Large Language Models in Education: A Systematic Scoping Review | arXiv | 17 Mar 2023 | Paper | |
| ChatGPT Needs SPADE (Sustainability, PrivAcy, Digital divide, and Ethics) Evaluation: A Review | arXiv | 13 Apr 2023 | Paper | |
| A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation | arXiv | 19 May 2023 | Paper | |
| Tricking LLMs into Disobedience: Understanding, Analyzing, and Preventing Jailbreaks | arXiv | 24 May 2023 | Paper | |
| A Critical Review of Large Language Models: Sensitivity, Bias, and the Path Toward Specialized AI | arXiv | 28 Jul 2023 | Paper | |
| A Survey on Fairness in Large Language Models | arXiv | 20 Aug 2023 | Paper | |
| Bias and Fairness in Large Language Models: A Survey | arXiv | 02 Sep 2023 | Paper | |
| Explainability for Large Language Models: A Survey | arXiv | 02 Sep 2023 | Paper | |
| Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models | arXiv | 03 Sep 2023 | Paper | |
| A Survey of Hallucination in Large Foundation Models | arXiv | 12 Sep 2023 | Paper | |
| Cognitive Mirage: A Review of Hallucinations in Large Language Models | arXiv | 13 Sep 2023 | Paper | |
| People's Perceptions Toward Bias and Related Concepts in Large Language Models: A Systematic Review | arXiv | 25 Sep 2023 | Paper | |
| Ethical Challenges of Large Language Models-A Systematic Literature Review | helda.helsinki.fi | 26 Sep 2023 | Paper | |
| Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attacks | arXiv | 16 Oct 2023 | Paper | |
| Large Language Models as Subpopulation Representative Models: A Review | arXiv | 27 Oct 2023 | Paper | |
| A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions | arXiv | 09 Nov 2023 | Paper | |
| Prompting | Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing | arXiv | 28 Jul 2021 | Paper |
| A Survey on In-context Learning | arXiv | 31 Dec 2022 | Paper | |
| Augmented Language Models: A Survey | arXiv | 15 Feb 2023 | Paper | |
| Towards Reasoning in Large Language Models: A Survey | ACL Anthology | 01 Jul 2023 | Paper | |
| A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models | arXiv | 24 Jul 2023 | Paper | |
| Towards Better Chain-of-Thought Prompting Strategies: A Survey | arXiv | 08 Oct 2023 | Paper | |
| How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances | arXiv | 11 Oct 2023 | Paper | |
| Unleashing The Potential of Prompt Engineering in Large Language Models: A Comprehensive Review | arXiv | 23 Oct 2023 | Paper | |
| Knowledge Editing for Large Language Models: A Survey | arXiv | 24 Oct 2023 | Paper | |
| Trends in Integration of Knowledge and Large Language Models: A Survey and Taxonomy of Methods, Benchmarks, and Applications | arXiv | 10 Nov 2023 | Paper | |
| Igniting Language Intelligence: The Hitchhiker’s Guide From Chain-of-Thought Reasoning to Language Agents | arXiv | 20 Nov 2023 | Paper | |
| Prompting Frameworks for Large Language Models: A Survey | arXiv | 21 Nov 2023 | Paper | |
| Bioinformatics | The Shaky Foundations of Clinical Foundation Models: A Survey of Large Language Models and Foundation Models for EMRs | arXiv | 22 Mar 2023 | Paper |
| A Survey for Biomedical Text Summarization: From Pre-trained to Large Language Models | arXiv | 18 Apr 2023 | Paper | |
| ChatGPT-Like Large-Scale Foundation Models for Prognostics and Health Management: A Survey and Roadmaps | arXiv | 10 May 2023 | Paper | |
| Large Language Models in Medicine | Nature | 17 Jul 2023 | Paper | |
| ChatGPT for Shaping The Future of Dentistry: The Potential of Multi-modal Large Language Model | Nature | 28 Jul 2023 | Paper | |
| Large Language Models (LLMs) and Empathy – A Systematic Review | medRxiv | 07 Aug 2023 | Paper | |
| A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics | arXiv | 09 Oct 2023 | Paper | |
| The Future Landscape of Large Language Models in Medicine | Nature | 10 Oct 2023 | Paper | |
| Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review | arXiv | 03 Nov 2023 | Paper | |
| A Survey of Large Language Models in Medicine: Progress, Application, and Challenge | arXiv | 09 Nov 2023 | Paper | |
| Multi-modal Pre-training |
A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT | arXiv | 18 Feb 2023 | Paper |
| The Contribution of Knowledge in Visiolinguistic Learning: A Survey on Tasks and Challenges | arXiv | 04 Mar 2023 | Paper | |
| A Survey on Multimodal Large Language Models | arXiv | 23 Jun 2023 | Paper | |
| Examining User-Friendly and Open-Sourced Large GPT Models: A Survey on Language, Multimodal, and Scientific GPT Models | arXiv | 27 Aug 2023 | Paper | |
| Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey | arXiv | 01 Nov 2023 | Paper | |
| How to Bridge the Gap between Modalities: A Comprehensive Survey on Multimodal Large Language Model | arXiv | 10 Nov 2023 | Paper | |
| Multimodal Large Language Models: A Survey | arXiv | 22 Nov 2023 | Paper | |
| Large Language Models Meet Computer Vision: A Brief Survey | arXiv | 28 Nov 2023 | Paper | |
| RecSys IR |
A Survey on Large Language Models for Recommendation | arXiv | 31 May 2023 | Paper |
| How Can Recommender Systems Benefit from Large Language Models: A Survey | arXiv | 09 Jun 2023 | Paper | |
| Recommender Systems in the Era of Large Language Models (LLMs) | arXiv | 05 Jul 2023 | Paper | |
| When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities | arXiv | 31 Jul 2023 | Paper | |
| Large Language Models for Information Retrieval: A Survey | arXiv | 14 Aug 2023 | Paper | |
| Large Language Models for Generative Recommendation: A Survey and Visionary Discussions | arXiv | 03 Sep 2023 | Paper | |
| Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity | arXiv | 11 Oct 2023 | Paper | |
| A Survey on Large Language Models for Personalized and Explainable Recommendations | arXiv | 21 Nov 2023 | Paper | |
| Adaptation Tuning | Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation | arXiv | 01 May 2023 | Paper |
| Efficient Methods for Natural Language Processing: A Survey | ACL Anthology | 12 Jul 2023 | Paper | |
| Aligning Large Language Models with Human: A Survey | arXiv | 24 Jul 2023 | Paper | |
| Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategies | arXiv | 06 Aug 2023 | Paper | |
| Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models' Alignment | arXiv | 10 Aug 2023 | Paper | |
| Instruction Tuning for Large Language Models: A Survey | arXiv | 21 Aug 2023 | Paper | |
| Large Language Model Alignment: A Survey | arXiv | 26 Sep 2023 | Paper | |
| Robotics | A Survey on Large Language Model based Autonomous Agents | arXiv | 22 Aug 2023 | Paper |
| The Rise and Potential of Large Language Model Based Agents: A Survey | arXiv | 14 Sep 2023 | Paper | |
| An In-depth Survey of Large Language Model-based Artificial Intelligence Agents | arXiv | 23 Sep 2023 | Paper | |
| Large language models for human–robot interaction: A review | ScienceDirect | 28 Oct 2023 | Paper | |
| A Survey of Large Language Models for Autonomous Driving | arXiv | 02 Nov 2023 | Paper | |
| Large Language Models for Robotics: A Survey | arXiv | 13 Nov 2023 | Paper | |
| A Survey on Multimodal Large Language Models for Autonomous Driving | arXiv | 21 Nov 2023 | Paper | |
| Graphs | Graph Learning and Its Advancements on Large Language Models: A Holistic Survey | arXiv | 17 Dec 2022 | Paper |
| A Survey of Graph Prompting Methods: Techniques, Applications, and Challenges | arXiv | 13 Mar 2023 | Paper | |
| Unifying Large Language Models and Knowledge Graphs: A Roadmap | arXiv | 14 Jun 2023 | Paper | |
| ChatGPT is not Enough: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling | arXiv | 20 Jun 2023 | Paper | |
| Large Language Models and Knowledge Graphs: Opportunities and Challenges | arXiv | 11 Aug 2023 | Paper | |
| A Survey of Graph Meets Large Language Model: Progress and Future Directions | arXiv | 21 Nov 2023 | Paper | |
| Graph Prompt Learning: A Comprehensive Survey and Beyond | arXiv | 28 Nov 2023 | Paper | |
| Software Engineering | Large Language Models Meet NL2Code: A Survey | arXiv | 01 Jul 2023 | Paper |
| Software Testing with Large Language Model: Survey, Landscape, and Vision | arXiv | 14 Jul 2023 | Paper | |
| Towards Understanding the Capability of Large Language Models on Code Clone Detection: A Survey | arXiv | 02 Aug 2023 | Paper | |
| Large Language Models for Software Engineering: A Systematic Literature Review | arXiv | 21 Aug 2023 | Paper | |
| Large Language Models for Software Engineering: Survey and Open Problems | arXiv | 05 Oct 2023 | Paper | |
| A Survey of Large Language Models for Code: Evolution, Benchmarking, and Future Trends | arXiv | 17 Nov 2023 | Paper | |
| Evaluation | A Survey on Evaluation of Large Language Models | arXiv | 06 Jul 2023 | Paper |
| Through the Lens of Core Competency: Survey on Evaluation of Large Language Models | arXiv | 15 Aug 2023 | Paper | |
| Evaluating Large Language Models: A Comprehensive Survey | arXiv | 30 Oct 2023 | Paper | |
| Education | ChatGPT for good? On opportunities and challenges of large language models for education | ScienceDirect | 09 Mar 2023 | Paper |
| Law | A Short Survey of Viewing Large Language Models in Legal Aspect | arXiv | 16 Mar 2023 | Paper |
| Finance | Large Language Models in Finance: A Survey | arXiv | 28 Sep 2023 | Paper |
| Others | The Life Cycle of Knowledge in Big Language Models: A Survey | arXiv | 14 Mar 2023 | Paper |
| Topics, Authors, and Networks in Large Language Model Research: Trends from a Survey of 17K arXiv Papers | arXiv | 20 Jul 2023 | Paper | |
| A Survey on Model Compression for Large Language Models | arXiv | 15 Aug 2023 | Paper | |
| Document Automation Architectures: Updated Survey in Light of Large Language Models | arXiv | 18 Aug 2023 | Paper | |
| When Large Language Models Meet Citation: A Survey | arXiv | 18 Sep 2023 | Paper | |
| A Survey of Large Language Models Attribution | arXiv | 07 Nov 2023 | Paper |
- 2023-10-04: Released the first draft of the survey summary for LLMs.
- 2023-10-07: Added three survey papers about LLMs for graphs.
- 2023-10-10: Included one survey paper about LLMs for healthcare.
- 2023-10-19: Appended two survey papers about LLMs for software engineering.
- 2023-10-29: Added one comprehensive survey and four surveys for trustworthiness.
- 2023-11-05: Incorporated one survey for factuality issues in knowledge and retrieval.
- 2023-11-11: Collected nine survey papers across seven categories.
- 2023-11-18: Updated the category and supplemented nineteen survey papers.
- 2023-11-23: Included ten survey papers across eight categories.
- 2023-11-30: Created a new category: education; updated nineteen survey papers across eight categories.
- 2023-12-03: Replenished five survey papers across three categories.