This repository provides a practical guide to building a GPT-style Large Language Model (LLM) from the ground up using PyTorch, following the structure of Sebastian Raschka's book, Build a Large Language Model (From Scratch).
Programming & Technical
- Python 3.8+
- NumPy
- PyTorch
- Software Engineering Basics
Mathematical
- Calculus & Derivatives
- Linear Algebra
- Probability & Statistics
- Basic Information Theory
Machine Learning
- Core Classical ML Concepts
- Deep Learning Fundamentals
- NLP Basics
- Hugging Face libraries:
transformers,datasets,huggingface_hub gradiofor deployment