LLM Tuner

Generic trainer script to fine tune LLMs in an alpaca formatted dataset.

The trainer will use the text data in the "text" column to tune the LLM.

Check more about the alpaca format here

Instructions:

• Install requirements with pip install -r requirements.txt
• Customize train.py script training variables according to your training specs
• Run train.py

Credits:

This is based on the work of Abhishek Thakur in the video Train LLMs in just 50 lines of code!

TODOs:

• Add modifiable command line arguments