Skip to content

Commit

Permalink
Update README.md to be more detailed
Browse files Browse the repository at this point in the history
  • Loading branch information
@jshuadvd
jshuadvd committed Jul 19, 2024
1 parent dc5f71c commit 3977cf4
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -197,6 +197,10 @@ Custom Dataset Training

To train on a custom dataset:

1. Prepare your dataset in a format compatible with the datasets library.
2. Implement a custom preprocess_data function if needed.
3. Use the extend_context method with your custom data.

## Results

My implementation of LongRoPE achieves the following results:
Expand Down

0 comments on commit 3977cf4

Please sign in to comment.