Skip to content

Conversation

@david-wei-01001
Copy link

When I attempted to run the original code in README on how to use "eagenerate", I always encountered two errors:

  1. torch is not defined
  2. AttributeError: 'EConfig' object has no attribute 'draft_vocab_size'

In this pull request, I have slightly modify the code wrt "eagenerate" + EAGLE so it is fully functioning.

Now one can directly copy the code and execute! Hoo ray!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant