v1.74.0
New Features
-
✨ Enhanced Log Probability Handling: Introducing the ability to handle
logprobs
andresponseTokens
more efficiently. This update includes the addition of thetopLogprobsToMarkdown
function, allowing users to visualize token probabilities in a more informative way. -
🎉 Entropy and Perplexity Calculations: We've added robust entropy and perplexity computations to provide deeper insights into token generation confidence and model performance.
Improvements
- 🛠️ CLI Enhancements: The CLI now supports a
--top-logprobs
option, enabling users to specify the number of top log probabilities to report, enhancing the granularity of token probability analysis.
Refactoring
- ♻️ Entropy Logic Update: The entropy calculation logic has been refined for better accuracy and performance, ensuring users get the most precise data.
Visual Updates
- 🎨 Color Tuning: Minor color adjustments have been made to improve the readability and visual appeal of probability gradients.
This release empowers users with more detailed insights into model predictions, offering advanced tools for analyzing token probabilities and model confidence. Enjoy exploring these new capabilities!