Skip to content

Add token tracking and api call backoff when token per/minute usage too high for api #4

@medright

Description

@medright

Added a token tracking feature to intelligently calculate token usage and display in the ui, it also backs off api requests if the current per/minute rate would be exceeded.

here's what that looks like:
Screenshot 2024-10-28 at 10 31 32 AM

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions