Common Utils for LLM

Baichuan2-13b-chat

• Model
• fastapi streaming server & call demo
• integrate into the openai py-library demo

Common

• openai token online: https://tiktoken.aigc2d.com/
• split text no more than max_step_len token by sentence
• llm retry demo
• ……