roadmap: Migrate Jan's legacy Assistants to Cortex /assistants API

[dan-menlo]

Goal

• Jan's Assistants to migrate to Cortex /assistants API
• We are using the outdated Jan Assistant
  • Each thread will has a specific Assistant
  • Assistant has model settings (not ideal)

Out-of-scope

• OpenAI-compatible Assistants
• Relies on runs to integrate into threads

Task List

Backend

• planning: Cortex API supports basic /assistants (Jan status quo equivalent) cortex.cpp#1573
• Decouple threads.json into Assistants: roadmap: Cortex API supports /threads, /messages cortex.cpp#1567 (comment)
• Add the OpenAI-Header =assisstant-v1

Docs

• @namchuai

Scope

• Default Assistant?
• Include Retrieval Tool?

[dan-menlo]

Current state:

• 0.5.12: Each Thread has its own Assistant (legacy) with RAG (legacy)
• We need runs for Asssistants (v1) to work with Threads
  • Assistants (Openai-Beta: v2) are global and accessed via /assistants API
  • Assistants (Openai-Beta: v2) have /runs as join table with /threads

[dan-menlo]

Merging into #4274