Groq API in PrivateGPT

[psmukhopadhyay]

Hello

I am a beginner-level user of PrivateGPT and set it for 'local' with LLM as mistral-7b-instruct-v0.2.Q4_K_M.gguf.

Please advise me how to add Groq (OpenAI compatible LLM service - https://console.groq.com/docs/quickstart) in PrivateGPT. I already have API key and other ID for Groq. Should I follow the included azopenai as model?

Regards

[KenFlack]

I am in the same boat... Will let you know if I discover the solution.

[psmukhopadhyay]

Thanks Ken :)

[nizar0x1f]

any updates guys?

[somashekhar161]

yes i was able to integrate it with fireworks hoping it'll be similar to groq
will create a PR for this

[somashekhar161]

any updates guys?

#2089
check this out added fireworks integration