Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gemini 2.0 Live Api does not generate answers based on tool use's result #878

Open
phamtrung0633 opened this issue Dec 17, 2024 · 0 comments

Comments

@phamtrung0633
Copy link

Description

This is more of a feature request as the current way of doing Gemini 2.0 makes the model not answering based on tool results at all.

Issue description

I am using a RAG system using tool use of the new Gemini 2.0 live multimodal. The issue is i give it a tool that is used to retrieve information using RAG, however when the tool result returns, gemini does not generate a follow up answer based on those results at all (basically a tool use's results returned does not trigger a response ?)

Repro steps

Create a tool that Gemini multimodal live uses, this tool must return a result that's used for gemini to generate a follow-up response
Watch how it does not use the information.

Expected behavior

Gemini uses the tool use' results to answer the previous query.

Actual behavior

Gemini just said 'ok i am going to answer your query' and use the tool, and get the tool result back, and nothing else happens

Logs

Not applicable

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant