Feature Request: Custom HttpClient

[matty]

When using the SDK it would be good to be able to pass a custom HttpClient so that certain properties can be controlled like the request timeout. I came across timeout too short when trying to process long queries.

I have implemented temporary solution myself at: https://github.com/matty/dotnet-genai/tree/feature/custom_httpclient

[shivvaam0001]

Hi @matty

Thank you for your feedback.
We appreciate you taking the time to share your thoughts with us, and we'll be filing a feature request. To help us prioritize this request effectively, any additional details you can provide regarding the impact this feature would have would be very helpful.

[matty]

Hi @matty

Thank you for your feedback. We appreciate you taking the time to share your thoughts with us, and we'll be filing a feature request. To help us prioritize this request effectively, any additional details you can provide regarding the impact this feature would have would be very helpful.

The current timeout is set at 100 seconds. I have come across requests sent to Gemini which take longer and the SDK fails before a response can be received.

[matty]

I also added support for this here matty@7103cfe

However I do note you use some SDK generator so this would not be fit for purpose for merging but you can understand what I mean from this branch.

[fatihyildizhan]

Thanks for opening this issue! I am facing the same requirement where I need to configure a custom timeout for my requests.

@shivvaam0001 Would you be open to a PR that allows setting a custom timeout or injecting a custom HttpClient instance? If you are planning to implement this internally, could you please share a rough ETA?

Thanks in advance for your hard work on this library.

[rwjdk]

If you ar to do it, it could be even better if you expose it as a HttpClientPipelineTransport

Having a custom HttpClient that way would also allow for inspection of request/response payload like you can in OpenAI clients (great for debugging of the raw call to verify data is sent correct:

Here is an OpenAI client sample:
https://github.com/rwjdk/MicrosoftAgentFrameworkSamples/blob/main/src/WatchRawRequestAndResponse/Program.cs

[WardenUnleashed]

I would appreciate this as well, as it stands the "Client" is not currently compatible with the AddHttpClient DI extension methods, refactoring the classes to be utilized in this way would be a solid improvement.

Right now I have to add it as a singleton and just accept some of the pitfalls that come with not being able to hook it up to an http client factory.

[peter-bertok]

Certain failure is the default configuration with the current Google.GenAI SDK because the timeout is far too short for most of the current thinking models. Every developer using this library will hit this issue! The defaults are just wrong, and setting them should use idiomatic dotnet instead of GenAI-specific types that overlap with the built-in class names!