[Feat] Added Opik integration for logging and evaluation

[dsblank]

Title

Added Comet's Opik open-source observability integration for logging and evaluation.

For more information on Opik, see: https://github.com/comet-ml/opik

Hope you find this useful!

Type

🆕 New Feature

Changes

1. Adds documentation: docs/my-website/docs/observability/opik_integration.md
2. Lists Opik in sidebar
3. Adds the integration: litellm/integrations/opik.py
4. Adds tests: litellm/tests/test_opik.py

UI Changes

Testing

All Tests Pass:

# Set api keys in environment
pytest litellm/tests/test_opik.py

Tests can run with openai and anthropic keys. Traces and spans are logged to a local or hosted Opik server.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Sep 13, 2024 2:01pm

[krrishdholakia]

Hi @dsblank is Opik otel compatible?

If so, we already have an otel logger - could you just inherit from / use that? (it'll mean fewer dependencies on litellm docker images)

litellm/litellm/integrations/opentelemetry.py

Line 41 in cd8d7ca

class OpenTelemetryConfig:

See the arize_ai integration for reference -

litellm/litellm/integrations/arize_ai.py

Line 17 in cd8d7ca

def set_arize_ai_attributes(span: Span, kwargs, response_obj):

[dsblank]

@krrishdholakia, I'm checking to be 100% sure, but I don't think so.

[dsblank]

@krrishdholakia , no sorry: opik is not OTEL compatible.

Let me know if there is anything else you need.