62 packages found

litellm

Library to easily interface with LLM API providers
  1. ai-gateway
  2. anthropic
  3. azure-openai
  4. bedrock
  5. gateway
  6. langchain
  7. llm
  8. llm-gateway
  9. llmops
  10. openai
  11. openai-proxy
  12. vertex-ai
406 Contributors
1.65.4.post1published 5 days agoMIT

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs
  1. amd
  2. cuda
  3. deepseek
  4. gpt
  5. hpu
  6. inference
  7. inferentia
  8. llama
  9. llm
  10. llm-serving
  11. llmops
  12. mlops
  13. model-serving
  14. pytorch
  15. qwen
  16. rocm
  17. tpu
  18. trainium
  19. transformer
  20. xpu
397 Contributors
0.8.3published 5 days agoOther

opentelemetry-instrumentation-cohere

OpenTelemetry Cohere instrumentation
  1. artifical-intelligence
  2. datascience
  3. generative-ai
  4. good-first-issue
  5. good-first-issues
  6. help-wanted
  7. llm
  8. llmops
  9. metrics
  10. ml
  11. model-monitoring
  12. monitoring
  13. observability
  14. open-source
  15. open-telemetry
  16. opentelemetry
  17. opentelemetry-python
  18. python
66 Contributors
0.39.0published 2 weeks agoApache-2.0

arize-phoenix-otel

LLM Observability
  1. Explainability
  2. Monitoring
  3. Observability
  4. agents
  5. ai-monitoring
  6. ai-observability
  7. aiengineering
  8. anthropic
  9. datasets
  10. evals
  11. langchain
  12. llamaindex
  13. llm-eval
  14. llm-evaluation
  15. llmops
  16. llms
  17. openai
  18. prompt-engineering
  19. smolagents
0.9.1published 5 days agoMulanPSL-2.0

openinference-instrumentation-openai

OpenInference OpenAI Instrumentation
  1. aiops
  2. hacktoberfest
  3. haystack
  4. langchain
  5. langraph
  6. llamaindex
  7. llmops
  8. llms
  9. openai
  10. openai-agents
  11. opentelemetry
  12. smolagents
  13. telemetry
  14. tracing
  15. vercel
  16. vertex
37 Contributors
0.1.23published 1 week agoApache-2.0

trulens-eval

Backwards-compatibility package for API of trulens_eval<1.0.0 using API of trulens-*>=1.0.0.
  1. explainable-ml
  2. llm
  3. llmops
  4. machine-learning
  5. neural-networks
57 Contributors
1.4.8published 1 week agoMIT

langwatch

Python SDK for LangWatch for monitoring your LLMs
  1. ai
  2. analytics
  3. datasets
  4. dspy
  5. evaluation
  6. gpt
  7. llm
  8. llmops
  9. low-code
  10. observability
  11. openai
  12. prompt-engineering
7 Contributors
0.1.43published 2 weeks agoMIT

opentelemetry-instrumentation-google-generativeai

OpenTelemetry Google Generative AI instrumentation
  1. artifical-intelligence
  2. datascience
  3. generative-ai
  4. good-first-issue
  5. good-first-issues
  6. help-wanted
  7. llm
  8. llmops
  9. metrics
  10. ml
  11. model-monitoring
  12. monitoring
  13. observability
  14. open-source
  15. open-telemetry
  16. opentelemetry
  17. opentelemetry-python
  18. python
54 Contributors
0.39.0published 2 weeks agoApache-2.0

arize-phoenix

AI Observability and Evaluation
  1. Explainability
  2. Monitoring
  3. Observability
  4. agents
  5. ai-monitoring
  6. ai-observability
  7. aiengineering
  8. anthropic
  9. datasets
  10. evals
  11. langchain
  12. llamaindex
  13. llm-eval
  14. llm-evaluation
  15. llmops
  16. llms
  17. openai
  18. prompt-engineering
  19. smolagents
65 Contributors
8.24.2published 16 hours agoMulanPSL-2.0

trulens-core

Library to systematically track and evaluate LLM based applications.
  1. explainable-ml
  2. llm
  3. llmops
  4. machine-learning
  5. neural-networks
57 Contributors
1.4.8published 1 week agoMIT
Showing 1 to 10 of 62 results