litellmLibrary to easily interface with LLM API providersai-gatewayanthropicazure-openaibedrockgatewaylangchainllmllm-gatewayllmopsopenaiopenai-proxyvertex-ai
vllmA high-throughput and memory-efficient inference and serving engine for LLMsamdcudadeepseekgpthpuinferenceinferentiallamallmllm-servingllmopsmlopsmodel-servingpytorchqwenrocmtputrainiumtransformerxpu
opentelemetry-instrumentation-cohereOpenTelemetry Cohere instrumentationartifical-intelligencedatasciencegenerative-aigood-first-issuegood-first-issueshelp-wantedllmllmopsmetricsmlmodel-monitoringmonitoringobservabilityopen-sourceopen-telemetryopentelemetryopentelemetry-pythonpython
arize-phoenix-otelLLM ObservabilityExplainabilityMonitoringObservabilityagentsai-monitoringai-observabilityaiengineeringanthropicdatasetsevalslangchainllamaindexllm-evalllm-evaluationllmopsllmsopenaiprompt-engineeringsmolagents
openinference-instrumentation-openaiOpenInference OpenAI Instrumentationaiopshacktoberfesthaystacklangchainlangraphllamaindexllmopsllmsopenaiopenai-agentsopentelemetrysmolagentstelemetrytracingvercelvertex
trulens-evalBackwards-compatibility package for API of trulens_eval<1.0.0 using API of trulens-*>=1.0.0.explainable-mlllmllmopsmachine-learningneural-networks
langwatchPython SDK for LangWatch for monitoring your LLMsaianalyticsdatasetsdspyevaluationgptllmllmopslow-codeobservabilityopenaiprompt-engineering
opentelemetry-instrumentation-google-generativeaiOpenTelemetry Google Generative AI instrumentationartifical-intelligencedatasciencegenerative-aigood-first-issuegood-first-issueshelp-wantedllmllmopsmetricsmlmodel-monitoringmonitoringobservabilityopen-sourceopen-telemetryopentelemetryopentelemetry-pythonpython
arize-phoenixAI Observability and EvaluationExplainabilityMonitoringObservabilityagentsai-monitoringai-observabilityaiengineeringanthropicdatasetsevalslangchainllamaindexllm-evalllm-evaluationllmopsllmsopenaiprompt-engineeringsmolagents
trulens-coreLibrary to systematically track and evaluate LLM based applications.explainable-mlllmllmopsmachine-learningneural-networks