Traceloop
Traceloop, based in Tel Aviv-Yafo, Israel, is a B2B company specializing in observability and testing for LLM applications, offering features like real-time alerts, performance suggestions, and integration capabilities.
Company Overview
Traceloop, previously known as Rovie, Vecinity, Enrolla, and traceloop, is a business-to-business (B2B) company located in Tel Aviv-Yafo, Israel. Operating primarily in the B2B industry, Traceloop is renowned for providing observability and testing services for large language model (LLM) applications. The company has a small team size of 5 members and was part of the Y Combinator's W23 batch. Traceloop's reach extends across Israel, the Middle East and North Africa, and in remote and partly remote settings.
Services and Features
Traceloop offers a range of services to ensure optimal operational efficiency for LLM applications. Key offerings include observability, real-time alerts on unexpected output quality changes, and suggestions for performance improvements. Additionally, the platform supports re-running failed chains and agents in a staging environment. Integration with existing observability stacks is facilitated through OpenLLMetry, an open-source SDK. Traceloop's service suite also includes a monitoring dashboard, evaluation dashboard, CI/CD integration, and prompt management capabilities. Gradual and automatic rollout of changes is another notable feature.
Pricing Tiers
Traceloop provides multiple pricing tiers to accommodate various needs: the Free tier, Growth tier, and Enterprise tier. The Free tier includes up to 10K LLM calls per month, unlimited seats, and 24-hour data retention. The Growth tier offers customizable pricing based on the number of LLM calls per month, unlimited seats, and a week of data retention. The Enterprise tier is designed for products at scale, offering custom pricing, unlimited seats, unlimited data retention, SOC 2 compliance, an on-prem deployment option, and dedicated Slack support.
Integration and Deployment Options
Traceloop supports seamless integration with existing observability stacks using OpenLLMetry, an open-source SDK. This allows for smooth observability and monitoring of LLM applications within existing frameworks. Additionally, the Enterprise tier provides an on-prem deployment option for organizations requiring higher levels of customization and security. The automatic and gradual rollout feature enhances deployment, allowing changes to be introduced in a controlled and efficient manner.
