Chatter

Chatter, previously named Cram, operates out of Philadelphia, PA, and serves the B2B sector, specifically focusing on tools for large language models (LLMs). As a participant in Y Combinator’s S23 batch, Chatter has established a robust platform that supports the creation of complex chains using various models and configurations. These include function calling, chaining, data manipulation, and integration with existing codebases. The platform features an automatic evaluation system for LLMs, assessing models across nearly a dozen metrics such as semantic similarity and regex matching. Additionally, Chatter facilitates team collaboration through a non-technical interface that simplifies the building and maintenance of testing suites. Key features include an SDK & Code Export, Jinja2 templating for data transformations, and Retrieval Augmented Generation (RAG) for pipeline setup from vector databases or other sources. Chatter also provides an API Key Vault for managing LLM API keys, tracking token usage, and costs, alongside detailed analytics and observability tools for each call within a chain. The company offers various plans, including a Pro plan with enhanced functionalities like full chain builder, testing suite, and observability tools, and an Enterprise plan that adds features such as 24/7 support and on-premises hosting options. Trusted by notable clients like Coursera, Thomson Reuters, and Casetext, Chatter also offers a free trial and options for personalized demos.