Keywords AI
We regularly share feature releases on LinkedIn and our Changelog page. However, we recognize the value in consolidating these updates in one comprehensive space, along with exclusive insights and resources for our audience.
Introducing Lab
📡 Lab: A spreadsheet-style editor for running prompts and models across multiple test cases. Import testsets to easily test, evaluate, and optimize your LLM outputs. Read our guide >
Manage test cases in Testsets
📊 Testsets: Easily manage and organize test cases. Import a CSV file and edit it like a Google Sheet. Read our guide >
Customize LLM retries
When an LLM call fails, our system detects the error and retries the request to prevent failover.
You can:
- •Set the number of retries
- •Define initial retry time in seconds
Keywords AI @ GitHub HQ!
Andy demoed Keywords AI at the Awesome AI DevTools event at GitHub HQ, invited by Yujian Tang. Over 300 developers attended, giving us great feedback and new connections. Watch our demo here >
Keywords AI demo @ Product Hunt
We recently had the opportunity to demo Keywords AI at Product Hunt, alongside over 10 other leading AI observability and evaluation tools. It was a great chance to showcase how we stand out in this fast-evolving space. Watch our demo here >
✅ BAML integration. Build LLM apps using BAML and monitor them with Keywords AI.
✅ Mem0 integration. Give your AI apps memory.
✅ OpenAI O1 models. Test OpenAI's latest models in our LLM playground.
✅ Cost management. Added Limits page where you can edit usage and rate limits.
✅ Warning page. Customize warnings when any anomalies are detected.
✅ AI SEO description generator. Rank higher on Google with AI-powered, SEO-friendly descriptions.
