changelog
September 12, 2024
Introducing LLM Analytics in Kong Konnect for GenAI traffic
We’re pleased to announce the new LLM Usage reporting feature in Advanced Analytics with the release of Kong Gateway 3.8. This release aims to help organizations better manage their large language model (LLM) usage. This feature offers insights into token consumption, costs, and latency, allowing businesses to optimize their AI investments. By enabling comparisons across different LLM providers and models, organizations can make better-informed decisions and improve budget management.
Thank you for your feedback.