llmonitor is an open-source monitoring platform for AI developers.

It enables:

  • πŸ’Έ analytics on cost & usage
  • πŸ—žοΈ log prompts & requests
  • 🐾 debug your agents with traces
  • πŸ‘¨β€πŸ‘©β€πŸ‘§β€πŸ‘¦ user tracking, cost / user
  • πŸ–²οΈ frontend feedback buttons
  • πŸ’¬ chat conversation replays
  • πŸ§ͺ prompt testing suit (soon)

Getting started

The first thing you'll need to get started is to sign up and get a tracking ID.

Get a tracking ID (it's free) β†’

Pick an integration

We support integrating with the most popular AI libraries, with more in the work.

Questions? We're here to help.