Projects

LM Proxy - AI gateway for collecting LLM metrics

These days I use a number of different AI tools and aggregating metrics across everything I write that uses AI is cumbersome. LM Proxy sits in the middle of AI applications and model providers to have a centralized point to track usage that works out-of-the-box with anything where you can set an OpenAI API base URL.