GoModel: Open-Source AI Gateway Launched by Warsaw Developer

Jakub, a solo founder in Warsaw, has developed GoModel, an open-source AI gateway designed to sit between applications and model providers such as OpenAI and Anthropic. The project began in December with contributions from several collaborators. It addresses multiple operational challenges, including tracking AI usage and costs per client or team, enabling model switching without altering application code, facilitating easier debugging of request flows, and reducing AI expenditures through exact and semantic caching. Distinctive features include a compact ~17MB Docker image, which is significantly smaller than LiteLLM's 746MB image, a visible and inspectable request workflow, and an environment-variable-first configuration approach. The recent LiteLLM supply-chain attack has prompted some users to explore alternatives, with GoModel positioned as one such option. The project's website is https://gomodel.enterpilot.io, and feedback is welcomed via a Hacker News discussion thread.