Foreman: Self‑hosted LLM gateway for cost‑aware model routing
Foreman is an open‑source project hosted on GitHub. It provides a self‑hosted gateway for large language model (LLM) APIs. The gateway
Foreman is an open‑source project hosted on GitHub. It provides a
self‑hosted gateway for large language model (LLM) APIs. The gateway
can route requests to different models based on cost criteria. Users
can configure policies to prioritize cheaper or higher‑performance
models. The project aims to help developers manage expenses when using
multiple LLM providers. Documentation and source code are available in
the repository. Foreman is maintained by Northwood Systems. It offers
a flexible solution for cost‑aware LLM deployment.