Manifest: An open-source LLM router that focuses on reducing AI inference costs

Discover Manifest, an open-source LLM router that intelligently directs queries to the most cost-effective model, saving up to 70% on AI inference costs.

AI agents TypeScript CSS GitHub

Overview

Manifest is a smart model router for agents and AI apps that redirects each query to the right model, saving up to 70% in AI costs.

🔀 Routing based on complexity, specificity and custom HTTP headers

🎛️ Mix your providers: API keys, Subscriptions, Local models, Custom providers

📊 Track every single dollar, setup notifications and limits

🚑 Fallback on different models when queries fails

Links

https://manifest.build/
Manifest is an open-source, self-hosted AI orchestration framework and gateway.
https://github.com/mnfst/manifest
Manifest provides a backend-as-a-service framework using YAML-defined data modeling.

Tech stack

AI agents

Autonomous software systems that leverage LLMs to reason, plan, and execute complex, multi-step goals across external tools and data sources.

AI agents are the next evolution of applied AI: they are goal-driven, autonomous entities that handle entire workflows without constant human prompting. Unlike simple chatbots, agents use a core LLM for reasoning, integrate with external tools (APIs, CRMs, web browsers), and maintain memory to adapt and improve over time. Enterprises deploy them for high-value automation: examples include a sales agent generating over 2,000 qualified leads monthly or a research agent analyzing 50 petabytes of clinical data for insights. This technology is about scaling complex decision-making and action, not just conversation.

https://cloud.google.com/vertex-ai

View projects
TypeScript

TypeScript is an open-source superset of JavaScript: it adds static typing and compiles to clean, standards-based JavaScript.

TypeScript is a high-level, open-source language developed by Microsoft: it acts as a superset of JavaScript, adding a powerful static type system. This system enables compile-time type checking, catching errors before runtime (a critical benefit for large-scale applications). The TypeScript Compiler (TSC) reliably transpiles all code into clean, standards-based JavaScript (ES3 or newer), ensuring compatibility across any browser or host environment (Node.js, React.js, etc.).

https://www.typescriptlang.org/

View projects
CSS

A utility-first CSS-in-JS library for React that enables prop-based styling with a minimal footprint.

and CSS (stylized as &css) delivers a utility-first styling engine for React environments. It cuts the cord on external stylesheets: developers use shorthand props (like p:4 for padding) to style components directly in the markup. The package is lean (under 5kB gzipped) and provides strict TypeScript definitions to catch errors early. It is a precise choice for building high-performance interfaces without the overhead of traditional CSS-in-JS frameworks.

https://and-css.com

View projects
GitHub

Host Git repositories and enable massive-scale collaboration (pull requests, issue tracking) for over 100 million developers.

GitHub is the world's dominant web-based platform for Git repository hosting and collaborative software development. Built on Linus Torvalds' Git version control system, the platform facilitates 'social coding' by providing essential tools like pull requests, forking, and issue tracking. It currently serves over 100 million developers, managing a massive ecosystem of public and private codebases. Microsoft acquired the company in 2018 for $7.5 billion, solidifying its role as the central hub for open-source and enterprise-level version control.

https://github.com

View projects