AI Cost Router
A small Go HTTP service that decides whether tutor chat messages should call an LLM or return a canned reply.
Description
A small Go HTTP service for reducing unnecessary tutor-chat LLM calls. It exposes health and routing endpoints, protects routing with an internal Bearer token, returns canned replies for greetings, thanks, vague, empty, or acknowledgement messages, and lets the Nest API delegate the same routing heuristics without duplicating them in TypeScript.
Technologies
Go
- Date
- 2026
- Type
- AI Infrastructure
- Client
- Open Source
