infermux
Route inference across LLM providers. Track cost per request.
5 items
Route inference across LLM providers. Track cost per request.
Eval framework. Define correct, test against it, get results.
Structured data compiler. Pass pipeline, pluggable backends.
Where did your tokens go? Spans, latency percentiles, alerts.
Shared core for the MIST stack. Zero external deps.