9Router Gateway Skill

9router is a local AI gateway that routes LLM requests to multiple providers (OpenAI, Anthropic, Google, custom models like Qwen3.8, Kimi-K3, Inkling-NVFP4) through a single OpenAI-compatible endpoint.

Capabilities

• Route chat completions to any configured model
• Load balance across providers
• Access custom serverless endpoints (MODAL prefixes)
• Failover between models

Endpoint

POST http://127.0.0.1:20128/v1/chat/completions

Example

curl -X POST http://127.0.0.1:20128/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "cx/gpt-5.6-luna",
    "messages": [{"role": "user", "content": "Hello"}]
  }'

Trigger Keywords

• 9router, gateway, route model
• LLM proxy, inference routing
• modal endpoint, qwen, kimi

Verification

Check gateway health:

curl -s http://127.0.0.1:20128/v1/models