Back to home

Tag

API

API is the interface layer that connects apps, models, and agents, shaping how systems call tools, handle auth, and bill usage. Topics here include LLM SDKs, sandboxing, tool calls, and plugin-based integrations that affect real-world deployment.

1 articles

Why routing belongs at the center of model serving
Industry News/May 4

Why routing belongs at the center of model serving

Routing should be the single entry point for model serving because it speeds iteration and unlocks new ML products.