llmlite

Autonomous AI agent framework: CodeAct paradigm, pluggable LLMs, sandboxed execution.

A practical guide to building a production-ready LLM Gateway with LiteLLM + LangChain — unified multi-provider API, fallbacks, caching, cost tracking, smart routing, and guardrails.

Ask a question in plain English, get a plain-English answer — from any database connected through Trino (PostgreSQL, MongoDB, MySQL, and more). The app finds the relevant tables, writes one SQL query, runs it, and turns the result into an answer.

LiteLLM API service - Simple, fast, multi-provider LLM API wrapper.