Skip to content

dimfeld/chronicle

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

148 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

chronicle

Chronicle is a proxy for language model API calls which

  • Presents an OpenAI-compatible API regardless of the underlying provider. Switching providers is as easy as changing the model string in your request.
  • Provides retries and optionally falls back to other providers on a failed call
  • Records each call in a database, and sends OpenTelemetry events
  • Lets you switch model provider APIs without changing your request format.
  • Supports both SQLite and PostgreSQL databases
  • Comes with a drop-in fetch function that will redirect OpenAI SDK calls to Chronicle instead.
  • Supports logging "runs" and "steps" for multi-step workflows

See the roadmap for the current status and other notes.

The project contains both a Rust crate named chronicle-proxy in the proxy directory for embedding in applications, and a turnkey server in the api directory which can be run directly.

See the CHANGELOG for latest changes.

Supported Providers

  • OpenAI
  • Anthropic
  • AWS Bedrock
  • Groq
  • Ollama
  • AnyScale
  • DeepInfra
  • Fireworks
  • Together

About

LLM Proxy

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors

Languages