'llm-toolkit' - A low-level Rust toolkit for the LLM last mile problem.

This library provides a set of sharp, reliable, and unopinionated "tools" for building robust LLM-powered applications in Rust. It focuses on solving the common and frustrating problems that occur at the boundary between a strongly-typed Rust application and the unstructured, often unpredictable string-based responses from LLM APIs.

llm-toolkit

See the main README for an overview and quick start guide.

Documentation

Detailed documentation is available in the docs/ directory:

• Core Design Principles
• Features
• Prompt Generation
• Intent Extraction
• Type-Safe Intents
• Agent API & Orchestration
• Observability
• Future Directions

API Reference

See docs.rs/llm-toolkit for the complete API documentation.