Download
Guidance is an efficient programming paradigm for steering language models. With Guidance, you can control how output is structured and get high-quality output for your use case—while reducing latency and cost vs. conventional prompting or fine-tuning. It allows users to constrain generation (e.g. with regex and CFGs) as well as to interleave control (conditionals, loops, tool use) and generation seamlessly.
Features
- Write pure Python, with additional LM functionality
- Constrain generation with selects (i.e., sets of options), regular expressions, and context-free grammars, as well as with pre-built components
- Documentation available
- Examples available
- Call and deploy tools easily with automatic interleaving of control and generation
- Gain speed with stateful control + generation functions—no need for intermediate parsers
Project Samples
Categories
Large Language Models (LLM)License
MIT LicenseFollow Guidance
Other Useful Business Software
Our Free Plans just got better! | Auth0
You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Guidance!
