5 releases
Uses new Rust 2024
| new 0.0.5 | Mar 5, 2026 |
|---|---|
| 0.0.4 | Mar 1, 2026 |
| 0.0.3 | Feb 27, 2026 |
| 0.0.2 | Feb 20, 2026 |
| 0.0.1 | Feb 20, 2026 |
#1684 in Web programming
83KB
3K
SLoC
soe-llms
Crate for working with large language models (LLMs) in Rust.
These are opiniated implementations and are intended for agent use no image support is planned.
Provides a common interface for working with different providers. Currently the following models are supported:
pub enum Model {
Gpt5,
Gpt5Mini,
Gpt5Nano,
Gpt5_2,
ClaudeOpus4_6,
ClaudeSonnet4_6,
ClaudeHaiku4_5,
GeminiPro3,
GeminiFlash3,
Grok4_1Fast,
Grok4_1FastNonReasoning,
GrokCodeFast1,
MistralLarge3,
MistralMedium3_1,
MistralSmall3_2,
Devstral2,
MagistralMedium1_2,
// At the moment tool calls are not supported
Apertus8bInstruct,
}
Dependencies
~12–28MB
~273K SLoC