Lib.rs

› Science › Machine learning
#llama-cpp #low-level #cuda

sys llama-cpp-sys-2

Low Level Bindings to llama.cpp

by Marcus Dunn, Sepehr and 62 contributors

113 releases

0.1.133 Feb 3, 2026
0.1.130 Dec 13, 2025
0.1.128 Nov 28, 2025
0.1.113 Jul 30, 2025
0.1.45 Mar 27, 2024

#316 in Machine learning

Download history 1586/week @ 2025-10-26 1470/week @ 2025-11-02 1310/week @ 2025-11-09 1532/week @ 2025-11-16 2440/week @ 2025-11-23 2781/week @ 2025-11-30 4279/week @ 2025-12-07 4466/week @ 2025-12-14 2058/week @ 2025-12-21 4415/week @ 2025-12-28 13341/week @ 2026-01-04 7170/week @ 2026-01-11 4179/week @ 2026-01-18 5147/week @ 2026-01-25 6574/week @ 2026-02-01 7698/week @ 2026-02-08

24,143 downloads per month
Used in 37 crates (4 directly)

MIT/Apache

11MB
209K SLoC

C++ 133K SLoC // 0.1% comments C 29K SLoC // 0.0% comments CUDA 15K SLoC // 0.0% comments GLSL 14K SLoC // 0.0% comments Python 8K SLoC // 0.1% comments Metal Shading Language 7.5K SLoC // 0.1% comments Objective-C 1.5K SLoC // 0.1% comments Rust 785 SLoC // 0.1% comments

llama-cpp-sys

Raw bindings to llama.cpp with cuda support.

See llama-cpp-2 for a safe API.

Dependencies