LLM inference in C/C++

Tensor library for machine learning

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

CUDA Templates for Linear Algebra Subroutines

Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training

A Easy-to-understand TensorOp Matmul Tutorial

AI Native database for embedding vectors