A high-throughput and memory-efficient inference and serving engine for LLMs

Data manipulation and transformation for audio signal processing, powered by PyTorch

FlashMLA: Efficient Multi-head Latent Attention Kernels

Common recipes to run vLLM

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Development repository for the Triton language and compiler

Fast and memory-efficient exact attention

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Coding assistant MCP for Claude Desktop

A framework for few-shot evaluation of language models.

FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Pytorch domain library for recommendation systems

Facebook's IT - Client Platform Engineering tools. Some of the tools we have written to help manage our fleet of client systems.

Open source chef cookbooks.

Jenkins job definitions for OSSCI

Better front page for ci.pytorch.org than Jenkins provides

Open Neural Network Exchange

Open deep learning compiler stack for cpu, gpu and specialized accelerators

A natural language modeling framework based on PyTorch

Compiler for Neural Network hardware accelerators

A set of reinforcement learning reference implementations built on caffe2.

ONNX models

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

Caffe2 is a lightweight, modular, and scalable deep learning framework.