A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Pipeline Parallelism for PyTorch

An open source implementation of CLIP.

A native PyTorch Library for large model training

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supportin…

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.

A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.

Torch Distributed Experimental

Introduction to Parallel Programming class code

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

A tensor-aware point-to-point communication primitive for machine learning

Python module that allows interacting with Genie Aladdin Connect devices

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

Slurm on Google Cloud Platform

PyTorch extensions for high performance and large scale training.

A Strong and Easy-to-use Single View 3D Hand+Body Pose Estimator

Repo for "Multi-Garment Net: Learning to Dress 3D People from Images, ICCV'19"

DIRT: a fast differentiable renderer for TensorFlow

PyTorch3D is FAIR's library of reusable components for deep learning with 3D data

MPI-IS Mesh Processing Library

Collective communications library with various primitives for multi-machine training.

PyTorch tutorials.

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

Continuous builder and binary build scripts for pytorch