ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Experts via Clustering

The official Meta Llama 3 GitHub site

DEMix Layers for Modular Language Modeling

FairSeq repo with Apollo optimizer

An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up processing, and attention (consensus between columns), for emerg…

Fully featured implementation of Routing Transformer

Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.

To eventually become an unofficial Pytorch implementation / replication of Alphafold2, as details of the architecture get released

PyTorch implemented C3D, R3D, R2Plus1D models for video activity recognition.

Vector (and Scalar) Quantization, in Pytorch

PyTorch package for the discrete VAE used for DALL·E.

Vision Transformer (ViT) in PyTorch

Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)

⏬ Dumb downloader that scrapes the web

Learning Spatiotemporal Features via Video and Text Pair Discrimination

Visualizing the sum of all human knowledge

Implementation of Linformer for Pytorch

An implementation of Performer, a linear attention-based transformer, in Pytorch

An implementation of local windowed attention for language modeling

Implementation of Bottleneck Transformer in Pytorch

Implementation of Pixel-level Contrastive Learning, proposed in the paper "Propagate Yourself", in Pytorch

Implementation of the Point Transformer layer, in Pytorch

Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification

Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch

Implementation of Nyström Self-attention, from the paper Nyströmformer

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

Entity Linker solution

[CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning on image-text and video-text tasks.