Open-Sora: Democratizing Efficient Video Production for All

This project aim to reproduce Sora (Open AI T2V model), but we only have limited resource. We deeply wish the all open source community can contribute to this project.

A MFCC-based LipSync plugin for Unity using Burst Compiler

Bringing Characters to Life with Computer Brains in Unity

Code for CVPR 2022 paper "Bailando: 3D dance generation via Actor-Critic GPT with Choreographic Memory"

[CVPR 2022] FaceFormer: Speech-Driven 3D Facial Animation with Transformers

Lightweight facial capture package for Unity

📖 A curated list of resources dedicated to talking face.

This add-on allows you to add SMPL-X skinned meshes to your current Blender scene. Each imported SMPL-X mesh consists of a shape specific rig, as well as shape keys (blend shapes) for shape, expres…

A resource repository for 3D machine learning

中国科学院大学2019-2020课程（秋季，春季，夏季）

An end-to-end library for automatic character rigging, skinning, and blend shapes generation, as well as a visualization tool [SIGGRAPH 2021]

【教程】从零开始的自制Vtuber！

Papers, repository and other data about anime or manga research. Please let me know if you have information that the list does not include.

Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".

An Implementation of VTuber (Both 3D and Live2D) using Python and Unity. Providing face movement tracking, eye blinking detection, iris detection and tracking and mouth movement tracking using CPU …

自己的学习历程，重点包括各种好玩的图像处理算法、运动捕捉、机器学习

The source code for paper "Deep Image Spatial Transformation for Person Image Generation"

Official PyTorch implementation of U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation

A sketch extractor for anime/illustration.

Official Tensorflow implementation of U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation (ICLR 2020)

based on FBX SDK Python 2020.2 for scientific research purpose only bounded by license: https://smpl-x.is.tue.mpg.de/modellicense

Language-based Colorization of Scene Sketches. (SIGGRAPH Asia 2019)

Jupyter notebooks made for the Computational Musicology Seminar at The Ohio State University’s School of Music.

A Deep Learning based project for creating line art portraits.

Code for APDrawingGAN: Generating Artistic Portrait Drawings from Face Photos with Hierarchical GANs (CVPR 2019 Oral)