Stars
🚀🚀 「大模型」2小时完全从0训练26M的小参数GPT！🌏 Train a 26M-parameter GPT from scratch in just 2h!
FlashMLA: Efficient MLA Decoding Kernel for Hopper GPUs
Tensors and Dynamic neural networks in Python with strong GPU acceleration
Open standard for machine learning interoperability
Cross-platform, customizable ML solutions for live and streaming media.
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
一个执着于让CPU\端侧-Model逼近GPU-Model性能的项目，CPU上的实时率(RTF)小于0.1
MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba. Full multimodal LLM Android App:[MNN-LLM-Android](./apps/Android/MnnLlmChat/READ…
Speech-to-text server framework with next-gen Kaldi
Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU
Python tools for WhisperKit: Model conversion, optimization and evaluation
DINO-X: The World's Top-Performing Vision Model for Open-World Object Detection and Understanding
Offline Speech Recognition with OpenAI Whisper and TensorFlow Lite for Android
The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
On-device Speech Recognition for Android
Optimized OpenAI's Whisper TFLite Port for Efficient Offline Inference on Edge Devices
Speech-to-text, text-to-speech, speaker diarization, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC…
llm deploy project based mnn. This project has merged into MNN.
Universal LLM Deployment Engine with ML Compilation
📝A simple and elegant markdown editor, available for Linux, macOS and Windows.
Generation of diagrams like flowcharts or sequence diagrams from text in a similar manner as markdown
Official electron build of draw.io
Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
Create web-based user interfaces with Python. The nice way.
A central hub for gathering and showcasing amazing projects that extend OpenMMLab with SAM and other exciting features.