Skip to content

[CVPR 2024] A framework to fine-tune LLaMAs on instruction-following task and get many Stitched LLaMAs with customized number of parameters, e.g., Stitched LLaMA 8B, 9B, and 10B...

Notifications You must be signed in to change notification settings

ziplab/Stitched_LLaMA

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Dec 1, 2023
5af48bb · Dec 1, 2023

History

2 Commits
Dec 1, 2023

Repository files navigation

Stitched LLaMA

This is the official repository of our paper: Efficient Stitchable Task Adaptation.

In this repo, we provide a framework to fine-tune LLaMAs on the instruction-following task and get many Stitched LLaMAs with customized numbers of parameters, e.g., Stitched LLaMA 8B, 9B, and 10B...

The source code will be released soon.

About

[CVPR 2024] A framework to fine-tune LLaMAs on instruction-following task and get many Stitched LLaMAs with customized number of parameters, e.g., Stitched LLaMA 8B, 9B, and 10B...

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published