Skip to content
/ PELA Public

PELA: Learning Parameter-Efficient Models with Low-Rank Approximation [CVPR 2024]

License

Notifications You must be signed in to change notification settings

guoyang9/PELA

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Apr 14, 2024
e0d3e1f · Apr 14, 2024

History

8 Commits
Oct 18, 2023
Apr 13, 2024
Apr 13, 2024
Oct 10, 2023
Feb 29, 2024
Oct 18, 2023

Repository files navigation

PELA: Learning Parameter-Efficient Models with Low-Rank Approximation [CVPR 2024]

arxiv

Code contribution:

  • Yangyang Guo -- ALBEF
  • Guangzhi Wang -- DeiT and Swin.

Detailed configuration of each model can be found on each model directory.

model

Acknowledgement

If you found this repo helpful, please consider cite the following paper:

@inproceedings{pela,
  author       = {Yangyang Guo and Guangzhi Wang and Mohan Kankanhalli},
  title        = {PELA: Learning Parameter-Efficient Models with Low-Rank Approximation},
  booktitle    = {CVPR},
  year         = {2024}
}

About

PELA: Learning Parameter-Efficient Models with Low-Rank Approximation [CVPR 2024]

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published