Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation.

Mon, 01 Jan 2024 00:00:00 +0100

Yuchen Yang, Yingdong Shi, Cheems Wang, Xiantong Zhen, Yuxuan Shi, Jun Xu:
Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation. ICML 2024: 56357-56381