BERxiT (BERT + exit) This is the code base for the paper [BERxiT: Early Exiting for BERT with Better Fine-Tuning and Extension to Regression].