This repository is forked from the original repository to extend functionality
This is code for the paper:
Low-Complexity Probing via Finding Subnetworks
Steven Cao, Victor Sanh, Alexander M. Rush
NAACL-HLT 2021
run $ conda env create -n subnet_prob --file environment.yml to install dependencies
This code was tested with python 3.6, pytorch 1.1, and pytorch-transformers 1.2.
This paper uses the Universal Dependencies dataset for dependencies and part-of-speech tagging, and the CoNLL 2003 NER Shared Task for named entity recognition.
To run the main experiment in the paper, run python main.py PATH_TO_SAVE_DIRECTORY.