- this is the repo containing all the code for training, evaluating and generate medical text with GPT models based on Megatron-LM
- this is the repo for GatorTronGPT project
- The GatorTronS model is available from : https://huggingface.co/UFNLP/gatortronS
- How to use
from transformers import AutoModel, AutoTokenizer, AutoConfig
tokinizer= AutoTokenizer.from_pretrained('UFNLP/gatortronS')
config=AutoConfig.from_pretrained('UFNLP/gatortronS')
mymodel=AutoModel.from_pretrained('UFNLP/gatortronS')
encoded_input=tokinizer("Bone scan: Negative for distant metastasis.", return_tensors="pt")
encoded_output = mymodel(**encoded_input)
print (encoded_output)We have a preprint at
@misc{peng2023study,
title={A Study of Generative Large Language Model for Medical Research and Healthcare},
author={Cheng Peng and Xi Yang and Aokun Chen and Kaleb E Smith and Nima PourNejatian and Anthony B Costa and Cheryl Martin and Mona G Flores and Ying Zhang and Tanja Magoc and Gloria Lipori and Duane A Mitchell and Naykky S Ospina and Mustafa M Ahmed and William R Hogan and Elizabeth A Shenkman and Yi Guo and Jiang Bian and Yonghui Wu},
year={2023},
eprint={2305.13523},
archivePrefix={arXiv},
primaryClass={cs.CL}
}