Downloading LLMs on UVA HPC
When you use a transformers LLM for inference, it is downloaded to your home account.
~/.cache/huggingface/hub
Datasets (from the datasets package) are also downloaded to your home account.
~/.cache/huggingface/datasets
Make sure you have enough storage in your home account!
Currently, each user has access to 200GB of home storage.