Wait Time in the Queue

You may not need to request an A100 GPU!

Requesting an A100 may mean you wait in the queue for a much longer time than using another GPU. This could give you a slower overall time (wait time + execution time) than if you had used another GPU.

Three plots showing that queue time rises with more allocated resources, execution time falls, and total time to solution is minimized at an intermediate resource level.

When you request memory for HPC, that is CPU memory.

If you request a GPU, you will receive all of the GPU memory.

Previous
Next
© 2026 The Rector and Visitors of the University of Virginia