Open Internet by MindsNet

Extreme Performance Disparity Between NVIDIA T4 and A100 GPUs

A PyTorch model experiences a 170x slowdown on an NVIDIA T4 compared to an A100, which cannot be explained by generational hardware differences alone. The model involves 4D correlation volumes and transformer layers, and potential bottlenecks need to be identified.

Computing & Technology, Computer Science, Machine Learning