GPUs will process information, and then stop and share that information, Hoff notes, and the time used for that networking and data transfer can represent up to 50 percent of the total compute time, ...