The Accelerator Age
At the recent DARPA ERI Summit, Bill Dally of NVIDIA spoke about machine learning applications of new GPU chips, enabling acceleration of performance based on computer architecture, rather than faster devices.
Slides for the talk are available here (PDF, 2 MB).
He provided an example whereby a speedup to 15,000 was enabled by co-design of algorithms and hardware (memory distribution) on a Volta GPU chip. He also described how DARPA sponsorship and teaming with university researchers is promoting the further development of this technology.