Graphcore
Author:
- 22 August 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-25
Abstract
IPU Foundations • AI is nascent – facilitating exploration is as vital as executing known algorithms. • Tera-scale models will be necessary for “super-human” AI. • Sparse evaluation will be necessary at tera-scale, $\text{for} \$ $ and Watts. • Rich natural data is sequences, images, and graphs. • Post-Dennard, keep memory and logic close. • Post-Moore, parallel computing over many chips.