While Moore's Law for traditional CPU-based computing is on the decline, Jen-Hsun Huang, Nvidia CEO says that we are just on the precipice of a new Moore's Law-like curve of innovation—one that is driven by traditional CPUs with accelerator kickers, mixed precision capabilities, new distributed frameworks for managing both AI and supercomputing applications, and an unprecedented level of data for training.

Huang sees a new golden age of computing ahead and it is one so fast-moving that even our current goals for exascale capabilities might arrive sooner than expected and while this might have a hyperbolic ring to it, after listening to HPC end users and vendors from both hardware and software sides, there is indeed a fortunate merging between AI and supercomputing codes and systems. With their lower precision focus and offloading of traditional simulation results to deep neural networks for large-scale inferencing, there is the possibility of lower power consuming, higher-yielding supercomputers around the corner. Judging from the nodes on the forthcoming Summit supercomputer, which is setting the stage for machines capable of handling mixed precision, mixed HPC/AI workloads