Exascale computers will enable the unraveling of significant scientific mysteries. Predictions are that 2019 will be the year of exascales, with millions of compute nodes and billions of threads of execution. The current state-of-the-art storage (but decades-old approach) in High-End Computing (HEC), in which storage is segregated from compute nodes and connected by a network, will not scale with the expected exponential growth in concurrency. At exascales, basic functionality at high concurrency levels will suffer poor performance, and combined with system mean-time-to-failure in hours, will lead to a performance collapse for heroic applications. Storage has the potential to be the Achilles heel of exascale systems. We propose that future HEC systems be designed with non-volatile memory on every compute node. Every compute node would actively participate in the metadata and data management, leveraging many-core processors high bisection bandwidth in torus networks. Distributed metadata management would be used, implemented in a distributed data-structure, tailored for HEC, supporting constant time operations by emphasizing trustworthy/reliable hardware, fast network interconnects, non-existent node "churn", low latencies, and scientific computing data-access patterns. The data would be partitioned and spread out over many nodes based on the data access patterns. Replication would be used to ensure data availability, and cooperative caching would deliver high aggregate throughput. Data would be indexed, by including descriptive, provenance, and system metadata on each file. There would be a variety of data-access semantics, from POSIX-like interfaces for generality, to relaxed semantics for increased scalability. This talk discusses this revolutionary new storage architecture that will make exascale computing more tractable, touching all disciplines in HEC, fueling scientific discovery and global economic development. This new architecture will extend the knowledgebase beyond HEC into commodity systems as the fastest machines generally become mainstream systems in a matter of years.