File Storage

Big Data Demands Flexible High Performance Computing

Big data, defined as a massive volume of structured and unstructured data that is difficult to process via traditional technology, holds a wealth of possibility; but, standard, traditional parallel relational database technology has not proven to be cost-effective or provide the high-performance… [...]

Read More

Optimized by Design: Solving the Limited Memory Challenge for Machine Learning

Before we delve into issues pertaining to Machine Learning (ML) and storage optimization, it’s crucial for the reader to understand what ML is and how it works. A subset of Artificial Intelligence (AI), ML is a technique centered around training algorithms to… [...]

Read More

A Parallel File System Defined: Understanding Lustre, Lustre over ZFS and Spectrum…

A parallel file system enables systems simultaneous, coordinated access to data across multiple storage servers over a high-performance network such as OmniPath or Infiniband. High-performance computing (HPC) parallel applications require parallel file systems to take advantage of multiple IO paths and distributed… [...]

Read More

Born from AI: Accelerating Time to Insight

The more data an organization can collect, analyze and interpret the fastest wins – period. However, many organizations are not selective about the types of data they squeeze through these processes. One study found that 73 percent of data collected by organizations… [...]

Read More

“Swaptronics” an Inexpensive and Quick Method to Isolate Problems in Redundant Components…

In our example, you have an InfiniBand network down on the blue path. There are redundant InfiniBand host channel adapters, cables, InfiniBand switch ports, and storage controllers. As you use this technique you are looking to answer the question, “does the problem… [...]

Read More