Alluxio Launches Enhanced Hybrid Cloud Solution Based on Intel Optane Persistent Memory
Intel Optane Persistent Memory With Alluxio Sees 2.13X Performance Boost Over Local HDFS
Alluxio, the developer of open source cloud data orchestration software, announced a go-to-market solution in collaboration with Intel to offer an in-memory acceleration layer with 2nd Gen Intel Xeon Scalable processors and Intel Optane persistent memory (PMem). The solution eliminates performance degradation of analytics clusters that are increasingly built on disaggregated compute and storage architecture.
“Today’s disaggregated cloud storage lacks efficient file system semantics support like ‘rename’. Additionally, disaggregated cloud storage typically can’t leverage compute side storage media such as DRAM and SSD for use as buffers and page caches,” said Haoyuan Li, founder and CEO, Alluxio. “Adding Alluxio Data Orchestration System and Intel’s Optane persistent memory solves both issues, enabling maximum benefit for cloud storage and achieving competitive and even better performance than traditional on-premises configurations. This is particularly helpful for hybrid cloud environments when data is remote.”
Recommended AI News: Samsung Brings In Auto-Fit Flex Mode For YouTube Viewers
Benchmarking results show 2.13x faster completion compared to local HDFS and a 1.92x speedup over DRAM cache for 4TB decision support queries when adding Alluxio and Intel persistent memory1. Using Storage over App Direct, a feature of PMem App Direct mode, allows Alluxio to access high-performance block storage without the latency of moving data across the I/O bus to provide the data acceleration and reduction in query runtime. With Alluxio and Intel Xeon Scalable processors, an I/O intensive benchmark delivers a 3.4x speedup over disaggregated S3 object storage and a 1.3x speedup over a co-located compute and storage architecture2.
In addition, Alluxio has joined into a strategic collaboration with Intel aimed at improving their joint customers’ experience with managing and processing their data, such as optimizations for Intel Deep Learning Boost, the AI acceleration technology built into Intel Xeon Scalable processors. Together, Alluxio and Intel will bring solutions to market to help fuel next-generation data, analytics and AI applications and use cases.
Recommended AI News: Diligent Robotics Announces $10 Million Series a Funding
“With this new collaboration we bring to market a solution that enables enterprise-grade shared storage and faster time to insights to solve for the challenges we see around bounded storage and compute resources on Hadoop,” said Rowan Scranage, Chief Business Officer, Alluxio. “Together with Intel, we plan to disrupt the advanced analytics and AI status quo with an in-memory data accelerator layer to accelerate intermediate data access and ease data bottlenecks that many of our customers are highlighting as key challenges with their increasing big data requirements.”
“We are thrilled to work with Alluxio and help bring this compelling solution to market,” said Arijit Bandyopadhyay, CTO of enterprise analytics & AI within Intel’s data platform group. “As we see more companies building advanced analytics and AI applications that are faced with performance challenges, the Alluxio-based in-memory data accelerator coupled with Intel’s Optane persistent memory will bring data locality, data accessibility, and data elasticity back into the environment. Based on the performance gains we are seeing with this joint solution, we are looking forward to bringing it to the market at scale.”
Recommended AI News: Microsoft Signs A 5-Year Deal With The Coca-Cola Company To Transform Global Engagement And Experiences
Comments are closed, but trackbacks and pingbacks are open.