Sessions Include: Architecting data platforms with Presto and Alluxio; Microservice to analyze Presto queries panel with ByteDance; and Speeding up Presto at Uber with Alluxio Caching
Alluxio, the developer of the open source data orchestration platform for data driven workloads such as large-scale analytics and AI/ML, announced its participation in PrestoCon Day, a day dedicated to all things Presto taking place virtually on Thursday, July 21, 2022. Alluxio will also be hosting a Presto Committer Virtual Office Hour to answer any questions related to Presto and Alluxio.
Latest Aithority Insights: Detecting, Addressing and Debunking the Hidden AI Biases
Alluxio Sessions at PrestoCon
As the cloud is evolving and the adoption of a hybrid-cloud or multi-cloud approach grows, the data architecture must adapt to heterogeneous environments. In this talk, Adit Madan shares insights on how to architect a data platform with Presto and Alluxio that provides agility and simplicity to your data team.
In this talk, Rongrong and Yanbing will talk about a microservice that they built at Uber to analyze Presto queries. The Presto Query Engine does not provide endpoints for query analysis purposes. One has to either execute the query or gather insights from the query explain plan. In this talk, they will talk about 1. The work that they had to do to do the query analysis in a microservice using Presto as a library. 2. Doing predicate analysis on the queries to come up with data formatting recommendations in order to improve query performance. 3. Using the analysis service for query result cache invalidation. The analysis figures out whether the results from a previous run of the query are still valid and can be reused.
AI and ML News: AI: Continuing the Chase for Brain-Level Efficiency
At Uber, Presto is heavily used as one of the primary data analytics tools, and Presto’s query performance has profound production impact at Uber. As part of the Presto optimization effort, Uber turned to explore Alluxio as a caching solution. Alluxio is an open source data orchestration platform often used by many compute frameworks as the caching layer. Alluxio caching is currently enabled on ~2000 nodes across 6 clusters at Uber. This session will present Uber’s journey integrating Alluxio cache into Presto. It will review the specific challenges encountered and how they were addressed. It will also share their performance improvements. Lastly, this session will discuss plans and next steps, and potential future collaboration opportunities with the community.
AI ML in Marketing: AI and Big Data Analysis Used to Find Brands’ Emotional Connection
[To share your insights with us, please write to sghosh@martechseries.com]
Comments are closed.