Upsolver Announces SQL-Based ETL for Cloud Data Lakes to Democratize Big Data

New Data Lake ETL Platform Makes Machine Learning and Big Data Analytics Possible for More Organizations by Replacing Arcane Data Pipeline Coding Using Spark/Hadoop with Simple SQL

Upsolver, a rapidly growing big data startup and an Advanced Technology Partner in the Amazon Web Services (AWS) Partner Network (APN), has released SQL-based ETL for cloud data lakes.

The new functionality eliminates friction and complexity in big data initiatives, such as machine learning (ML) and real-time stream processing, lowering the barriers to entry and reducing time to production of data lake ETL projects by 95 percent.

Upsolver‘s SQL-based data preparation replaces thousands of lines of complex coding by big data engineers with familiar syntax and a visual interface, giving data scientists and analysts unprecedented ability to generate new insights from data lakes.

Read More: Drone Racing League Launches DRL RacerAI, the First-Ever Autonomous Racing Drone

“Upsolver has allowed me to do things that would otherwise require at least three dedicated engineers,” said Guy Boyangu, CTO at Sisense. “It has been a game-changer in terms of our ability to deliver advanced analytics and has dramatically accelerated our time to market.”

The release will serve to further bolster Upsolver‘s cloud platform, which is already used by hundreds of data professionals worldwide to manage their organizational data lakes and transform petabytes of semi-structured data into usable datasets for analytics and ML.

Data lake engineering has long been seen as the main roadblock to cloud data lake adoption. While on-premises Hadoop implementations have fallen out of favor as companies gravitate toward managed cloud storage solutions such as Amazon Simple Storage Service (Amazon S3), most organizations still struggle to see real value from their data lake initiatives due to the challenging nature of ingesting, managing, and preparing high volumes of structured and semi-structured data.

“Our customers are increasingly leveraging solutions like Amazon Athena and data lakes on Amazon S3 to operationalize data at a massive scale,” said Rahul Pathak, General Manager, Big Data, Data Lakes, Blockchain at Amazon Web Services, Inc. “We’re delighted to be working with Upsolver to help our customers easily process and analyze high volumes of data.”

Read More: How Artificial Intelligence Is Regulating Live Video Streams

Upsolver emerged from stealth early last year with the mission of making data lakes a reality for more organizations.

To realize this vision, founders Ori Rafael and Yoni Iny, both former leaders in one of the Israeli military’s elite technology units, have leveraged stream processing and indexing technology, which the company developed from the ground-up, to provide a frictionless alternative to data lake ETL as compared to Spark/Hadoop.

Since its first release in 2018, the company’s namesake platform has seen rapid adoption in data-intensive organizations such as Sisense, IronSource and The Meet Group.

“There is a worldwide shortage of skilled big data engineers,” said Ori Rafael, Co-founder and CEO at Upsolver. “It’s very difficult to find people who are very well-versed in Spark, Airflow, and Cassandra, but every developer and data analyst knows SQL. Our platform empowers anyone to be self-sufficient with big data and frees up valuable time and resources for IT and data engineering departments.”

Read More: Three Realities of Artificial Intelligence as We Approach 2020