Airbyte Offers Industry-First Open-Source Data Integration Platform To Data Lakes

By AIT News Desk On Jul 8, 2021

AWS users can now replicate data from anywhere to their S3 account

Airbyte, creators of the fastest-growing open-source data integration platform, announced the industry-first release of open-source data integration for data lakes, enabling AWS users to replicate data from anywhere to their Amazon Simple Storage Service (S3) account.

Companies are now able to leverage Airbyte’s 75-plus pre-built connectors, or build their own custom connectors within two hours using Airbyte’s Connector Development Kit (CDK), in order to replicate their data to S3. It makes it possible for businesses to access all of their data consolidated in their data lake for analytics and any other use case. S3 is the first destination offered by Airbyte, but the data lakes of other cloud providers and Delta Lake will soon follow.

95 Percent of Retail Leaders Prioritize AI, but Only 40 Percent Feel Ready Due to Data Gaps

Nov 21, 2024

Baffle Announces Vector Database Protection to Enhance Data Security for GenAI Applications

Nov 21, 2024

H2O.ai Generative and Predictive AI Now Validated on the Dell AI Factory with NVIDIA

Nov 21, 2024

Prev Next 1 of 40,423

“Airbyte is moving forward with its mission to commoditize all data integration and will start supporting all the other data lakes,” said Michel Tricot, co-founder and CEO of Airbyte. “Airbyte is becoming the new de facto standard for open-source ETL/ELT.”

Recommended AI News: Pyramid Systems Achieves AWS Government Competency Status

By commoditizing data integration, Airbyte is establishing the new standard of moving and consolidating data from different sources to data warehouses, data lakes, or databases in a process referred to as extract, load, and, when desired, transform (ELT). Businesses can create data pipelines from sources such as PostgreSQL, MySQL, Facebook Ads, Salesforce, and Stripe, and connect to destinations that include Redshift, Snowflake, and BigQuery.

Airbyte is already fostering a community of more than 2,500 users to build and maintain open source connectors that are available to anyone. To date, there are 75 connectors that Airbyte is certifying to ensure they are production ready. By the end of this year, the company anticipates it will reach 200 connectors, which would be the most pre-built connectors in the market. It recently introduced its Connector Development Kit (CDK) in order to enable its user community to accelerate development and quickly address the long tail of connectors.

The Airbyte connectors run in Docker containers, which means they can be deployed in minutes on any cloud platform. It also enables connectors to be built in any programming language.