The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 open source projects and initiatives, announced Apache InLong as a Top-Level Project (TLP).
Apache InLong is a one-stop integration framework for massive data that provides automatic, secure, and reliable data transmission capabilities. The project was originally developed at Tencent in June 2013 and entered the Apache Incubator in November 2019.
The project name carries significant meaning. InLong (应龙) is a divine beast in Chinese mythology who guides the river into the sea, and it is regarded as a metaphor for the InLong system for reporting data streams.
“The InLong community aims to help enterprises simplify the process of data ingestion, ETL, and distribution,” said Charles Zhang, vice president of Apache InLong. “The graduation of InLong marks the successful establishment of an open, diverse, and mature open source community. The project will continue to practice the Apache way and help the digital transformation of enterprises through a joint community effort.”
Recommended AI News: Veriff Enhances Face Match with New Authentication Capabilities
InLong has been widely adopted across various industries, including advertising, payment, social, gaming, AI, and others. The Apache InLong project was originally called TubeMQ, focusing on high-performance, low-cost message queuing services.
To further release the surrounding ecological capabilities of TubeMQ, the community upgraded the project to InLong. It integrates the entire processes of collecting, aggregating, storing, and sorting data processing. It is simple, flexible, stable, and reliable. Features include:
- Ease of Use: Apache InLong is a SaaS-based service platform. Users can easily and quickly report, transfer, and distribute data by publishing and subscribing to data based on topics.
- Stability & Reliability: Apache InLong is derived from the online production environment. It delivers high-performance processing capabilities for 100 trillion-level data streams and highly reliable services for 100 billion-level data streams.
- Comprehensive Features: Apache InLong supports various data access methods and can be integrated with different types of Message Queue (MQ). It also provides real-time data extract, transform, and load (ETL) and sorting capabilities based on rules. Apache InLong also allows users to plug features to extend system capabilities.
- Service Integration: Apache InLong provides unified system monitoring and alert services. It provides fine-grained metrics to facilitate data visualization. Users can view the running status of queues and topic-based data statistics in a unified data metric platform. Users can also configure the alert service based on their business requirements so that users can be alerted when errors occur.
- Scalability: Apache InLong adopts a pluggable architecture that allows you to plug modules into the system based on specific protocols. Users can replace components and add features based on their business requirements.
In addition, the project recently released v1.2.0-incubating, the twelfth release of Apache InLong. Improvements include:
- Refactoring the InLong Sort module to support Transform, such as String Split, Data Filter, Regular Join, etc.
- Adding 8+ data nodes including MongoDB, SqlServer, Greenplum, Oracle DB, etc.
- Optimizing the initialization process of data nodes such as Iceberg, ClickHouse, and Hive.
- Supporting MySQL to collect Binlog from the specified offset.
- Supporting the plug-in expansion of different types of message queues.
- Supporting the management of multiple clusters and data nodes.
Recommended AI News: Syzygy Integration Releases iTAK in the App Store, a Cutting-Edge Situational Awareness App
“We are very pleased to see InLong graduate from the Apache Incubator as ASF TLP,” said Jiang Jie, vice president of Tencent. ” InLong has been used widely across Tencent and in other critical industries, like finance and government. We are committed to contributing to the community and helping to expand the big data ecosystem.”
“I was very impressed by the InLong community during the Apache incubation,” said JB Onofre, Apache InLong mentor. “The community grew in a healthy manner in both developers and users. Apache InLong is a great example of how to build a healthy and active community and successful project at The Apache Software Foundation.”
“As a one-stop data integration service, InLong’s complete surrounding ecology greatly reduces the threshold for use,” said Zhongbo Wu, PMC of Apache InLong. “High-performance, low-cost message queue services have also become the choice for enterprises to reduce costs and increase efficiency. And I wish the InLong community an even better and faster development in the future.”
“Apache InLong integrates the capabilities of Apache Pulsar and increases data processing throughput with the help of Pulsar’s queue buffering feature,” said Zhai Jia, member of Apache Pulsar PMC. “I am thrilled to see the graduation of InLong. Different from previous open source big data projects, InLong integrates the capabilities of multiple big data projects and has rich usage scenarios. C************** to the InLong community.”
Recommended AI News: Microsoft Industry Cloud Could Be a Worthwhile Consideration, According to Info-Tech Research Group
[To share your insights with us, please write to sghosh@martechseries.com]
Comments are closed.