New Features Including Rapid Target and Automator Allow Data Engineers to More Efficiently Operationalize Data Preparation Workflows in Production
Trifacta, the global leader in data preparation, announced a new set of capabilities designed to enable data engineers within data operations (DataOps) practices to more efficiently develop, test, schedule and monitor data preparation pipelines in production. With RapidTarget, Trifacta customers can utilize an existing data model to intelligently guide transformations and accelerate the process of generating a new output dataset that matches the predefined schema. Automator provides end-to-end management of scheduling, monitoring and refining preparation workflows. These new features, along with the new Deployment Manager framework, facilitate the work of data engineers in administering data pipelines that feed analytics, machine learning and data science initiatives.
“Today’s organizations are increasingly adopting DataOps to more efficiently scale their analytics and data management practices,” said Wei Zheng, VP of Products at Trifacta. “Data engineers are at the center of this shift, playing a critical role in the data preparation practices that form the backbone of their data efforts. Our team has extensively studied the emerging role of data engineers within our customers’ organizations and focused these latest enhancements on improving their ability to transition data prep workflows into scalable, repeatable data pipelines. Our introduction of these new capabilities demonstrates the expanding role Trifacta is playing within the data management practices of our customers.”
DataOps is clearly on the rise, with 73 percent of organizations indicating they planned to invest in the methodology in 2018. In light of this growing adoption of DataOps practices, the role of the data engineer in configuring, managing and scaling data pipelines has risen as a critical position within data management. Trifacta, through its work with large-scale enterprises including New York Life, GlaxoSmithKline and Deutsche Boerse, has seen first-hand how data engineers are a driving force behind the maturation of data preparation from an ad-hoc activity to a standard enterprise data management process. These new features in the Trifacta platform further support the role that data engineers perform in promoting data preparation flows developed by analyst end users into scalable data pipelines that deliver value to the broader organization.
“Data engineering is a critical function at Malwarebytes—ultimately, we’re the ones responsible for the secure adoption of new analytics use cases across the organization,” said Manjunath Vasishta, Director of Data Science and Engineering, Malwarebytes. “Trifacta’s data preparation platform has been instrumental to that objective, allowing us to provide our business users with increased accessibility to data, while also maintaining governance. As data preparation usage continues to grow, the platform’s functionality provides data engineers with even further assurance to scale and operationalize data prep workflows in order to keep pace with the demands of the business.”