Talend and Databricks deliver data engineering solution

Databricks and Talend have formed a strategic partnership that includes the integration of their products to enable data engineers to more easily perform data integration at large scale.

Friday, 16th November 2018 Posted 6 years ago in by Phil Alsop

“As part of our cloud data platform strategy, we rely on Databricks and Talend to help us run data engineering projects at huge scale using the best Spark analytics engine and enable more data engineers to take advantage of these features through an easy to use interface.” said Rene Greiner, Vice President, Enterprise Data Integration, Uniper, a global energy company. “High velocity data from our sensors and enterprise systems are used to help us make real-time decisions on maintenance, monitoring and asset management. This modern approach enables us to break down silos and better monetize data to help run our energy operations more efficiently.”

Integration between Talend Cloud and Databricks’ Unified Analytics Platform enables data engineers to perform data processing at large-scale using the powerful Apache Spark platform. Through this integration, users can access the scale and cloud benefits through a drag and drop interface, instead of manually coding data engineering jobs. Talend Cloud is integrated with both Azure Databricks and Databricks for AWS.

“We are proud to be teaming with the leading cloud data processing platform in the market,” said Michael Pickett, Senior Vice President, Corporate and Business Development, Talend. “Working closely with Databricks, our joint customers can achieve higher performance and faster innovation by using Talend Cloud to move workloads to Databricks.”

Databricks’ Unified Analytics Platform provides a cloud-based service capable of running all analytics in one place - from highly reliable and performant data pipelines to state-of-the-art machine learning - at an unprecedented scale. With capabilities like auto-config and auto-scaling, Databricks’ Unified Analytics Platform addresses challenges with operations and operational costs head-on by spinning up and down clusters as needed.

“Running data engineering projects at scale while keeping total cost of ownership low continues to be a struggle for organizations looking to get machine learning models to the last mile,” said Michael Hoff, Senior Vice President, Business Development at Databricks. “With Talend Cloud’s embedded data quality components, our joint integration provides a single source of trusted data which is essential when data teams are working with machine learning algorithms. It has never been easier for joint customers to run massive data pipelines.”