Talend Modernizes Data Pipelines for Hybrid and Multi-Cloud Environments

Talend Modernizes Data Pipelines for Hybrid and Multi-Cloud Environments

April 16, 2019 0 By Hoofer

Talend announced the addition of Pipeline Designer to Talend Cloud, a unified, comprehensive, and highly scalable integration platform as-a-service (iPaaS).

Talend’s new web-based graphical designer dramatically simplifies the creation of end-to-end data pipelines, giving customers the ability to preview live data and transform it with ease. Using a single web interface, data engineers and developers can seamlessly design data pipelines across batch and streaming use cases that can scale with the latest hybrid and multi-cloud technologies.  

Enables data pipelines to be built faster and smarter with a next-generation design environment

With Talend, the processing and computing layer is decoupled from the data pipeline design so companies can scale with the cloud and/or on-premise technologies of their choice at any time. Talend Cloud with Pipeline Designer enables IT and ad-hoc integrators to use a simple interface to transform and move their data – whether it is on-premises or cloud, batch or streaming – into cloud data lakes and data warehouses within a single seamless environment.

“A majority of organizations are integrating sources and targets across hybrid and multi-cloud environments, where on-demand availability, elastic scalability, and ease-of-use are expected. These complex environments also have unique functional and non-functional requirements that can result in an assembly of multiple tools and technologies for one end-to-end solution,” said Stewart Bond, director, Data Integration and Integrity Software research, IDC.

“Talend Cloud with Pipeline Designer is built for hybrid and multi-cloud data environments, providing data engineers with ease-of-use and elastic scalability on-demand while also enabling integration of streaming and at-rest data, all-in-one tool, simplifying integration solutions.”

Highlights of Pipeline Designer include:

  • Create end-to-end pipelines to preview live data and transform it in a web-based UI
    • Design and build resilient pipelines with schema-on-read capabilities
    • Develop and debug in real time with a live preview of data
  • Design with speed across batch and streaming data use cases using a single interface
    • Integrate any data, structured or unstructured 
    • Connect easily to leading data sources like Salesforce; Amazon S3, Redshift and Kinesis; Azure SQL Database; Snowflake; and Apache Kafka 
  • Design pipelines in the cloud, then run on-premises, in AWS EMR, or in a virtual private cloud
    • Build and run hybrid, multi-cloud pipelines 
    • Get unlimited scale by running native Apache Spark on big data platforms 
    • Future-proof development with one-click portability between platforms 

Data pipelines for today’s data integration needs

“The requirements for modern data engineering are very different today compared to only a couple years ago. Most teams are not ready or equipped to process or analyze data in real time; yet, to remain viable, companies need to respond faster to opportunities and threats,” said Ciaran Dynes, SVP Products, Talend.

“With Pipeline Designer’s new user-friendly UI, customers will be able to easily ingest and transform batch and streaming data. We’re thrilled to add this new design environment to Talend Cloud.”