Monte Carlo, the data observability company, announced a new integration with the automated data movement platform Fivetran, giving users the ability to accelerate data incident detection and resolution by adding monitoring to data pipelines at the point of creation. With today’s announcement, Monte Carlo becomes the first data company to bring data observability to the entire orchestration layer, after integrations with Airflow, dbt Core and dbt Cloud were announced in 2022.
The integration with Fivetran is the latest step in Monte Carlo’s mission to bring end-to-end data observability to customers’ data stack. Monte Carlo, which maintains rich integrations with data warehouses and lakes like Snowflake, Databricks, Google BigQuery, and Amazon Redshift, business intelligence tools like Looker, Tableau, and Mode, and ETL tools like Airflow and dbt, extends data quality coverage at ingestion with our native Fivetran integration. Now, data teams that rely on Fivetran to seamlessly ingest data into their warehouses and lakes can unlock the power of automated, end-to-end data observability to prevent bad data from affecting downstream consumers.
“Customers are at the core of everything we do at Monte Carlo, including driving what decisions we make with the evolution of our product,” said Lior Gavish, co-founder and CTO of Monte Carlo. “We’ve seen incredible adoption of our dbt integration, which has demonstrated to us that customers require more and more visibility into the orchestration layer. And with Fivetran being one of our customers’ favorite ELT tools, this new integration with Fivetran will be transformative and give them the ability to detect and troubleshoot issues faster so they can reduce data downtime and tackle initiatives that drive the needle for their business.”
CIO INFLUENCE: PlainID Launches The PlainID Technology Network to Enable Identity Aware Security for Advanced Access Control
As part of this news, Monte Carlo is excited to announce an official partnership with Fivetran to help joint customers improve data reliability at scale across the modern data stack.
“Our customers understand how easy it is to build pipelines, automate the ingestion process, and scale easier with Fivetran,” said Logan Welley, vice president of Alliances at Fivetran. “Joint customers of Monte Carlo and Fivetran now have the added benefit of having data observability built into those pipelines the moment they are built – allowing data teams to have full visibility of any upstream problems before they impact downstream users and products.”
Reduce time and resources spent on data quality with end-to-end coverage
As companies ingest larger volumes of data and pipelines become increasingly complex, the opportunity for data downtime – periods of time when data is inaccurate or erroneous – only grows. Data engineers spend up to two days per week firefighting broken data pipelines, an expensive problem that costs data teams millions of dollars per year in wasted revenue. Launched in 2019, Monte Carlo’s data observability platform helps data teams mitigate the risk and impact of data quality issues across the modern data stack by reducing the amount of time and resources it takes to detect and resolve them.
Our latest integration and partnership with Fivetran signals our commitment to making data more trustworthy and reliable by giving data engineers even more granular visibility into the health of their pipelines.
CIO INFLUENCE: Ascend.io Launches Solution in Partnership with Snowflake, Enabling Cost Savings for Data Teams
With this integration, mutual customers can now:
- Achieve end-to-end data observability across ELT: Get end-to-end data observability for Fivetran data pipelines with a quick, no-code implementation process. Access out-of-the-box visibility into data freshness, volume, distribution, schema, and lineage just by plugging Monte Carlo into Fivetran.
- Know when data breaks, as soon as it happens: Monte Carlo continuously monitors your data assets and proactively alerts stakeholders to data issues. Monte Carlo’s machine learning-first approach gives data teams broad coverage for common data issues with minimal configuration, and business-context-specific checks layered on top ensure coverage at each stage of ELT – and beyond.
- Find the root cause of data quality issues, fast: Monte Carlo gives teams a single pane of glass to investigate data issues, drastically reducing time to resolution. By bringing all information and context for pipelines into one place, including Fivetran logs, teams spend less time firefighting data issues and more time building.
With the Monte Carlo – Fivetran integration, monitoring coverage is automatically integrated the moment the pipeline is built. When an issue occurs, notifications are surfaced within the Monte Carlo UI and sent as alerts in Slack, Microsoft Teams, PagerDuty and anywhere else you manage incident workflows.
What our mutual customers have to say
Mutual customers like Backcountry, Checkout.com, and Masterclass are already leveraging both tools to improve data observability across their pipelines:
“Earlier when we had issues related to accuracy and efficacy of our data pipelines, Monte Carlo helped us get to a place where we could have a good idea of when things might be going south upstream,” said Prasad Govekar, director of data engineering, data science & analytics at Backcountry.com. “When you’re leading a tight-knit data team and trying to improve data trust, understanding when data breaks is only the first step. Integrating Monte Carlo at the point of ingestion allows us to understand impact, and therefore provide greater visibility to key stakeholders. Having end-to-end lineage with Fivetran is a game changer that is helping us reduce time to detection and resolution for data incidents, and in the process, increasing trust with our stakeholders.”
CIO INFLUENCE: Anglicare Leverages Ribbon and Switch Connect for Voice Consolidation and Path for Microsoft Teams Deployment
[To share your insights with us, please write to sghosh@martechseries.com]
