CIO Influence
Analytics CIO Influence News Cloud Data Management

Alation Deepens Integrations with Databricks Unity Catalog and dbt Cloud to Power Data Intelligence Across the Modern Data Stack

Alation Deepens Integrations with Databricks Unity Catalog and dbt Cloud to Power Data Intelligence Across the Modern Data Stack

Alation Inc., the leader in enterprise data intelligence solutions, announced expanded partnerships with Databricks, the lakehouse company, and dbt Labs, the pioneer in analytics engineering, to extend knowledge, collaboration, and trust across the modern data stack. Joint customers can now easily integrate rich metadata from Databricks Unity Catalog and leverage a new connector that provides support for dbt Core and dbt Cloud in Alation. As a result, users have a better understanding of their data landscape and can view underlying data changes and transformations to power data intelligence.

In the modern data stack, data lives in a variety of source systems and formats in preparation for transformation and analysis. To find, understand, and trust data that spans multiple technologies across an organization, users need a single-pane-of-glass view of the most valuable data within their ecosystem. With these recent integrations, metadata is visible within Alation, enabling users to better understand the data being leveraged, as well as its historical use, to ensure business decisions are made on high-quality and trusted data.

“The combination of Alation plus Databricks Unity Catalog, and Alation plus dbt Cloud, brings much-needed data intelligence with critical components of the modern data stack,” said Diby Malakar, VP of product management, Alation. “Metadata offers invaluable context to data users seeking to better understand their data’s path and collaborate across the organization. We’re looking forward to growing our partnerships with Databricks and dbt Labs to help data teams stay on track, work together, and increase confidence in data-driven decisions.”

CIO INFLUENCE: Ascend.io Launches Solution in Partnership with Snowflake, Enabling Cost Savings for Data Teams

Power Self-Discovery with Databricks Unity Catalog

Alation connects to more than 100 data sources, including Databricks, dbt Labs, Snowflake, AWS, and Tableau. The expanded connector with Databricks Unity Catalog empowers joint customers to better understand data that lives in their cloud-based technology stack. Organizations that leverage Databricks, which is specifically optimized for cloud environments, process and transform massive quantities of data that span multiple workspaces and systems.

Now, with the expanded connector to Databricks Unity Catalog, joint customers can sample and profile data, and compose queries on data from the Databricks Lakehouse, directly in Alation.

  • Sampling provides a preview of a small slice of data, its structure, and how it can be used.
  • Profiling provides a high-level view on the statistics of the data, such as minimum, maximum, median, and null, enabling users to observe potential quality and fit at a glance.
  • ComposeAlation’s SQL query tool, enables users to search data sources with real-time warnings and lowers the barrier to entry with its autocomplete function that generates suggestions as users write queries.

Data engineers and data scientists will now benefit from increased self-service at scale, faster migration, and the ability to collaborate inside Alation with enhanced context around the systems being used.

CIO INFLUENCE: Anglicare Leverages Ribbon and Switch Connect for Voice Consolidation and Path for Microsoft Teams Deployment

“Whether you’re a data owner or user, you need to understand the context around the data being used to accelerate time to value and garner trusted insights,” said Ariel Amster, Director of Strategic Technology Partners at Databricks. “By integrating Unity Catalog with Alation, data teams can easily search across multiple sources and workplaces to power self-discovery and streamline governance. This is a critical step before leveraging any data set, to improve the accuracy of their predictive models, and we’re thrilled to further strengthen our partnership with Alation.”

Gain Visibility into Data Changes with dbt Labs

Metadata plays a key role in enabling data users to quickly search, discover, and understand their data within Alation – an especially important feature for data engineers as they prepare increasing quantities of data for analysis.

The new connector for dbt Core and dbt Cloud extracts dbt descriptions for curated data in Alation, as well as dbt lineage for data warehouses, such as Snowflake, Redshift, and PostgreSQL. As a result, business users can fully understand the changes and transformations made to underlying data. Now, users can navigate, search, curate, flag, tag, and view lineage for data assets built with dbt in one location, increasing productivity and producing higher-quality results. The integration builds upon Alation’s extensive partner network, which utilizes the Open Connector Framework (OCF), and further cements the company’s ongoing commitment to open extensibility.

CIO INFLUENCE: Datometry Releases Driver Integration for BigQuery, Further Future-Proofing Its Customers’ Investments

[To share your insights with us, please write to sghosh@martechseries.com]

Related posts

Cyberattacks Strike More Than 40% of Manufacturers

IDG CIO Think Tank on 5G in the Enterprise Delivers Deep Insights into the Future of 5G at Work

CIO Influence News Desk

Transforming Public Broadband Access Into A High-Performing Service, Masergy Announces Masergy Performance Edge™