CIO Influence
CIO Influence News Data Management Digital Transformation

Airbyte Reaches 100 Open Source Connectors Within its First Year — Becoming the Most Complete Platform for Data Integration

Airbyte Reaches 100 Open Source Connectors Within its First Year — Becoming the Most Complete Platform for Data Integration

Company Expects to Reach 200 Connectors by Year End, Breaking Down Data Silos.

Airbyte announced the availability of more than 100 open-source data connectors just one year after the company began operations with the goal of reaching 200 connectors by the end of this year. This will make Airbyte the most complete platform for data integration.

Recommended ITech News: TVU Networks Partners with Blackbird to Integrate Cloud-Native, Real-Time Editing Into TVU Producer

“Using Airbyte makes extracting data from various sources super easy! I don’t have to spend a lot of time maintaining difficult data pipelines. Instead, I can now use that time to generate meaningful insights from data”

Airbyte is the fastest-growing open-source data integration platform with 4,000 companies using its technology , as compared with 250 at the end of January.

“Airbyte’s open-source approach opens new doors for extracting data from multiple sources and consolidating those so that data analysts and scientists have access to everything they need,” said Michel Tricot, co-founder and CEO, Airbyte. “Our goal is to commoditize data integration and break down all data silos. We’re seeing that Airbyte’s open-source software is quickly becoming the industry standard used for data integration.”

The connectors make it possible to move and consolidate data from different sources — such as MySQL, PostgreSQL, Salesforce — to data warehouses, data lakes, or databases in a process referred to as extract, load, and, when desired, transform (ELT). The Airbyte connectors run in Docker containers, which means they all operate independently from each other, making it simple to apply updates. Also, users can build connectors in the language they prefer and share those with the community.

“Using Airbyte makes extracting data from various sources super easy! I don’t have to spend a lot of time maintaining difficult data pipelines. Instead, I can now use that time to generate meaningful insights from data,” said Thomas van Latum, data engineer and cloud architect, g-company. “Also, with the great support of the Airbyte developers, I was able to create a new source connector in a couple of hours.​”

Airbyte supports two types of connectors: Sources and Destinations, which follow the Airbyte specification.

Recommended ITech News: SunTec Business Solutions Announces Xelerate On Salesforce AppExchange, The World’s Leading Enterprise Cloud Marketplace

Connector Grades

Airbyte uses a grading system for connectors to help users understand what to expect from a connector. There are three grades.

Certified – This connector has been proven to be robust via usage by a large number of users and extensive testing. Airbyte actively provides maintenance for these connectors.

Beta – While this connector is well tested and is expected to work a majority of the time, it was released recently. Airbyte will provide quick turnaround for support on any issues. All beta connectors will make their way to certified status after enough field testing.

Alpha – This connector is either not sufficiently tested, or has extremely limited functionality, or for any other reason may not be very mature. Most of those connectors are contributed by the community.

Here is the complete list of connectors available for Airbyte. For any not yet available, it’s possible to easily build a connector with the Airbyte CDK (Connector Developer Kit), which generates 75% of the code required. Templates are provided for building new connectors in Java or Python.

Using the Airbyte CDK enables users to build connectors to data sources in less than two hours, as compared with at least two days for most REST application programming interfaces (APIs). It standardizes the way connectors are built, maintained, and scaled, thus commoditizing data integration. There is no expectation for users to maintain the connectors they create. The intent is for Airbyte’s core team and the community to help maintain the connector.

Recommended ITech News: Infobip To Power Expresso Senegal Customer Communication With Whatsapp

Related posts

Improving vaccine cold chain integrity with IoT analytics through SAS and NC Collaboratory partnership

Stephen J. Luczo Retires from Seagate Technology’s Board of Directors

CIO Influence News Desk

Red Hat Rewrites The Business Automation Playbook With End-to-End Kubernetes-Native Decision Management Capabilities

CIO Influence News Desk

Leave a Comment