With Major New Release of Ibis, Users Can Now Seamlessly Leverage the Best Query Engines for Their Needs and Maximize Productivity
Voltron Data, the company accelerating modular and composable data analytics systems,announced the release of Ibis 8.0. Ibis, downloaded more than 10 million times, is a Python dataframe API that allows developers to easily run code across a myriad of data platforms – allowing the right query engine for the job to be done. The new release has its first dedicated streaming backends for Apache Flink and RisingWave, offering a variety of batch and now streaming execution engines unified with a single Python dataframe API.
“Finally developers can write code once and use it across local, batch, CPU, GPU and now real-time query engines. Ibis is leading the charge to break down the barriers between batch and stream processing execution engines.
“Finally developers can write code once and use it across local, batch, CPU, GPU and now real-time query engines. Ibis is leading the charge to break down the barriers between batch and stream processing execution engines.
This is a big step toward a modular and composable data ecosystem across all paradigms,” said Josh Patterson, co-founder and CEO of Voltron Data.
Ibis is an independently governed open source project backed by Voltron Data and contributors across data platforms including Google, Starburst Data and RisingWave. With today’s release, users can run Ibis on 20 different query engines — ranging from DuckDB for smaller queries to BigQuery, Spark, Theseus and others for big distributed preprocessing/ETL jobs. With no code change, they can also run on two streaming engines – Apache Flink and RisingWave.
Recommended: CIO Influence Interview with Steve Stone, Head of Rubrik Zero Lab
“As the Ibis API improves and adds new functionality like ML preprocessing, every backend it supports improves with it. Users can learn a single familiar dataframe API without being locked into any backend. The open source community can add Ibis ecosystem integrations to make working with data in Python better on any data platform Ibis supports,” said Zhenzhong “Z” Xu, vice president of engineering at Voltron Data.
Recommended: Cybersecurity: What’s on the Horizon for 2024?
[To share your insights with us as part of editorial or sponsored content, please write to sghosh@martechseries.com]
