Airbyte, creator of an open-source data movement infrastructure, is offering PyAirbyte, an open-source Python library that makes it easy to move data across API sources and destinations.
According to the company, the solution enables Airbyte resources to be created and managed using code, rather than the user interface (UI).
Python users gain access to Airbyte’s more than 250 data connectors—rather than having to build and maintain those themselves.
“A majority of existing data pipelines are written in Python today,” said Michel Tricot, co-founder and CEO, Airbyte. “We’ve seen growing demand for this capability, which provides a natural fit into the coding workflow and only requires running one command.”
PyAirbyte is an addition to the Airbyte API and Terraform Provider, which enable Airbyte resources to be managed programmatically—streamlining workflows and integrating Airbyte configurations with existing data infrastructure, according to the company. Other deployment models include Airbyte Open Source, Airbyte Self-Managed, Airbyte Cloud, and Powered by Airbyte.
Key features and benefits of PyAirbyte include:
- Programmatically manage data movement: Airbyte resources can now be created and managed through code, providing a more efficient and scalable approach for managing data pipelines.
- Integrate Airbyte configuration within existing data infrastructure: PyAirbyte enables users to merge changes to Airbyte configurations, enhancing workflow efficiency and simplifying the deployment process.
- Automate Airbyte configuration management: Leveraging automation minimizes the likelihood of errors and improves efficiency, saving engineering time.
- Compatibility: Works with open-source orchestration tools, like Airflow and Dagster, as well as LangChain for creation of applications using large language models (LLMs).
For more information about this news, visit https://airbyte.com.