DuckLake & Kafka – Open Source at Inyo
By Guilherme Castro, Lead Engineer at Inyo
We are excited to share an update on our open source journey at Inyo. Today, we're introducing an open-source Kafka connector for DuckLake.
Our data engineering team is a big fan and adopter of DuckDB. DuckLake was a natural move and excellent alternative to Iceberg, and has been a great addition to our data engineering workflows, providing a practical bridge between streaming events and efficient analytical queries. But in order to keep our data pipelines simple, we needed a reliable way to ingest data. The project, created to solve our internal processes, is now released as open source at github.com/inyo-global/ducklake-kafka-connect under Apache2 license.
Open Source at Inyo
The release of this project marks our first contribution as a company. It's on our roadmap to keep sharing tools and other cool stuff with the community.
"We're actively working to improve this Kafka connector and contributing back to DuckLake with the open-source community. We are eager to continue sharing more tools and other cool stuff with the community."
Interested in building great payment products with us? We're hiring!
Related Articles
Payment Orchestrator vs Payment Gateway: What's the Difference?
Learn about the key differences between payment orchestrators and traditional payment gateways.
What is an AFT? Understanding Account Funding Transactions
Learn how Account Funding Transactions power digital wallets, prepaid cards, and online account deposits.