FirstMark-backed data pipeline platform Estuary now offers a new way to stream data: Dekaf, which helps developers avoid complex Kafka configurations in their data architecture while being able to connect with Kafka consumers.

The Premise

Real-time event-driven architecture and message streaming between decoupled services are integral to modern applications. And the open-source Apache Kafka platform has been instrumental in the widespread implementation of real-time capabilities. Based on a publish/subscribe or producer/consumer model, Kafka lets applications handle data in motion.

However, maintaining an entire Kafka ecosystem can be a hassle. A full setup can include managing Kafka clusters, brokers, topics, and a schema registry. Starting from scratch with Kafka can delay teams trying to get up and running quickly, or dissuade them from ideating and iterating on event-driven features that would improve their product.

This type of blocker is especially apparent when integrating with other platforms. Because Kafka has become so widespread (used at 80% of Fortune 100 companies), it can act as a lingua franca—a common way for different platforms to communicate. And if your application doesn’t speak that language, you can miss out on valuable opportunities.

The options so far seem grim: spend a lot of time and developer effort on a complicated ecosystem that may only tangentially relate to your core offering, or forgo important integrations, potentially losing out on benefits like real-time analytics.

How Estuary Helps

Estuary adds a third option into this mix: stream your data to Kafka consumers without the mess of traditional Kafka setup.

Estuary does this with Dekaf, Estuary’s Kafka API compatibility layer. Essentially, Estuary acts as a Kafka broker and schema registry. Users can tap into these resources with a simple plug-and-play connector.

This opens up a world of possible integrations, allowing users to stream data in real time from application databases, APIs, webhooks, and logs into analytics or observability databases and platforms, like ClickHouse, Tinybird, StarTree, and more.

Dekaf’s Reception

Released as Generally Available in early April following a beta period, Dekaf has already generated plenty of buzz in the data community, including at an exclusive real-time data meetup hosted at FirstMark’s office. Estuary partnered with Tinybird and mutual customer PlayOn Sports to showcase a complete real-world example of Dekaf unlocking the otherwise esoteric Kafka ecosystem.

Chris Morgan, Director of Software Engineering at PlayOn, detailed how Estuary helps PlayOn process over 5 TB of data every month, across 27 different sources. Downstream, their Tinybird integration then uses 46 Estuary Dekaf sources so PlayOn can have a complete view of athletics events, ticketing, and more.

Other early adopters of Dekaf include Recart, a marketing platform for Shopify stores. Wanting to transfer MongoDB data to a robust analytics solution, Recart chose to use Dekaf to easily connect to SingleStore. Recart’s CTO, Istvan Kovacs, commented on Recart’s experience, explaining that “Estuary became our real-time data backbone without the cost or complexity of traditional solutions. We replaced a fragile, high-maintenance pipeline with a managed system that just works and scales.”

How Developers Can Join the (Data) Movement

By taking the Kafka out of Kafka integration, Estuary helps companies grow and be successful. Dekaf lets established companies simplify their data architecture while providing startups a head start so they don’t get bogged down in Kafka minutiae.

Developers can try out Dekaf for free to see if it’s right for their use case, take a product tour, or follow Estuary on LinkedIn to stay up-to-date on new product and event announcements.