Confluent building a real-time streaming platform using kafka streams and kafka...

Preview:

Citation preview

Building a real-time streaming platform using Kafka Connect + Kafka StreamsJeremy Custenborder, Systems Engineer, Confluent

• Everything in the company is a real-time stream

• > 1.2 trillion messages written per day• > 3.4 trillion messages read per day• ~ 1 PB of stream data• Thousands of engineers• Tens of thousands of producer processes

Resources• Confluent

• Company website: http://www.confluent.io• Blog: http://www.confluent.io/blog• Free Ebook “Making Sense of Stream Processing” http

://www.confluent.io/making-sense-of-stream-processing-ebook• Apache Kafka

• http://kafka.apache.org• Kafka Connect

• http://www.confluent.io/blog/announcing-kafka-connect-building-large-scale-low-latency-data-pipelines

• Kafka Streams• http://www.confluent.io/blog/introducing-kafka

-streams-stream-processing-made-simple

Thanks!Jeremy Custenborder | jeremy@confluent.io |

Download Kafkaand Confluent Platform

www.confluent.io/download

Training!http://www.confluent.io/training

Discount Code: BELLEVUE10

Operations Training in Seattle December 10th.

Recommended