Project Metamorphosis: Unveiling the next-gen event streaming platformLearn More

A Look Back at Kafka Summit San Francisco 2017

Another successful Kafka Summit is in the books! Around 800 Apache Kafka® committers, users, and enthusiasts joined us at the Hilton Union Square in San Francisco for a day of food, networking, and intense education. 

kafka-summit

Here are the highlights:

  • Allen Wang of Netflix gave us a litany of battle-tested recommendations for running Kafka at scale at Netflix. For example, is it hard to repartition your topics? Well, then don’t—just move the data in the old topic to a new one and remove the old one. A lot of Allen’s recommendations sounded like an application of the notion of immutable infrastructure to Kafka architectural questions.
  • Amy Boyle of New Relic presented From Scaling Nightmare to Stream Dream: Real-time Stream Processing at Scale. Amy is personally on the hook for the performance of systems that handle billions of monitoring events every hour, and she explained how it matters to her whether the systems she deploys work or not. Switching to events as a means of integrating New Relic’s microservices architecture helped them avoid, in Amy’s words, a costly scaling nightmare.
  • Matthias Sax of Confluent gave what you might call the usual introduction to the Streams API for Kafka, then with a not-at-all usual twist: interactive queries. He showed us methods on the Kafka Streams class that provide direct access to the state store in a Streams application. He explained how this can provide an additional line of architectural defense against deploying a database instance as a part of a Streams-based microservice. This is a pretty timely topic, since “Do I put a database in it?” is a question many of us are asking and answering in the microservices world right now.

And in case you missed it, you should be aware of these things as well:

  • KSQL is a thing and is in developer preview.
  • Jay Kreps announced that Apache Kafka will be going 1.0 this year.
  • If you didn’t make it through the book signing line for your copy of Kafka: The Definitive Guide, you can download a copy of the book online.
  • Our video wall footage highlighted the growth of the Kafka community in GitHub, Stack Overflow, and in the Confluent Community Slack organization.
  • We’re going to be having a London Summit on April 23-24, 2018.
  • The next San Francisco Summit will be on October 16-17, 2018.

Finally, we’re continuously working to improve your experience at Kafka Summit. If you haven’t had a chance to do so, please complete the event survey.

As always, we’ll keep you updated here, and we hope to see you in London or San Francisco next year, if not at a Meetup before then!

Did you like this blog post? Share it now

Subscribe to the Confluent blog

More Articles Like This

Walmart’s Real-Time Inventory System Powered by Apache Kafka

Consumer shopping patterns have changed drastically in the last few years. Shopping in a physical store is no longer the only way. Retail shopping experiences have evolved to include multiple […]

Kafka Summit San Francisco 2019 Session Videos

Last week, the Kafka Summit hosted nearly 2,000 people from 40 different countries and 595 companies—the largest Summit yet. By the numbers, we got to enjoy four keynote speakers, 56 […]

Kafka Summit San Francisco 2019: Day 2 Recap

If you looked at the Kafka Summits I’ve been a part of as a sequence of immutable events (and they are, unless you know something about time I don’t), it […]

Sign Up Now

Start your 3-month trial. Get up to $200 off on each of your first 3 Confluent Cloud monthly bills

新規登録のみ。

上の「新規登録」をクリックすることにより、当社がお客様の個人情報を以下に従い処理することを理解されたものとみなします : プライバシーポリシー

上記の「新規登録」をクリックすることにより、お客様は以下に同意するものとします。 サービス利用規約 Confluent からのマーケティングメールの随時受信にも同意するものとします。また、当社がお客様の個人情報を以下に従い処理することを理解されたものとみなします: プライバシーポリシー

単一の Kafka Broker の場合には永遠に無料
i

商用版の機能を単一の Kafka Broker で無期限で使用できるソフトウェアです。2番目の Broker を追加すると、30日間の商用版試用期間が自動で開始します。この制限を単一の Broker へ戻すことでリセットすることはできません。

デプロイのタイプを選択
手動デプロイ
  • tar
  • zip
  • deb
  • rpm
  • docker
または
自動デプロイ
  • kubernetes
  • ansible

上の「無料ダウンロード」をクリックすることにより、当社がお客様の個人情報をプライバシーポリシーに従い処理することを理解されたものとみなします。 プライバシーポリシー

以下の「ダウンロード」をクリックすることにより、お客様は以下に同意するものとします。 Confluent ライセンス契約 Confluent からのマーケティングメールの随時受信にも同意するものとします。また、お客様の個人データが以下に従い処理することにも同意するものとします: プライバシーポリシー

このウェブサイトでは、ユーザーエクスペリエンスの向上に加え、ウェブサイトのパフォーマンスとトラフィック分析のため、Cookie を使用しています。また、サイトの使用に関する情報をソーシャルメディア、広告、分析のパートナーと共有しています。