Apache Kafka and Confluent Platform Reference Architecture

This white paper provides a reference for data architects and system administrators who are planning to deploy Apache Kafka and Confluent Platform in production.

You will learn:

• Important considerations for production deployments to ensure the success and scalability of your streaming platform
• Guidelines for hardware selection and the selection of instances for cloud providers
• Recommendations on how to deploy the Kafka Connect API in production
• Best practices for deploying components of Confluent Platform that integrate with Apache Kafka, such as the Confluent Schema Registry, Confluent REST Proxy and Confluent Control Center.

Author

Gwen Shapira, Principal Data Architect, Confluent

Gwen is a principal data architect at Confluent. She has 15 years of experience working with code and customers to build scalable data architectures, integrating relational and big data technologies. She currently specializes in building real-time reliable data processing pipelines using Apache Kafka. Gwen is an Oracle Ace Director, an author of books including Kafka: The Definitive Guide and a frequent presenter at data related conferences. Gwen is also a committer on the Apache Kafka and Apache Sqoop projects.