Oreilly - Apache Kafka Series - Kafka Cluster Setup and Administration

Oreilly - Apache Kafka Series - Kafka Cluster Setup and Administration

by Stéphane Maarek | Released May 2018 | ISBN: 9781789346534

https://www.oreilly.com/library/view/apache-kafka-series/9781789346534/

Hands-On Training on ZooKeeper Quorum Setup, Kafka Cluster Setup, and Administration in AWSAbout This VideoWith over 4 hours of videos and around 50 classes, you will get a great understanding of how to deploy Kafka in production and you will understand the target architecture for clusters in AWSYou will learn what ZooKeeper? is, it's role for Kafka, How to setup ZooKeeper? and its usageYou will have a complete understanding Kafka setup including setup, configuration, usage and maintenance etc.You will have a Kafka broker shutdown and recovery demonstration, which will help you to understand how to overcome the Kafka broker problemsYou will learn Kafka production settings and how to optimize settings for better performanceYou will learn all the required tool setups such as ZooNavigator, Kafka Manager, Confluent Schema Registry, Confluent REST Proxy, Landoop Kafka Topics UI.You will get hands-on learning on Kafka common Administrative tasks using Kafka ManagerIn DetailThis course is designed for system administrators, architects and developers. It includes a step-by-step guide for installing a ZooKeeper quorum and a Kafka cluster. Hands-on training on Kafka administration is also provided.This course has Amazon Web Services for our cloud environment, which is used by many companies around the world. AWS knowledge is a pre-requisite. This course reveals exactly how your Kafka cluster on multiple machines should be set up and configured. We will start with understanding the Kafka basics, cluster size and the configuration. We will also have hands-on learning on the AWS set up, single broker set up, multi broker set up, testing the cluster, Kafka manager (cluster management), demonstrating Kafka resiliency and so on. We will enlighten you on Kafka performance with respect to I/Os, network, RAM, CPU, OS (Operating System) and so on. Includes hands-on learning on how to run Kafka in production on AWS, how to change a Kafka broker configuration and we will also cover the advanced Kafka configurations.Downloading the example code for this course: You can download the example code files for all Packt video courses you have purchased from your account at http://www.PacktPub.com. If you purchased this course elsewhere, you can visit http://www.PacktPub.com/support and register to have the files e-mailed directly to you. Show and hide more Publisher Resources Download Example Code

Chapter 1 : Course Introduction and Pre Requisites
- Course Objectives 00:03:28
- What is not covered in this course? 00:02:59
- Pre-Requisites: This is a Challenging course! 00:03:03
- Who is this course for? 00:01:06
- About me! 00:00:55
- 5 Golden Course Rules 00:02:13
Chapter 2 : Target Architecture
- Cloud Provider: AWS & Alternatives 00:02:16
- Zookeeper Quorum Architecture 00:01:06
- Kafka Cluster Architecture 00:02:43
- Final Architecture (with Web Tools) 00:01:10
- Note on IP addresses and DNS 00:03:21
Chapter 3 : Zookeeper Quorum Setup
- What is Zookeeper? 00:04:56
- Zookeeper Role in a Kafka Cluster 00:02:50
- Zookeeper Quorum Sizing 00:05:33
- Zookeeper Configuration 00:03:15
- Hands-On: Zookeeper AWS Setup 00:11:26
- How to SSH Into our Servers? 00:04:19
- Hands-On: Single Zookeeper Machine Setup 00:12:52
- Hands-On: Zookeeper Service Setup 00:06:23
- Using the Zookeeper Command Line Interface (CLI) 00:08:13
- Hands-On: Zookeeper Quorum setup - Part 1 AWS 00:08:04
- Hands-On: Zookeeper Quorum Setup - Part 2 Zookeeper 00:15:08
- Zookeeper Four Letter Words 00:04:52
- Zookeeper Internal File System 00:02:00
- Factors impacting Zookeeper Performance 00:01:58
- Note: Zookeeper in AWS 00:01:49
- Hands-On: Web tools AWS machine Docker setup 00:06:21
- Management Tools for Zookeeper & Zoonavigator demo 00:07:29
Chapter 4 : Kafka Cluster Setup
- Kafka Basics 00:01:50
- Kafka Cluster Size Discussions 00:04:26
- Kafka Configuration 00:08:27
- Hands-On: Kafka AWS Setup 00:11:29
- Hands-On: Single Kafka Broker Setup 00:12:07
- Hands-On: Running Kafka Commands 00:05:11
- Hands-On: Kafka Multi Broker (Cluster) Setup 00:10:52
- Hands-On: Testing the Kafka Cluster 00:05:37
- Can I connect to my Kafka cluster? 00:03:29
- advertised.listeners setting - most important setting 00:06:11
- Hands-On: Kafka Manager (Cluster Management) 00:10:30
- Hands-On: Demonstrating Kafka Resiliency 00:14:25
- Kafka Performance: I/O 00:01:48
- Kafka Performance: Network 00:02:06
- Kafka Performance: RAM 00:03:28
- Kafka Performance: CPU 00:01:35
- Kafka Performance: OS (Operating System) 00:01:28
- Kafka Performance: Other 00:01:10
- Running Kafka in Production on AWS 00:01:36
- Hands-On: How to change a Kafka Broker Configuration 00:04:02
- Advanced Kafka Configuration 00:05:43
- Landoop Kafka Topics UI, Confluent REST Proxy, Confluent Schema Registry Setup 00:05:38
Chapter 5 : Next steps!
- What's Next? Learning further 00:01:13