admin管理员组

文章数量:1576278

一、集群规划

kafka从2.8版本开始,就允许用户在不需要zookeeper的情况下运行。真正全面摒弃zookeeper的版本是3.0,在后面的版本kafka使用了新的元数据管理方式kraft,提高了Kafka的可扩展性、可用性和性能。

下载地址:Apache Kafka

这里下载kafka_2.13-3.4.0.tgz版本,自带有支持raft模式

主机名称 IP process.roles node.id
master 192.168.20.101 broker,controller 1
salve1 192.168.20.102 broker,controller 2
salve2 192.168.20.103 broker,controller 3

二、集群部署

将安装包上传到/opt/software目录下,解压到安装目录/opt/moudle/

[appview@master software]$ll 
-rw-rw-r--   1 appview appview 106290956 5月   2 08:26 kafka_2.13-3.4.0.tgz
[appview@master software]$ tar -zxvf kafka_2.13-3.4.0.tgz -C /opt/moudle/
[appview@master moudle]$ mv kafka_2.13-3.4.0  kafka-3.4.0
[appview@master kafka-3.4.0]$ cd config/kraft/
[appview@master kraft]$ ll
总用量 24
-rw-r--r-- 1 appview appview 6136 2月   1 2023 broker.properties
-rw-r--r-- 1 appview appview 5765 2月   1 2023 controller.properties
-rw-r--r-- 1 appview appview 6340 2月   1 2023 server.properties
[appview@master kraft]$ pwd
/opt/moudle/kafka-3.4.0/config/kraft
[appview@master kraft]$ vim server.properties

下面的文件是我的配置

只需要修改下面这几个配置成相应的ip地址以及node.id

node.id=1   (##修改)  ### node.id=2  ### node.id=3 对应我们的集群规划
controller.quorum.voters=1@192.168.20.101:9093,2@192.168.20.102:9093,3@192.168.20.103:9093
listeners=PLAINTEXT://192.168.20.101:9092,CONTROLLER://192.168.20.101:9093 (##修改)
advertised.listeners=PLAINTEXT://192.168.20.166:9092 (##修改)
log.dirs=/tmp/kraft-combined-logs (可选择)
配置文件server.properties
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements.  See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# 

本文标签: 集群操作文档KafkaZooKeeper