Elasticsearch集群搭建手册及配置详情(基于elasticsearch-8.5.2版本)

Elasticsearch集群搭建手册及配置详情(基于elasticsearch-8.5.2版本)

0 安装前准备工作

0.1 安装包下载

0.2 自定义部署标准

0.3 节点角色划分

0.4 elasticsearch目录介绍

0.5 系统重要配置介绍

0.6 elasticsearch重要配置项介绍

0.7 elasticsearch产品兼容性

1 修改系统重要配置

1.1 线程数,句柄数和锁定内存

修改es用户创建的最小线程数,可打开的最小文件描述符和文件句柄,锁定内存

文件：/etc/security/limits.d/90-nproc.conf（或/etc/security/limits.conf）

echo 'es  -  nproc   4096' >> /etc/security/limits.d/90-nproc.conf
echo 'es  -  nofile  65535' >> /etc/security/limits.d/90-nproc.conf
echo 'es soft memlock unlimited' >> /etc/security/limits.d/90-nproc.conf
echo 'es hard memlock unlimited' >> /etc/security/limits.d/90-nproc.conf

1.2 修改内核参数

文件：/etc/sysctl.conf

echo 'vm.max_map_count=262144'	>> /etc/sysctl.conf
echo 'vm.swappiness=0'			>> /etc/sysctl.conf
echo 'vm.overcommit_memory=1'	>> /etc/sysctl.conf
echo 'vm.zone_reclaim_mode=0'	>> /etc/sysctl.conf
echo 'net.ipv4.tcp_retries2=5'	>> /etc/sysctl.conf

#执行命令生效
sysctl -p

2 软件部署

2.1 创建es用户及用户组

root用户操作

groupadd es -g 750 && useradd -g es -u 750 es

2.2 配置用户环境变量

cd /home/es
echo 'export ES_HOME=/home/es/software/elasticsearch' >> .bashrc
echo 'export ES_TMPDIR=/home/es/logs/tmp' >> .bashrc
echo 'export JAVA_HOME=/home/es/software/java' >> .bashrc
echo 'export PATH=$JAVA_HOME/bin:$ES_HOME/bin:$PATH' >> .bashrc

2.3 创建相关目录

软件目录

su - es -c "mkdir /home/es/software"  

日志目录

su - es -c "mkdir -p /home/es/logs;mkdir -p /home/es/logs/tmp"  

数据目录

elastic官网提示在 7.13.0 中弃用多个数据路径，每个节点（或进程服务）只能配置一个数据路径。

mkdir /data00/es-v8.5.2;mkdir /data01/es-v8.5.2;mkdir /data02/es-v8.5.2

chown es:es /data*/es-v8.5.2

2.4 上传软件包

上传软件包到/home/es/software目录下

scp elasticsearch-8.5.2-linux-x86_64.tar.gz $ip:/home/es/software

scp openjdk-17.0.1_linux-x64_bin.tar.gz $ip:/home/es/software

解压软件包，为elasticsearch和jdk创建软连接，和环境变量路径保持一致

cd /home/es/software
tar -zxvf elasticsearch-8.5.2-linux-x86_64.tar.gz
rm -f elasticsearch-8.5.2-linux-x86_64.tar.gz
ln -s elasticsearch-8.5.2 elasticsearch
tar -zxvf openjdk-17.0.1_linux-x64_bin.tar.gz
rm -f openjdk-17.0.1_linux-x64_bin.tar.gz
ln -s jdk-17.0.1 java
chown -R es:es /home/es

3 修改elasticsearch重要配置项

切换到es用户下执行

su - es

cd /home/es/software/elasticsearch/config/

3.1 node-1节点elasticsearch.yml

cluster.name: es-v8.5.2
node.name: node-1
path.data: /data00/es-v8.5.2,/data01/es-v8.5.2,/data02/es-v8.5.2
path.logs: /home/es/logs
bootstrap.memory_lock: true
network.host: 192.168.168.1
discovery.seed_hosts: ["192.168.168.1", "192.168.168.2" , "192.168.168.3"]
cluster.initial_master_nodes: ["192.168.168.1", "192.168.168.2" , "192.168.168.3"]
xpack.security.enabled: false

3.2 node-2节点修改elasticsearch.yml

cluster.name: es-v8.5.2
node.name: node-2
path.data: /data00/es-v8.5.2,/data01/es-v8.5.2,/data02/es-v8.5.2
path.logs: /home/es/logs
bootstrap.memory_lock: true
network.host: 192.168.168.2
discovery.seed_hosts: ["192.168.168.1", "192.168.168.2" , "192.168.168.3"]
cluster.initial_master_nodes: ["192.168.168.1", "192.168.168.2" , "192.168.168.3"]
xpack.security.enabled: false

3.3 node-3节点修改elasticsearch.yml

cluster.name: es-v8.5.2
node.name: node-3
path.data: /data00/es-v8.5.2,/data01/es-v8.5.2,/data02/es-v8.5.2
path.logs: /home/es/logs
bootstrap.memory_lock: true
network.host: 192.168.168.3
discovery.seed_hosts: ["192.168.168.1", "192.168.168.2" , "192.168.168.3"]
cluster.initial_master_nodes: ["192.168.168.1", "192.168.168.2" , "192.168.168.3"]
xpack.security.enabled: false

3.4 node-4节点修改elasticsearch.yml

cluster.name: es-v8.5.2
node.name: node-4
path.data: /data00/es-v8.5.2,/data01/es-v8.5.2,/data02/es-v8.5.2
path.logs: /home/es/logs
bootstrap.memory_lock: true
network.host: 192.168.168.4
discovery.seed_hosts: ["192.168.168.1", "192.168.168.2" , "192.168.168.3"]
xpack.security.enabled: false

3.5 node-5节点修改elasticsearch.yml

cluster.name: es-v8.5.2
node.name: node-5
path.data: /data00/es-v8.5.2,/data01/es-v8.5.2,/data02/es-v8.5.2
path.logs: /home/es/logs
bootstrap.memory_lock: true
network.host: 192.168.168.5
discovery.seed_hosts: ["192.168.168.1", "192.168.168.2" , "192.168.168.3"]
xpack.security.enabled: false

4 依次启动Elasticsearch服务

切换到es用户下执行

su - es

cd /home/es/software/elasticsearch/bin/

./elasticsearch -d

#es用户下jps -ml查看Elasticsearch服务是否存在
jps -ml

5 验证集群服务

#查看集群监控状态
$ curl -XGET 'http://192.168.168.1:9200/_cat/health?v'
epoch      timestamp cluster   status node.total node.data shards pri relo init unassign pending_tasks max_task_wait_time active_shards_percent
1669797905 08:45:05  es-v8.5.2 green           5         5      0   0    0    0        0             0                  -                100.0%

#查看节点状态
$ curl -XGET 'http://192.168.168.1:9200/_cat/nodes?v&s=name'
ip            heap.percent ram.percent cpu load_1m load_5m load_15m node.role   master name
192.168.168.1           11          49   0    0.00    0.01     0.05 cdfhilmrstw -      node-1
192.168.168.2            6          98   0    0.00    0.01     0.05 cdfhilmrstw -      node-2
192.168.168.3            4          99   0    0.00    0.01     0.05 cdfhilmrstw *      node-3
192.168.168.4            2          99   0    0.00    0.05     0.09 cdfhilmrstw -      node-4
192.168.168.5            2          99   7    0.61    0.21     0.11 cdfhilmrstw -      node-5

6 删除cluster.initial_master_nodes配置项

删除master节点中cluster.initial_master_nodes: [“192.168.168.1”, “192.168.168.2” , “192.168.168.3”]配置项。

附录

附1 Elasticsearch和JDK兼容性对应关系表

转载：https://blog.csdn.net/qq_43005694/article/details/128133759