Elasticsearch通过elasticsearch-curator 插件来定期删除Index「终于解决」

Elasticsearch通过elasticsearch-curator 插件来定期删除Index「终于解决」Elasticsearch管理中索引的管理非常重要。基于磁盘空间和性能的考量,索引的生命周期管理显得尤为重要。Curator允许对索引创建、删除等操作,下面是我们借助 elasticsearch-cu

Elasticsearch通过elasticsearch-curator 插件来定期删除Index

Elasticsearch管理中索引的管理非常重要。基于磁盘空间和性能的考量,索引的生命周期管理显得尤为重要。Curator允许对索引创建、删除等操作,下面是我们借助 elasticsearch-curator 插件来定期删除index.本文主要介绍elasticsearch-curator 插件的安装步骤。

Step 1下载

https://www.elastic.co/guide/en/elasticsearch/client/curator/current/yum-repository.html

Elasticsearch通过elasticsearch-curator 插件来定期删除Index「终于解决」

 

 

 Step 2 上传安装包至服务器,并创建相应的文件

 Elasticsearch通过elasticsearch-curator 插件来定期删除Index「终于解决」

Step 3 安装

执行的安装命令如下:

yum localinstall elasticsearch-curator-5.8.1-1.x86_64.rpm

代码100分

Step 4  完善更新配置文件

 config.yml文件

Elasticsearch通过elasticsearch-curator 插件来定期删除Index「终于解决」

详细内容如下:

代码100分---
# Remember, leave a key empty if there is no value.  None will be a string,
# not a Python "NoneType"
client:
  hosts:
    - 201.101.101.101
  port: 端口
  url_prefix:
  use_ssl: False
  certificate:
  client_cert:
  client_key:
  ssl_no_validate: False
  http_auth: 用户名:密码
  timeout: 30
  master_only: False

logging:
  loglevel: INFO
  logfile: /data/elasticsearch-curator/log/curator.log
  logformat: default
  blacklist: ["elasticsearch", "urllib3"]

action.yml 文件的编辑

Elasticsearch通过elasticsearch-curator 插件来定期删除Index「终于解决」

 

 

 详细内容如下:

---
# Remember, leave a key empty if there is no value.  None will be a string,
# not a Python "NoneType"
#
# Also remember that all examples have "disable_action" set to True.  If you
# want to use this action as a template, be sure to set this to False after
# copying it.
actions:
  1:
    action: delete_indices
    description: >-
      Delete metric indices older than 3 days (based on index name), for
      .monitoring-es-6-
      .monitoring-kibana-6-
      .monitoring-logstash-6-
      .watcher-history-3-
      prefixed indices. Ignore the error if the filter does not result in an
      actionable list of indices (ignore_empty_list) and exit cleanly.
    options:
      ignore_empty_list: True
 #     disable_action: True
    filters:
    - filtertype: pattern
      kind: regex
      value: "^mysql-.*$"
    - filtertype: age
      source: name
      direction: older
      timestring: "%Y.%m.%d"
      unit: days
      unit_count: 3

  2:
    action: close
    description: >-
      Close indices older than 30 days (based on index name), for syslog-
      prefixed indices.
    options:
      ignore_empty_list: True
      delete_aliases: False
#      disable_action: True
    filters:
    - filtertype: pattern
      kind: prefix
      value: syslog-
    - filtertype: age
      source: name
      direction: older
      timestring: "%Y.%m.%d"
      unit: days
      unit_count: 30

  3:
    action: forcemerge
    description: >-
      forceMerge syslog- prefixed indices older than 2 days (based on index
      creation_date) to 2 segments per shard.  Delay 120 seconds between each
      forceMerge operation to allow the cluster to quiesce. Skip indices that
      have already been forcemerged to the minimum number of segments to avoid
      reprocessing.
    options:
      ignore_empty_list: True
      max_num_segments: 2
      delay: 120
      timeout_override:
      continue_if_exception: False
    filters:
    - filtertype: pattern
      kind: prefix
      value: syslog-
      exclude:
    - filtertype: age
      source: name
      direction: older
      timestring: "%Y.%m.%d"
      unit: days
      unit_count: 2
    - filtertype: forcemerged
      max_num_segments: 2
      exclude:

Step 5 使用crontab定期执行curator

设置定时任务,例如以下的crontab

代码100分6 0 * * * curator --config /data/elasticsearch-curator/config.yml /data/elasticsearch-curator/action.yml

 

版权声明:本文内容由互联网用户自发贡献,该文观点仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 举报,一经查实,本站将立刻删除。
转载请注明出处: https://daima100.com/7892.html

(0)
上一篇 2023-03-11
下一篇 2023-03-11

相关推荐

发表回复

您的电子邮箱地址不会被公开。 必填项已用*标注