使用Telegraf+GrayLog实现Linux业务系统服务异常时自动推送钉钉告警
实现过程参考Telegraf官方文档
https://docs.influxdata.com/telegraf/v1.24/get_started/
https://github.com/influxdata/telegraf/blob/release-1.24/plugins/inputs/exec/README.md
https://sbcode.net/grafana/telegraf-inputs-exec-monitor-ssh-sessions/
步骤较简单,下面只展示配置时的一些截图
(图片点击放大查看)
(图片点击放大查看)
(图片点击放大查看)
(图片点击放大查看)
(图片点击放大查看)
记得GrayLog上开放input设置的端口
firewall-cmd --permanent --zone=public --add-port=12201/udp
firewall-cmd --reload
(图片点击放大查看)
1、业务服务器上创建一个XX服务检测脚本
(图片点击放大查看)
vim /opt/service_check.sh
#!/bin/sh
status=$(/usr/bin/systemctl status sshd | grep Active | awk -F "since" '{print $1}')
echo $status
chmod 777 /opt/service_check.sh
rpm -ivh telegraf-1.24.3-1.x86_64.rpm
telegraf --sample-config --input-filter exec --output-filter graylog > telegraf.conf
vim telegraf.conf
(图片点击放大查看)
最终的telegraf.conf 配置文件如下
#cat telegraf.conf | grep -v ^# | grep -v ^$ | grep -v ^.*## | grep -v ^.*#
[global_tags]
[agent]
interval = "10s"
round_interval = true
metric_batch_size = 1000
metric_buffer_limit = 10000
collection_jitter = "0s"
flush_interval = "10s"
flush_jitter = "0s"
precision = "0s"
hostname = ""
omit_hostname = false
[[outputs.graylog]]
servers = ["udp://192.168.31.170:12201"]
[[inputs.exec]]
commands = [ "sh /opt/service_check.sh" ]
timeout = "10s"
name_override = "sshd_service_status_check"
data_format = "value"
data_type = "string"
interval = "45s"
cd /etc/telegraf/
mv telegraf.conf telegraf.conf_default
cp /root/telegraf.conf ./
chmod 644 telegraf.conf
systemctl start telegraf
启动报错,原因为telegraf.conf的权根
(图片点击放大查看)
(图片点击放大查看)
(图片点击放大查看)
其中 PrometheusAlert告警模板
(图片点击放大查看)
## [Graylog告警信息](.check_result.Event.Source)
### 告警描述:{{.event_definition_description}}
{{ range $k,$v:=.backlog }}
##### 告警时间:{{GetCSTtime $v.timestamp}}
##### 告警服务器名称:{{$v.source}}
##### 告警服务器IP地址:{{$v.fields.gl2_remote_ip}}
##### 服务目前状态:{{$v.fields.value}}
{{end}}
GrayLog告警配置过程截图
(图片点击放大查看)
(图片点击放大查看)
(图片点击放大查看)
(图片点击放大查看)
(图片点击放大查看)
四、最终钉钉上告警效果
(图片点击放大查看)
(图片点击放大查看)
页面更新:2024-04-02
本站资料均由网友自行发布提供,仅用于学习交流。如有版权问题,请与我联系,QQ:4156828
© CopyRight 2008-2024 All Rights Reserved. Powered By bs178.com 闽ICP备11008920号-3
闽公网安备35020302034844号