setting up openshift alert manager mail alerting based on critical and warning

-
Configure alert manager to send mail. This will send mail to 2 diffrent groups
one is managemnet group for ciritical alerts only and second is default group for all alerts.

$  oc project openshift-monitoring

The secret file where alertmanager.yaml content ( encoded in base64 ) will remain is alertmanager-main

convert the yaml content into base64 first
$  cat alertmanager.yaml | base64 -w0

copy value
now edit secret

$ oc edit secret alertmanager-main

find value starts with
alertmanager.yaml:

replace all base64 content from your own . save and exit

now in order to take this secret in effect we must bounce the pod

$  oc delete po -l alertmanager=main

check if all pod came online

$  oc get po -l alertmanager=main

done!

alertmanager.yaml content

resolve_timeout: 5m
route:
group_wait: 30s
group_interval: 5m
repeat_interval: 12h
receiver: default
routes:
- match:
alertname: DeadMansSwitch
repeat_interval: 5m
receiver: deadmansswitch
- match:
severity: critical
receiver: itops
receivers:
- name: default
email_configs:
- send_resolved: true
# Whether or not to notify about resolved alerts.
# The email address to send notifications to.
to: [email protected]
# The sender address.
from: [email protected]
# The SMTP host through which emails are sent.
smarthost: 192.168.1.5:25
# The hostname to identify to the SMTP server.
hello: localmail.mevijay.com
# The SMTP TLS requirement.
require_tls: false
- name: itops
email_configs:
- send_resolved: true
# Whether or not to notify about resolved alerts.
# The email address to send notifications to.
to: [email protected]
# The sender address.
from: [email protected]
# The SMTP host through which emails are sent.
smarthost: 192.168.1.5:25
# The hostname to identify to the SMTP server.
hello: localmail.mevijay.com
# The SMTP TLS requirement.
require_tls: false
- name: deadmansswitch
global:


--note change value of your mail server and from mailid  and to mail id


































Comments











Post a Comment



















Popular posts from this blog









Running web ssh client on port 443 /80 with nginx as reverse proxy






-















Package used         : shellinabox , nginx Repository used        : epel-release Linux distro used    : Centos 7.6 nginx reverse proxy server ip : 192.168.1.65 shellinabox web ssh server ip : 192.168.1.111 login to web ssh server first install epel-repo # yum install epel-release -y install shellinabox package # yum -y install shellinabox start and enable shellinaboxd service # systemctl enable shellinaboxd && systemctl start shellinaboxd By default shellinaboxd service starts with ssl port 4200 for us to run this in a reverse proxy environment need to make this as insecure hence the encryption will be done by nginx to end user. edit file /etc/sysconfig/shellinabox  like bellow- USER=shellinabox GROUP=shellinabox CERTDIR=/var/lib/shellinabox PORT=4200 OPTS="--disable-ssl-menu -s /:LOGIN" OPTS="-t -s /:SSH:192.168.1.111" save file exit and restart service # systemctl restart shellinaboxd Now open fire...








Read more










Running cockpit behind nginx reverse proxy with nginx ssl and cockpit non ssl






-















Domain for web access to cockpit : cockpit.mylab.local   cockpit server ip : 192.168.1.61  nginx server ip   : 192.168.1.65  Linux distro using is Centos 7.6   Login to cockpit server   Create a file  [root@repo ~]# vim /etc/cockpit/cockpit.conf  content will be like   [WebService]  Origins = https://cockpit.mylab.local wss://cockpit.mylab.local  ProtocolHeader = X-Forwarded-Proto  AllowUnencrypted = true   save and restart cockpit   # systemctl restart cockpit   now  login to your nginx webserver and install nginx   # yum install nginx -y   create a new file vim /etc/nginx/conf.d/cockpit.conf   paste content as bellow   server {      listen         80;      listen         443 ssl http2;      server_name    cockpit.mylab.local;      ssl_certificate /etc/ssl/certs/cockpit-selfsigned.crt;      ssl_certifica...








Read more










Setup VOD streaming server with nginx using RTMP on Ubuntu 18.04






-















  Install required packages for source code nginx build # apt-get install -y build-essential ca-certificates wget curl libpcre3 libpcre3-dev autoconf unzip automake libtool tar git libssl-dev zlib1g-dev uuid-dev lsb-release vim htop sysstat ufw fail2ban makepasswd libgd-dev libgeoip-dev -y create a directory # mkdir /usr/local/src/nginx/ # cd /usr/local/src/nginx/ download and extract nginx tar # wget -qO- http://nginx.org/download/nginx-1.14.2.tar.gz | tar zxf - clone nginx rtmp module # git clone https://github.com/arut/nginx-rtmp-module Download other modules - PCRE version 8.42 # wget https://ftp.pcre.org/pub/pcre/pcre-8.42.tar.gz && tar xzvf pcre-8.42.tar.gz - zlib version 1.2.11 # wget https://www.zlib.net/zlib-1.2.11.tar.gz && tar xzvf zlib-1.2.11.tar.gz - OpenSSL version 1.1.0h # wget https://www.openssl.org/source/openssl-1.1.0h.tar.gz && tar xzvf openssl-1.1.0h.tar.gz # cd nginx-1.14.2/ configure  nginx with modules and options # ./configure --add-...








Read more