Create and setup a Ceph Storage cluster in using very easy step.

-

          Ceph is a widely used open source storage platform. It provides high performance, reliability, and scalability. The Ceph free distributed storage system provides an interface for object, block, and file-level storage. Ceph is build to provide a distributed storage system without a single point of failure.
A Ceph cluster requires these Ceph components:

    Ceph OSDs (ceph-osd) - Handles the data store, data replication and recovery. A Ceph cluster needs at least two Ceph OSD servers. I will use three CentOS 7 OSD servers here.
    Ceph Monitor (ceph-mon) - Monitors the cluster state, OSD map and CRUSH map. I will use one server.
    Ceph Meta Data Server (ceph-mds) - This is needed to use Ceph as a File System.

For a new learner of ceph, it is a bigger challange to install and setup ceph cluster. I am telling you a very simple way how you can setup a ceph storage cluster by performing few steps only.

SETUP:-
In my setup i have 3 centos 7 VM
IP
ceph1.mylab.local    192.168.1.21
ceph2.mylab.local    192.168.1.22
ceph3.mylab.local    192.168.1.23

and one laptop running fedora from where i will run ansible playbook

Note- configure your dns as per above or make entries in hosts file.

I have two disk attached in all three VM
50GB  for OS
100GB for OSD or storage
Install Centos 7 minimum on all three node
Once centos 7 installation finished on all three node
--- Steps to perform on Laptop or your workstation from where you will run ansible playbooks
1) install ansible 2.8
  # yum install https://releases.ansible.com/ansible/rpm/release/epel-7-x86_64/ansible-2.8.8-1.el7.ans.noarch.rpm -y
 Generate ssh-key
 # ssh-keygen
 copy ssh public to all ceph node
 # ssh-copy-id root@ceph1
 # ssh-copy-id root@ceph2
 # ssh-copy-id root@ceph3

create ansible host inventory file
# vim /etc/ansible/hosts

[all:vars]
ansible_ssh_user=root
[grafana-server]
ceph1
[mons]
ceph1
[mgrs]
ceph1
[osds]
ceph1
ceph2
ceph3


save and exit

2) clone ceph ansible git repo
# git clone https://github.com/ceph/ceph-ansible
3) edit the groupvars files
# cd ceph-ansible/group_vars/
# vim all.yaml
# create new
ceph_origin: repository
ceph_repository: community
ceph_repository_type: cdn
ceph_stable_release: nautilus

fetch_directory: ~/ceph-ansible-keys

# set network interface for monitoring
monitor_interface: ens3
# specify your public network
public_network: 192.168.1.0/22
# specify cluster network
# if it's the same with public network, set like follows
# if not the same, specify your cluster network
cluster_network: "{{ public_network }}"
-- Please take care of your network interface name and network subnet

# vim osds.yml

devices:
  - /dev/sda
save and exit.

4) Now rename site.yml.sample  file

# cd ..
# mv site.yml.sample site.yml

5) Now you can run the ansible playbook.

# ansible-playbook site.yml

Installation will be complete with bellow msg

INSTALLER STATUS **********************************
Install Ceph Monitor           : Complete (0:00:17)
Install Ceph Manager           : Complete (0:01:26)
Install Ceph OSD               : Complete (0:00:52)
Install Ceph Dashboard         : Complete (0:00:23)
Install Ceph Grafana           : Complete (0:01:04)
Install Ceph Node Exporter     : Complete (0:01:36)

Done !

Comments

Post a Comment

Popular posts from this blog

using libguestfs virt-customize tool to modify qcow2 image and reset root password.

-
ibguestfs is a C library and a set of tools for accessing and modifying virtual disk images used in platform virtualization. The tools can be used for viewing and editing virtual machines managed by libvirt and files inside VMs, scripting changes to VMs, creating VMs, and much else beside. virt-customize is one of them as example. If you forgot root user password here is how you can modify . # virsh shutdown debian9-vm1 # virt-customize -a /var/lib/libvirt/images/debian9-vm1.qcow2 --root-password password:NewRootUserPasswordHere  not only this but you can edit many more. The –run-command option is used to execute any command inside a virtual image file. 1) register with rhel subscription virt-customize -a rhel-server-7.6.qcow2 --run-command 'subscription-manager attach --pool [subscription-pool]'     Install software or packages- virt-customize -a rhel-server-7.6.qcow2 --install net-tools  Upload a file into image virt-customize -a rhel-se...
Read more

Running cockpit behind nginx reverse proxy with nginx ssl and cockpit non ssl

-
Domain for web access to cockpit : cockpit.mylab.local cockpit server ip : 192.168.1.61 nginx server ip   : 192.168.1.65 Linux distro using is Centos 7.6 Login to cockpit server Create a file [root@repo ~]# vim /etc/cockpit/cockpit.conf content will be like [WebService] Origins = https://cockpit.mylab.local wss://cockpit.mylab.local ProtocolHeader = X-Forwarded-Proto AllowUnencrypted = true save and restart cockpit # systemctl restart cockpit now  login to your nginx webserver and install nginx # yum install nginx -y create a new file vim /etc/nginx/conf.d/cockpit.conf paste content as bellow server {     listen         80;     listen         443 ssl http2;     server_name    cockpit.mylab.local;     ssl_certificate /etc/ssl/certs/cockpit-selfsigned.crt;     ssl_certifica...
Read more

setting up openshift alert manager mail alerting based on critical and warning

-
Configure alert manager to send mail. This will send mail to 2 diffrent groups one is managemnet group for ciritical alerts only and second is default group for all alerts. $  oc project openshift-monitoring The secret file where alertmanager.yaml content ( encoded in base64 ) will remain is alertmanager-main convert the yaml content into base64 first $  cat alertmanager.yaml | base64 -w0 copy value now edit secret $ oc edit secret alertmanager-main find value starts with alertmanager.yaml: replace all base64 content from your own . save and exit now in order to take this secret in effect we must bounce the pod $  oc delete po -l alertmanager=main check if all pod came online $  oc get po -l alertmanager=main done! alertmanager.yaml content resolve_timeout : 5m route : group_wait : 30s group_interval : 5m repeat_interval : 12h ...
Read more