Create and setup a Ceph Storage cluster in using very easy step.

-

          Ceph is a widely used open source storage platform. It provides high performance, reliability, and scalability. The Ceph free distributed storage system provides an interface for object, block, and file-level storage. Ceph is build to provide a distributed storage system without a single point of failure.
A Ceph cluster requires these Ceph components:

    Ceph OSDs (ceph-osd) - Handles the data store, data replication and recovery. A Ceph cluster needs at least two Ceph OSD servers. I will use three CentOS 7 OSD servers here.
    Ceph Monitor (ceph-mon) - Monitors the cluster state, OSD map and CRUSH map. I will use one server.
    Ceph Meta Data Server (ceph-mds) - This is needed to use Ceph as a File System.

For a new learner of ceph, it is a bigger challange to install and setup ceph cluster. I am telling you a very simple way how you can setup a ceph storage cluster by performing few steps only.

SETUP:-
In my setup i have 3 centos 7 VM
IP
ceph1.mylab.local    192.168.1.21
ceph2.mylab.local    192.168.1.22
ceph3.mylab.local    192.168.1.23

and one laptop running fedora from where i will run ansible playbook

Note- configure your dns as per above or make entries in hosts file.

I have two disk attached in all three VM
50GB  for OS
100GB for OSD or storage
Install Centos 7 minimum on all three node
Once centos 7 installation finished on all three node
--- Steps to perform on Laptop or your workstation from where you will run ansible playbooks
1) install ansible 2.8
  # yum install https://releases.ansible.com/ansible/rpm/release/epel-7-x86_64/ansible-2.8.8-1.el7.ans.noarch.rpm -y
 Generate ssh-key
 # ssh-keygen
 copy ssh public to all ceph node
 # ssh-copy-id root@ceph1
 # ssh-copy-id root@ceph2
 # ssh-copy-id root@ceph3

create ansible host inventory file
# vim /etc/ansible/hosts

[all:vars]
ansible_ssh_user=root
[grafana-server]
ceph1
[mons]
ceph1
[mgrs]
ceph1
[osds]
ceph1
ceph2
ceph3


save and exit

2) clone ceph ansible git repo
# git clone https://github.com/ceph/ceph-ansible
3) edit the groupvars files
# cd ceph-ansible/group_vars/
# vim all.yaml
# create new
ceph_origin: repository
ceph_repository: community
ceph_repository_type: cdn
ceph_stable_release: nautilus

fetch_directory: ~/ceph-ansible-keys

# set network interface for monitoring
monitor_interface: ens3
# specify your public network
public_network: 192.168.1.0/22
# specify cluster network
# if it's the same with public network, set like follows
# if not the same, specify your cluster network
cluster_network: "{{ public_network }}"
-- Please take care of your network interface name and network subnet

# vim osds.yml

devices:
  - /dev/sda
save and exit.

4) Now rename site.yml.sample  file

# cd ..
# mv site.yml.sample site.yml

5) Now you can run the ansible playbook.

# ansible-playbook site.yml

Installation will be complete with bellow msg

INSTALLER STATUS **********************************
Install Ceph Monitor           : Complete (0:00:17)
Install Ceph Manager           : Complete (0:01:26)
Install Ceph OSD               : Complete (0:00:52)
Install Ceph Dashboard         : Complete (0:00:23)
Install Ceph Grafana           : Complete (0:01:04)
Install Ceph Node Exporter     : Complete (0:01:36)

Done !

Comments

Post a Comment

Popular posts from this blog

Running web ssh client on port 443 /80 with nginx as reverse proxy

-
Package used         : shellinabox , nginx Repository used        : epel-release Linux distro used    : Centos 7.6 nginx reverse proxy server ip : 192.168.1.65 shellinabox web ssh server ip : 192.168.1.111 login to web ssh server first install epel-repo # yum install epel-release -y install shellinabox package # yum -y install shellinabox start and enable shellinaboxd service # systemctl enable shellinaboxd && systemctl start shellinaboxd By default shellinaboxd service starts with ssl port 4200 for us to run this in a reverse proxy environment need to make this as insecure hence the encryption will be done by nginx to end user. edit file /etc/sysconfig/shellinabox  like bellow- USER=shellinabox GROUP=shellinabox CERTDIR=/var/lib/shellinabox PORT=4200 OPTS="--disable-ssl-menu -s /:LOGIN" OPTS="-t -s /:SSH:192.168.1.111" save file exit and restart service # systemctl restart shellinaboxd Now open firewall for listening port 4200 from nginx proxy server only #
Read more

Running cockpit behind nginx reverse proxy with nginx ssl and cockpit non ssl

-
Domain for web access to cockpit : cockpit.mylab.local cockpit server ip : 192.168.1.61 nginx server ip   : 192.168.1.65 Linux distro using is Centos 7.6 Login to cockpit server Create a file [root@repo ~]# vim /etc/cockpit/cockpit.conf content will be like [WebService] Origins = https://cockpit.mylab.local wss://cockpit.mylab.local ProtocolHeader = X-Forwarded-Proto AllowUnencrypted = true save and restart cockpit # systemctl restart cockpit now  login to your nginx webserver and install nginx # yum install nginx -y create a new file vim /etc/nginx/conf.d/cockpit.conf paste content as bellow server {     listen         80;     listen         443 ssl http2;     server_name    cockpit.mylab.local;     ssl_certificate /etc/ssl/certs/cockpit-selfsigned.crt;     ssl_certificate_key  /etc/ssl/private/cockpit-selfsigned.key;     location / {         proxy_pass http://192.168.1.61:9090;         proxy_set_header Host $host;         proxy_http_version 1.1;
Read more

Setup VOD streaming server with nginx using RTMP on Ubuntu 18.04

-
Install required packages for source code nginx build # apt-get install -y build-essential ca-certificates wget curl libpcre3 libpcre3-dev autoconf unzip automake libtool tar git libssl-dev zlib1g-dev uuid-dev lsb-release vim htop sysstat ufw fail2ban makepasswd libgd-dev libgeoip-dev -y create a directory # mkdir /usr/local/src/nginx/ # cd /usr/local/src/nginx/ download and extract nginx tar # wget -qO- http://nginx.org/download/nginx-1.14.2.tar.gz | tar zxf - clone nginx rtmp module # git clone https://github.com/arut/nginx-rtmp-module Download other modules - PCRE version 8.42 # wget https://ftp.pcre.org/pub/pcre/pcre-8.42.tar.gz && tar xzvf pcre-8.42.tar.gz - zlib version 1.2.11 # wget https://www.zlib.net/zlib-1.2.11.tar.gz && tar xzvf zlib-1.2.11.tar.gz - OpenSSL version 1.1.0h # wget https://www.openssl.org/source/openssl-1.1.0h.tar.gz && tar xzvf openssl-1.1.0h.tar.gz # cd nginx-1.14.2/ configure  nginx with modules and options # ./configure --add-modu
Read more