centos 7使用源代码安装openattic

2019-02-24

字数统计: 2.1k字 | 阅读时长≈ 9分

openattic是个不错的运维监控工具，安装部署难度很大啊～～

写在前面

松鼠哥的ceph专业课程上线啦！
面向新手同学，从0实战，全面入门ceph安装部署与运维，有需要的同学赶紧扫码订购吧：

openattic是一个针对ceph的管理和监控系统，与zabbix和grafana相比，它最大的优势在于通过librados与集群通信，属于定制型的插件，除了可以实现监控外，还能进行一些配置，迈出了可视化运维管理的一步

openattic是openSUSE赞助的一个项目，因此在其安装平台主要是openSUSE，最新的3.x版本就仅有openSUSE有包可以直接安装，而其他发行版平台的包只有2.x的版本，2.x版本确是read-only的，功能缺少很多，考虑到场景及适用性，我们非常希望将最新版本安装到centos7中，并基于此进行二次开发

踩坑

一开始，笔者在虚拟机环境的centos 7.5上安装openattic 2.x，想着哪怕是read-only也好，看看样子，结果，安装完之后给我看的是这个！？

就不多吐槽安装过程有多疼了，哎呀，各种python依赖的版本不兼容换低版本装到吐。。。

接下来，好，你不是支持openSUSE嘛？我就来个openSUSE，誓要吃下你这个螃蟹，于是，笔者又在虚拟机环境中开了一个openSUSE 42.3，然后按照官方步骤一路安装下来，嗯，还是3.x的，阔以啊^_^，来，咱们启动完后，访问一下ui

使用openattic/openattic登陆进去之后，随便点开看，都是不行的，what!?

排查一轮之后，发现访问ceph部分的代码一直超时.

2019-02-24 15:34:26,223 2334 mod_wsgi ERROR nodb.models#__get__ - failed to populate Field "osd_flags" of /etc/ceph/ceph.conf (<class 'ceph.models.CephCluster'>)
Traceback (most recent call last):
  File "/usr/share/openattic/nodb/models.py", line 324, in __get__
    self.eval_func(instance, query_set, self.field_names)
  File "/usr/share/openattic/ceph/models.py", line 185, in set_osd_flags
    flags = self.mon_api(self.fsid).osd_dump()['flags'].split(',')
  File "/usr/share/openattic/ceph/librados.py", line 944, in osd_dump
    return self._call_mon_command('osd dump')
  File "/usr/share/openattic/ceph/librados.py", line 1059, in _call_mon_command
    timeout)
  File "/usr/share/openattic/ceph/librados.py", line 439, in call_librados
    return run_in_external_process(with_client, cmd_name, timeout)
  File "/usr/share/openattic/utilities.py", line 172, in run_in_external_process
    'Command \'{}\' terminated because of timeout ({} sec).'.format(cmd_name, timeout))
ExternalCommandError: Command 'osd dump' terminated because of timeout (30 sec).

尝试解决未果，会不会是访问集群都有问题呢？好，尽然本机器已经被admin授权，那执行ceph -s看下

linux-039h:/etc/ceph # ceph -s
/home/abuild/rpmbuild/BUILD/ceph-12.2.10-551-gbb089269ea/src/common/ceph_crypto.cc: In function 'void ceph::crypto::init(CephContext*)' thread 7fc45d6e9700 time 2019-02-24 22:27:36.406979
/home/abuild/rpmbuild/BUILD/ceph-12.2.10-551-gbb089269ea/src/common/ceph_crypto.cc: 71: FAILED assert(crypto_context != __null)
 ceph version 12.2.10-551-gbb089269ea (bb089269ea0c1272294c6b9777123ac81662b6d2) luminous (stable)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x10e) [0x7fc462858a9e]
 2: (()+0x5a2cb3) [0x7fc462b4ecb3]
 3: (CephContext::init_crypto()+0x15) [0x7fc462a88da5]
 4: (common_init_finish(CephContext*)+0x19) [0x7fc462a85239]
 5: (librados::RadosClient::connect()+0x1d) [0x7fc46b2e248d]
 6: (()+0x32350) [0x7fc46b5b3350]
 7: (PyEval_EvalFrameEx()+0x6745) [0x7fc46da1c995]
 8: (PyEval_EvalCodeEx()+0x244) [0x7fc46da20fa4]
 9: (PyEval_EvalFrameEx()+0x59cc) [0x7fc46da1bc1c]
 10: (PyEval_EvalFrameEx()+0x51e4) [0x7fc46da1b434]
 11: (PyEval_EvalCodeEx()+0x244) [0x7fc46da20fa4]
 12: (()+0x9a76f) [0x7fc46d9c476f]
 13: (PyObject_Call()+0x46) [0x7fc46d9adbd6]
 14: (()+0x8a82e) [0x7fc46d9b482e]
 15: (PyObject_Call()+0x46) [0x7fc46d9adbd6]
 16: (PyEval_CallObjectWithKeywords()+0x36) [0x7fc46da15d66]
 17: (()+0x154962) [0x7fc46da7e962]
 18: (()+0x8744) [0x7fc46d715744]
 19: (clone()+0x6d) [0x7fc46d453aad]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
Aborted (core dumped)

WTF!这简直就是包有问题吧，ceph命令都直接挂掉，放弃～.～

开始自力更生

既然openSUSE的ceph包不行，centos的openattic包直接就废掉，自力更生用源代码自己编自己跑行不行？好吧，看看它的开发者手册，发现有个Setting up a Development System，它的示例是在debian上部署开发环境，那么我们在centos上应该是差不多的，代码是跨平台的(那当然，python写的)，所以有必要探索一下在centos上的安装部署，下面的安装过程重试了好多次才试出来的，对比了好多次openSUSE的内容，都快吐了。。。

环境准备

虚拟机使用的系统是CentOS Linux release 7.5.1804 (Core) - minimal，使用root用户进行操作

如果安装机器上没有ceph源，需要手动添加，因为要安装ceph客户端rados库

[Ceph]
name=Ceph packages for $basearch
baseurl=http://mirrors.aliyun.com/ceph/rpm-luminous/el7/$basearch
enabled=1
gpgcheck=0
type=rpm-md
gpgkey=https://mirrors.aliyun.com/ceph/keys/release.asc
priority=1
[Ceph-noarch]
name=Ceph noarch packages
baseurl=http://mirrors.aliyun.com/ceph/rpm-luminous/el7/noarch
enabled=1
gpgcheck=0
type=rpm-md
gpgkey=https://mirrors.aliyun.com/ceph/keys/release.asc
priority=1
[ceph-source]
name=Ceph source packages
baseurl=http://mirrors.aliyun.com/ceph/rpm-luminous/el7/SRPMS
enabled=1
gpgcheck=0
type=rpm-md
gpgkey=https://mirrors.aliyun.com/ceph/keys/release.asc
priority=1

首先yum安装包:

1
2
3

yum -y install epel-release
yum -y install ceph-common httpd postgresql-server postgresql-devel git npm mod_wsgi gcc python-devel pygobject2
yum -y install python2-pip

然后pip安装下面的包:

packs='decorator==4.0.9
Django==1.6.11
django-cors-headers==1.1.0
django-filter==0.7
djangorestframework==2.4.3
djangorestframework-bulk==0.2.1
ipython==4.2.0
ipython-genutils==0.1.0
mock==2.0.0
pyinotify==0.9.6
requests==2.9.1
six==1.10.0
docopt==0.6.2
configobj
requests-aws==0.1.8
testtools==2.3.0
xmlrunner==1.7.7
psycopg2==2.6
'
for x in $packs;
do
    pip install $x -i https://pypi.tuna.tsinghua.edu.cn/simple
done

关闭linux防火墙及selinux

systemctl stop firewalld.service
systemctl disable firewalld.service
setenforce 0
sed -i 's/SELINUX=enforcing/SELINUX=disable/g' /etc/selinux/config

因为我们不安装openattic的rpm包，根据它的spec文件，手工创建openattic使用的用户及相关目录并修改权限:

groupadd -r openattic
usermod -a --groups openattic apache
useradd -r -g openattic -d /var/lib/openattic -s /bin/bash -c "openATTIC System User" openattic 

mkdir /var/lib/openattic
mkdir /var/log/openattic
mkdir /etc/openattic
chown openattic.openattic /var/log/openattic

下载最新代码编译

从git上下载master代码，然后进入webui目录进行编译，编译过程中会下载一些文件，会比较慢:

cd /srv
git clone https://github.com/openattic/openattic.git
cd webui
npm run build

这个过程比较慢，笔者用手机开热点(城中村的破网)搞了半小时，编译完成后，还是因为我们无法安装rpm包，所以需要手工创建并修改一些openattic的文件，这些文件启动openattic的时候要用到

#创建openattic的相关文件，这些文件来源于git下载的代码
cp /srv/openattic/etc/openattic/database.ini /etc/openattic/database.ini
cp /srv/openattic/bin/oaconfig /usr/sbin/oaconfig
cp /srv/openattic/etc/systemd/openattic-systemd.service /usr/lib/systemd/system/openattic-systemd.service
cp /srv/openattic/etc/apache2/conf-available/openattic.conf /etc/httpd/conf.d/openattic.conf
cp /srv/openattic/etc/dbus-1/system.d/openattic.conf /etc/dbus-1/system.d/openattic.conf
cp /srv/openattic/rpm/sysconfig/openattic.RedHat /etc/default/openattic
sudo -u openattic touch /var/log/openattic/openattic.log

修改部分文件的内容，这些修改部分使得openattic的运行环境指向我们的代码，从而能够使用最新的代码，并且我们在本地修改代码后，能够直接跑起来(我们编译的是webui的代码，修改webui才需要再编译)

#修改相关参数，使得openattic可以使用下载的git代码
sed -i 's/\/usr\/share\/openattic/\/srv\/openattic\/backend/g' /etc/default/openattic
sed -i 's/\/usr\/share\/openattic/\/srv\/openattic\/backend/g' /etc/httpd/conf.d/openattic.conf
sed -i '$a <Directory /srv/openattic>\n    Require all granted\n</Directory>' /etc/httpd/conf.d/openattic.conf
chmod 755 /usr/sbin/oaconfig
systemctl daemon-reload

配置集群访问

至此，环境准备得差不多了，接下来开始配置

首先是ceph集群，向监控机器授权密钥，这里openattic为监控机器名：

1	ceph-deploy admin openattic

然后修改keyring权限使得openattic可以读取到

1	chmod o+r /etc/ceph/ceph.client.admin.keyring

完成后，使用下面的脚本测试openattic主机能否正常访问到集群

import rados

#Create Handle Examples.
cluster = rados.Rados(conffile='/etc/ceph/ceph.conf')

print "\nlibrados version: " + str(cluster.version())
print "Will attempt to connect to: " + str(cluster.conf_get('mon initial members'))
cluster.connect()
print "\nCluster ID: " + cluster.get_fsid()
print cluster.list_pools()