安装
声明
实验环境：VirtualBox虚机中安装Ubuntu 12.04（64-bit），部署OpenStack的Grizzly版本
安装数据库
sudo apt-get install mysql-server mysql-client python-mysqldb
终端弹出界面，提示输入数据库的root用户密码（例如：111111）
安装Keystone
创建keystone数据库
mysql -u root -p
create database keystone;
quit
获取源码
# commit 5097a03f8f77f54acefefb9886d3064b638184cb
git clone git://github.com/openstack/keystone.git
安装依赖
cd keystone
pip install -r requirements.txt
安装keystone到系统
python setup.py install
复制配置文件
mkdir -p /etc/keystone
cp etc/* /etc/keystone/
cd /etc/keystone
cp keystone.conf.sample keystone.conf
修改/etc/keystone/keystone.conf (使用openssl rand -hex 10生成token：fa9a647b8de836869722随机串)
[DEFAULT]
admin_token = fa9a647b8de836869722
public_port = 5000
admin_port = 35357
public_endpoint = http://localhost:%(public_port)s/v2.0
admin_endpoint = http://localhost:%(admin_port)s/v2.0
[sql]
# connection = sqlite:///keystone.db
connection = mysql://root:111111@localhost/keystone
[catalog]
driver = keystone.catalog.backends.sql.Catalog
# driver = keystone.catalog.backends.templated.TemplatedCatalog
# template_file = default_catalog.templates
初始化数据库
keystone-manage db_sync
初始化证书 （参数意义：chmod root:root）
keystone-manage pki_setup --keystone-user=root --keystone-group=root
启动keystone服务(加上-d参数可查看debug信息)
keystone-all
设置环境变量（目前还没有账户，只能先使用admin_token方式验证）
export SERVICE_TOKEN=fa9a647b8de836869722
export SERVICE_ENDPOINT=http://localhost:35357/v2.0
创建类型为identity的service和相应的endpoint
keystone service-create --name=keystone --type=identity \
--description="Keystone Identity Service"
+-------------+----------------------------------+
| Property | Value |
+-------------+----------------------------------+
| description | Keystone Identity Service |
| id | 714af530900840ef88106765f13f1921 |
| name | keystone |
| type | identity |
+-------------+----------------------------------+
keystone endpoint-create --service_id 714af530900840ef88106765f13f1921 \
--publicurl 'http://127.0.0.1:5000/v2.0' \
--adminurl 'http://127.0.0.1:35357/v2.0' \
--internalurl 'http://127.0.0.1:5000/v2.0'
keystone endpoint-list
+----------------------------------+-----------+----------------------------+----------------------------+-----------------------------+----------------------------------+
| id | region | publicurl | internalurl | adminurl | service_id |
+----------------------------------+-----------+----------------------------+----------------------------+-----------------------------+----------------------------------+
| d28d840d4be74a778578953a1a13324f | regionOne | http://127.0.0.1:5000/v2.0 | http://127.0.0.1:5000/v2.0 | http://127.0.0.1:35357/v2.0 | 714af530900840ef88106765f13f1921 |
+----------------------------------+-----------+----------------------------+----------------------------+-----------------------------+----------------------------------+
创建管理员（admin）账户
创建用户、角色、租户
keystone user-create --name admin --pass 123456
+----------+----------------------------------+
| Property | Value |
+----------+----------------------------------+
| email | |
| enabled | True |
| id | 94d416d8ebf34d3e97e345afcc5a2283 |
| name | admin |
| tenantId | |
+----------+----------------------------------+
keystone role-create --name admin
+----------+----------------------------------+
| Property | Value |
+----------+----------------------------------+
| id | de5cdd28a71f4df2943ac617ed20695c |
| name | admin |
+----------+----------------------------------+
keystone tenant-create --name admin
+-------------+----------------------------------+
| Property | Value |
+-------------+----------------------------------+
| description | |
| enabled | True |
| id | 40c76f9aa1c44907aa1a68b9cd7e8034 |
| name | admin |
+-------------+----------------------------------+
将admin用户设置为admin角色和admin租户的成员 （参数为上面动态生成的ID）
keystone user-role-add --user 94d416d8ebf34d3e97e345afcc5a2283 \
--role de5cdd28a71f4df2943ac617ed20695c \
--tenant_id 40c76f9aa1c44907aa1a68b9cd7e8034
为admin用户创建快速设置环境变量的脚本
cat > ~/keystonerc_admin << EOF
export OS_USERNAME=admin
export OS_TENANT_NAME=admin
export OS_PASSWORD=123456
export OS_AUTH_URL=http://127.0.0.1:35357/v2.0/
export PS1="[\u@\h \W(keystone_admin)]\$ "
EOF
不再使用admin_token的验证方式，清除环境变量
unset SERVICE_TOKEN
unset SERVICE_ENDPOINT
用admin用户测试一下 (如果keystone用-d参数启动，还能看到debug信息)
. ~/keystonerc_admin
keystone user-list
+----------------------------------+-------+---------+-------+
| id | name | enabled | email |
+----------------------------------+-------+---------+-------+
| 94d416d8ebf34d3e97e345afcc5a2283 | admin | True | |
+----------------------------------+-------+---------+-------+
创建用户账户 (可选)
创建用户、角色、租户
keystone user-create --name joe --pass 123123
+----------+----------------------------------+
| Property | Value |
+----------+----------------------------------+
| email | |
| enabled | True |
| id | 770def1aa63847bb8a5d31e1df2004d5 |
| name | joe |
| tenantId | |
+----------+----------------------------------+
keystone role-create --name user
+----------+----------------------------------+
| Property | Value |
+----------+----------------------------------+
| id | 430f055d142649d1b02e685025b07a5b |
| name | user |
+----------+----------------------------------+
keystone tenant-create --name trial
+-------------+----------------------------------+
| Property | Value |
+-------------+----------------------------------+
| description | |
| enabled | True |
| id | 249d66d789d643fabc544f6d6fc9ed9f |
| name | trial |
+-------------+----------------------------------+
将用户joe设置为user角色和租户trial的成员
keystone user-role-add --user 770def1aa63847bb8a5d31e1df2004d5 \
--role 430f055d142649d1b02e685025b07a5b \
--tenant_id 249d66d789d643fabc544f6d6fc9ed9f
为用户joe创建环境变量快速设置脚本
cat > ~/keystonerc_joe << EOF
export OS_USERNAME=joe
export OS_TENANT_NAME=trial
export OS_PASSWORD=123123
export OS_AUTH_URL=http://127.0.0.1:5000/v2.0/
export PS1="[\u@\h \W(keystone_joe)]\$ "
EOF
测试一下（keystone user-list只有管理员才有权限调用，应该会报错，但是keystone token-get可以返回信息）
. ~/keystonerc_joe
$ keystone user-list
2013-09-08 14:10:14.312 10936 WARNING keystone.common.wsgi [-] You are not authorized to perform the requested action, admin_required.
You are not authorized to perform the requested action, admin_required. (HTTP 403)
keystone token-get
安装Swift
获取源码
# commit f46b48e1dc5747faef5857d331db9a441b8b6af6
git clone git://github.com/openstack/swift.git
安装依赖
cd swift
pip install -r requirements.txt
apt-get install memcached
pip安装依赖时可能报错
error: ffi.h: No such file or directory，见Troubleshooting部分
安装swift到系统
python setup.py install
创建Ring Files
Ring File包含存储设备的所有信息 （each ring will contain 2^12=4096 partitions）
mkdir -pv /etc/swift
swift-ring-builder /etc/swift/account.builder create 12 3 1
swift-ring-builder /etc/swift/container.builder create 12 3 1
swift-ring-builder /etc/swift/object.builder create 12 3 1
为每个Ring增加存储设备
swift-ring-builder /etc/swift/account.builder add z1-127.0.0.1:6002/z1d1 100
swift-ring-builder /etc/swift/account.builder add z1-127.0.0.1:6002/z1d2 100
swift-ring-builder /etc/swift/account.builder add z2-127.0.0.1:6002/z2d1 100
swift-ring-builder /etc/swift/account.builder add z2-127.0.0.1:6002/z2d2 100
swift-ring-builder /etc/swift/account.builder add z3-127.0.0.1:6002/z3d1 100
swift-ring-builder /etc/swift/account.builder add z3-127.0.0.1:6002/z3d2 100
swift-ring-builder /etc/swift/container.builder add z1-127.0.0.1:6001/z1d1 100
swift-ring-builder /etc/swift/container.builder add z1-127.0.0.1:6001/z1d2 100
swift-ring-builder /etc/swift/container.builder add z2-127.0.0.1:6001/z2d1 100
swift-ring-builder /etc/swift/container.builder add z2-127.0.0.1:6001/z2d2 100
swift-ring-builder /etc/swift/container.builder add z3-127.0.0.1:6001/z3d1 100
swift-ring-builder /etc/swift/container.builder add z3-127.0.0.1:6001/z3d2 100
swift-ring-builder /etc/swift/object.builder add z1-127.0.0.1:6000/z1d1 100
swift-ring-builder /etc/swift/object.builder add z1-127.0.0.1:6000/z1d2 100
swift-ring-builder /etc/swift/object.builder add z2-127.0.0.1:6000/z2d1 100
swift-ring-builder /etc/swift/object.builder add z2-127.0.0.1:6000/z2d2 100
swift-ring-builder /etc/swift/object.builder add z3-127.0.0.1:6000/z3d1 100
swift-ring-builder /etc/swift/object.builder add z3-127.0.0.1:6000/z3d2 100
To distribute the partitions across the drives in the ring
swift-ring-builder /etc/swift/account.builder rebalance
swift-ring-builder /etc/swift/container.builder rebalance
swift-ring-builder /etc/swift/object.builder rebalance
检查文件是否生成
ls /etc/swift/*gz
/etc/swift/account.ring.gz /etc/swift/container.ring.gz /etc/swift/object.ring.gz
为swift创建HashKey (使用openssl rand -hex 10生成随机串0b1b9109c1ddde4f9c4b)
cat > /etc/swift/swift.conf << EOF
[swift-hash]
swift_hash_path_suffix = 0b1b9109c1ddde4f9c4b
EOF
chmod 600 /etc/swift/swift.conf
###配置Swift Proxy
增加配置文件/etc/swift/proxy-server.conf
tee /etc/swift/proxy-server.conf <<EOF
[DEFAULT]
bind_port = 8080
workers = 3
user = swift
[pipeline:main]
pipeline = healthcheck cache authtoken keystone proxy-server
[app:proxy-server]
use = egg:swift#proxy
allow_account_management = true
account_autocreate = true
[filter:cache]
use = egg:swift#memcache
memcache_servers = 127.0.0.1:11211
[filter:catch_errors]
use = egg:swift#catch_errors
[filter:healthcheck]
use = egg:swift#healthcheck
[filter:keystone]
#paste.filter_factory = keystone.middleware.swift_auth:filter_factory
use = egg:swift#keystoneauth
operator_roles = admin, SwiftOperator
is_admin = true
cache = swift.cache
[filter:authtoken]
paste.filter_factory = keystone.middleware.auth_token:filter_factory
auth_host = 127.0.0.1
auth_port = 35357
auth_protocol = http
auth_uri = http://127.0.0.1:35357
# if its defined
admin_tenant_name = admin
admin_user = admin
admin_password = 123456
EOF
然后
groupadd swift
useradd -g swift swift
chown -R swift:swift /etc/swift/
LANG=en_US.utf8
service memcached start
###配置Keystone
切换到管理员
. ~/keystonerc_admin
创建用户、租户（admin角色前面已经创建）
keystone tenant-create --name services
+-------------+----------------------------------+
| Property | Value |
+-------------+----------------------------------+
| description | |
| enabled | True |
| id | 750f121b2087434e91393d554a5940d4 |
| name | services |
+-------------+----------------------------------+
keystone user-create --name swift --pass 789789
+----------+----------------------------------+
| Property | Value |
+----------+----------------------------------+
| email | |
| enabled | True |
| id | e981e5f5a4244456b3a3cfdb52cd9707 |
| name | swift |
| tenantId | |
+----------+----------------------------------+
将swift用户设置为admin角色和services租户成员
keystone role-list
+----------------------------------+----------+
| id | name |
+----------------------------------+----------+
| 9fe2ff9ee4384b1894a90878d3e92bab | _member_ |
| de5cdd28a71f4df2943ac617ed20695c | admin |
| 430f055d142649d1b02e685025b07a5b | user |
+----------------------------------+----------+
keystone user-role-add --role de5cdd28a71f4df2943ac617ed20695c \
--tenant_id 750f121b2087434e91393d554a5940d4 \
--user e981e5f5a4244456b3a3cfdb52cd9707
创建service和endpoint
keystone service-create --name swift --type object-store \
--description "Swift Storage Service"
+-------------+----------------------------------+
| Property | Value |
+-------------+----------------------------------+
| description | Swift Storage Service |
| id | c09efaf486e54266b328cad0a52752c2 |
| name | swift |
| type | object-store |
+-------------+----------------------------------+
keystone endpoint-create --service_id c09efaf486e54266b328cad0a52752c2 \
--publicurl "http://127.0.0.1:8080/v2/AUTH_\$(tenant_id)s" \
--adminurl "http://127.0.0.1:8080/v2/AUTH_\$(tenant_id)s" \
--internalurl "http://127.0.0.1:8080/v2/AUTH_\$(tenant_id)s"
+-------------+---------------------------------------------+
| Property | Value |
+-------------+---------------------------------------------+
| adminurl | http://127.0.0.1:8080/v2/AUTH_$(tenant_id)s |
| id | 20f2279d7b2345c38f5315ac4518f1ea |
| internalurl | http://127.0.0.1:8080/v2/AUTH_$(tenant_id)s |
| publicurl | http://127.0.0.1:8080/v2/AUTH_$(tenant_id)s |
| region | regionOne |
| service_id | c09efaf486e54266b328cad0a52752c2 |
+-------------+---------------------------------------------+
查看一下
keystone service-list
+----------------------------------+----------+--------------+---------------------------+
| id | name | type | description |
+----------------------------------+----------+--------------+---------------------------+
| 714af530900840ef88106765f13f1921 | keystone | identity | Keystone Identity Service |
| c09efaf486e54266b328cad0a52752c2 | swift | object-store | Swift Storage Service |
+----------------------------------+----------+--------------+---------------------------+
keystone endpoint-list
+----------------------------------+-----------+---------------------------------------------+---------------------------------------------+---------------------------------------------+----------------------------------+
| id | region | publicurl | internalurl | adminurl | service_id |
+----------------------------------+-----------+---------------------------------------------+---------------------------------------------+---------------------------------------------+----------------------------------+
| 20f2279d7b2345c38f5315ac4518f1ea | regionOne | http://127.0.0.1:8080/v2/AUTH_$(tenant_id)s | http://127.0.0.1:8080/v2/AUTH_$(tenant_id)s | http://127.0.0.1:8080/v2/AUTH_$(tenant_id)s | c09efaf486e54266b328cad0a52752c2 |
| d28d840d4be74a778578953a1a13324f | regionOne | http://127.0.0.1:5000/v2.0 | http://127.0.0.1:5000/v2.0 | http://127.0.0.1:35357/v2.0 | 714af530900840ef88106765f13f1921 |
+----------------------------------+-----------+---------------------------------------------+---------------------------------------------+---------------------------------------------+----------------------------------+
###配置Swift Storage Nodes
创建配置文件
/etc/swift/account-server.conf
tee /etc/swift/account-server.conf <<EOF
[DEFAULT]
devices = /srv/node
bind_ip = 127.0.0.1
bind_port = 6002
mount_check = false
user = swift
log_facility = LOG_LOCAL2
workers = 3
[pipeline:main]
pipeline = account-server
[app:account-server]
use = egg:swift#account
[account-replicator]
concurrency = 1
[account-auditor]
[account-reaper]
concurrency = 1
EOF
/etc/swift/container-server.conf
tee /etc/swift/container-server.conf <<EOF
[DEFAULT]
devices = /srv/node
bind_ip = 127.0.0.1
bind_port = 6001
mount_check = false
user = swift
log_facility = LOG_LOCAL2
workers = 3
[pipeline:main]
pipeline = container-server
[app:container-server]
use = egg:swift#container
[container-replicator]
concurrency = 1
[container-updater]
concurrency = 1
[container-auditor]
[container-sync]
EOF
/etc/swift/object-server.conf
tee /etc/swift/object-server.conf <<EOF
[DEFAULT]
devices = /srv/node
bind_ip = 127.0.0.1
bind_port = 6000
mount_check = false
user = swift
log_facility = LOG_LOCAL2
workers = 3
[pipeline:main]
pipeline = object-server
[app:object-server]
use = egg:swift#object
[object-replicator]
concurrency = 1
[object-updater]
concurrency = 1
[object-auditor]
[object-expirer]
EOF
/etc/swift/object-expirer.conf
cat > /etc/swift/object-expirer.conf << EOF
[DEFAULT]
[object-expirer]
interval = 300
[pipeline:main]
pipeline = catch_errors cache proxy-server
[app:proxy-server]
use = egg:swift#proxy
[filter:cache]
use = egg:swift#memcache
[filter:catch_errors]
use = egg:swift#catch_errors
EOF
创建和挂载loopback设备（注意：系统重启后挂载失效）
for zone in 1 2 3 ; do
for device in 1 2 ; do
truncate /var/tmp/swift-device-z${zone}d${device} --size 5G
LOOPDEVICE=$(losetup --show -f /var/tmp/swift-device-z${zone}d${device})
mkfs.ext4 -I 1024 $LOOPDEVICE
mkdir -p /srv/node/z${zone}d${device}
mount -o noatime,nodiratime,nobarrier,user_xattr $LOOPDEVICE \
/srv/node/z${zone}d${device}
done
done
chown -R swift:swift /srv/node /etc/swift
启动Swift
swift-init all start
启动时可能会报错
NameError: name '_' is not defined，解决方案见Troubleshooting部分
重启系统后需要重新挂载，执行
for zone in 1 2 3 ; do
for device in 1 2 ; do
LOOPDEVICE=$(losetup --show -f /var/tmp/swift-device-z${zone}d${device})
mount -o noatime,nodiratime,nobarrier,user_xattr $LOOPDEVICE \
/srv/node/z${zone}d${device}
done
done
###测试Swift
. ~/keystonerc_admin
swift list
head -c 1024 /dev/urandom > data.file ; swift upload c1 data.file
head -c 1024 /dev/urandom > data2.file ; swift upload c1 data2.file
head -c 1024 /dev/urandom > data3.file ; swift upload c2 data3.file
$ swift list
c1
c2
$ swift list c1
data.file
data2.file
$ swift list c2
data3.file
安装Glance
获取源码
# commit 4e7c8e6d553e9d187b6c7f6eb284b4b7d63cfd74
git clone git://github.com/openstack/glance.git
# commit 518cb2508d6557f1e8f1c8c480720e46fef4bae9
git clone git://github.com/openstack/python-glanceclient.git
安装
cd glance
pip install -r requirements.txt
python setup.py install
cd ../python-glanceclient
pip install -r requirements.txt
python setup.py install
cd ..
创建数据库
mysql -u root -p
create database glance;
quit
复制配置文件
mkdir -p /etc/glance
cp glance/etc/* /etc/glance/
修改/etc/glance/glance-api.conf
[DEFAULT]
# default_store = file
default_store = swift
sql_connection = mysql://root:111111@127.0.0.1/glance
swift_store_auth_address = http://127.0.0.1:35357/v2.0/
swift_store_user = admin:admin
swift_store_key = 123456
swift_store_create_container_on_put = True
[keystone_authtoken]
admin_tenant_name = admin
admin_user = admin
admin_password = 123456
[paste_deploy]
flavor = keystone
修改/etc/glance/glance-registry.conf
[DEFAULT]
#sql_connection = sqlite:///glance.sqlite
sql_connection = mysql://root:111111@127.0.0.1/glance
[keystone_authtoken]
admin_tenant_name = admin
admin_user = admin
admin_password = 123456
[paste_deploy]
flavor = keystone
初始化数据库
mkdir -p /var/log/glance
glance-manage db_sync
创建service和endpoint
keystone service-create --name=glance --type=image --description="Glance Image Service"
+-------------+----------------------------------+
| Property | Value |
+-------------+----------------------------------+
| description | Glance Image Service |
| id | c9f6e93cfd384a27bdac595be296ad4a |
| name | glance |
| type | image |
+-------------+----------------------------------+
keystone endpoint-create --service_id c9f6e93cfd384a27bdac595be296ad4a \
--publicurl http://localhost:9292/v1 \
--adminurl http://localhost:9292/v1 \
--internalurl http://localhost:9292/v1
+-------------+----------------------------------+
| Property | Value |
+-------------+----------------------------------+
| adminurl | http://localhost:9292/v1 |
| id | c052904b25ac44c785c9ecb4cd53507e |
| internalurl | http://localhost:9292/v1 |
| publicurl | http://localhost:9292/v1 |
| region | regionOne |
| service_id | c9f6e93cfd384a27bdac595be296ad4a |
+-------------+----------------------------------+
启动服务
glance-api --config-file /etc/glance/glance-api.conf
glance-registry --config-file /etc/glance/glance-registry.conf
测试一下
. ~/keystonerc_admin
glance image-list
+----+------+-------------+------------------+------+--------+
| ID | Name | Disk Format | Container Format | Size | Status |
+----+------+-------------+------------------+------+--------+
+----+------+-------------+------------------+------+--------+
增加image
wget https://launchpad.net/cirros/trunk/0.3.0/+download/cirros-0.3.0-x86_64-disk.img
glance image-create --name="Cirros 0.3.0" \
--disk-format=qcow2 \
--container-format bare < cirros-0.3.0-x86_64-disk.img
查看一下
$ glance image-list
+--------------------------------------+--------------+-------------+------------------+----------+--------+
| ID | Name | Disk Format | Container Format | Size | Status |
+--------------------------------------+--------------+-------------+------------------+----------+--------+
| 5ef6d78b-dd3e-4575-ad52-692552f3ddd3 | Cirros 0.3.0 | qcow2 | bare | 13147648 | active |
+--------------------------------------+--------------+-------------+------------------+----------+--------+
$ swift list
c1
c2
glance
$ swift list glance
5ef6d78b-dd3e-4575-ad52-692552f3ddd3
##安装Cinder
获取源码
# commit 300ce61120ce179d1d0e4ffe8aa0bd4ceaddba6b
git clone https://github.com/openstack/cinder.git
# commit d21ed05b4ed1a5b5321876c481e0286d3696afd5
git clone https://github.com/openstack/python-cinderclient.git
安装
cd cinder
pip install -r requirements.txt
python setup.py install
cd ../python-cinderclient/
pip install -r requirements.txt
python setup.py install
cd ..
apt-get install tgt open-iscsi rabbitmq-server
安装配置
cp -af cinder/etc/cinder /etc
cp /etc/cinder/cinder.conf.sample /etc/cinder/cinder.conf
修改/etc/cinder/api-paste.ini
[filter:authtoken]
admin_tenant_name = admin
admin_user = admin
admin_password = 123456
service_protocol = http
service_host = 127.0.0.1
service_port = 5000
修改/etc/cinder/cinder.conf
[DEFAULT]
rootwrap_config=/etc/cinder/rootwrap.conf
sql_connection=mysql://root:111111@127.0.0.1/cinder
api_paste_config=/etc/cinder/api-paste.ini
state_path=/var/lib/cinder
volumes_dir=$state_path/volumes
iscsi_helper=tgtadm
volume_name_template=volume-%s
volume_group=cinder-volumes
verbose=true
auth_strategy=keystone
log_file=cinder.log
log_dir=/var/log/cinder
rabbit_host=localhost
rabbit_port=5672
rabbit_userid=guest
rabbit_password=321321
rabbit_virtual_host=/
创建cinder数据库
mysql -u root -p
create database cinder;
quit
配置RabbitMQ
rabbitmqctl change_password guest 321321
配置TGT
mkdir -p /var/lib/cinder/volumes
sh -c "echo 'include /var/lib/cinder/volumes/*' >> /etc/tgt/conf.d/cinder.conf"
restart tgt
初始化数据库
mkdir -p /var/log/cinder
cinder-manage db sync
创建卷
dd if=/dev/zero of=~/cinder-volumes bs=1 count=0 seek=2G
losetup /dev/loop6 ~/cinder-volumes
pvcreate /dev/loop6
vgcreate cinder-volumes /dev/loop6
$ pvscan
PV /dev/sda5 VG precise64 lvm2 [79.76 GiB / 0 free]
PV /dev/loop6 VG cinder-volumes lvm2 [2.00 GiB / 2.00 GiB free]
Total: 2 [81.75 GiB] / in use: 2 [81.75 GiB] / in no VG: 0 [0 ]
启动服务
cinder-volume --config-file=/etc/cinder/cinder.conf
cinder-api --config-file=/etc/cinder/cinder.conf
cinder-scheduler --config-file=/etc/cinder/cinder.conf
创建service和endpoint
keystone service-create --name=volume --type=volume --description="Nova Volume Service"
+-------------+----------------------------------+
| Property | Value |
+-------------+----------------------------------+
| description | Nova Volume Service |
| id | 0f66c20499ca4f77990e286a3607e5aa |
| name | volume |
| type | volume |
+-------------+----------------------------------+
keystone endpoint-create --service_id=0f66c20499ca4f77990e286a3607e5aa \
--publicurl "http://localhost:8776/v1/\$(tenant_id)s" \
--adminurl "http://localhost:8776/v1/\$(tenant_id)s" \
--internalurl "http://localhost:8776/v1/\$(tenant_id)s"
+-------------+----------------------------------------+
| Property | Value |
+-------------+----------------------------------------+
| adminurl | http://localhost:8776/v1/$(tenant_id)s |
| id | a62cb598466f411bb8f6381495994690 |
| internalurl | http://localhost:8776/v1/$(tenant_id)s |
| publicurl | http://localhost:8776/v1/$(tenant_id)s |
| region | regionOne |
| service_id | 0f66c20499ca4f77990e286a3607e5aa |
+-------------+----------------------------------------+
keystone endpoint-list
创建1G的volume测试一下（取名：test）
cinder list
+----+--------+--------------+------+-------------+----------+-------------+
| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |
+----+--------+--------------+------+-------------+----------+-------------+
+----+--------+--------------+------+-------------+----------+-------------+
cinder create --display_name test 1
+---------------------+--------------------------------------+
| Property | Value |
+---------------------+--------------------------------------+
| attachments | [] |
| availability_zone | nova |
| bootable | False |
| created_at | 2013-09-23T13:08:54.358719 |
| display_description | None |
| display_name | test |
| id | 7e7a503c-0f47-4a74-88a6-e4fd84a9592b |
| metadata | {} |
| size | 1 |
| snapshot_id | None |
| source_volid | None |
| status | creating |
| volume_type | None |
+---------------------+--------------------------------------+
cinder list
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| 7e7a503c-0f47-4a74-88a6-e4fd84a9592b | available | test | 1 | None | False | |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
##安装Nova
获取源码
# commit 042dc449701ad6fdec04c475b309dd0f072f61ab
git clone git://github.com/openstack/nova.git
# commit 1d2263dae339590b60250793bc81ec5776845060
git clone https://github.com/openstack/python-novaclient.git
安装源码
cd nova
pip install -r requirements.txt
python setup.py install
cd ..
cd python-novaclient
pip install -r requirements.txt
python setup.py install
cd ..
安装依赖
apt-get install python-libvirt guestmount bridge-utils dnsmasq-utils
安装配置文件
cp -af nova/etc/nova /etc
cp /etc/nova/nova.conf.sample /etc/nova/nova.conf
###配置数据库
创建nova的数据库
mysql -u root -p
create database nova;
quit
###网络结构
本实验使用FlatDHCP网络模型，如下；
VMs.eth0 <---> vnet1 <---> br100 <---> Host.eth1
Host.eth0 <---> Internet
多个虚机通过vnet1形成一个局域网，该内部网络通过br100与Host机的eth1通信；
为了简化网络结构，eth1不接外网（不设网关即可），eth0可访问外网
这里为了方便演示，删除Ubuntu的图形网络管理工具NetworkManager
dpkg -P network-manager-gnome network-manager
手动修改网络配置文件/etc/network/interfaces
auto lo
iface lo inet loopback
auto eth0
iface eth0 inet dhcp
auto eth1
iface eth1 inet static
address 192.168.1.11
netmask 255.255.255.0
重启网络，使设置生效
/etc/init.d/networking restart
然后查看一下
$ ifconfig
... (省略不相关信息)
eth0 Link encap:Ethernet HWaddr 00:25:90:97:68:82
inet addr:192.168.1.148 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::225:90ff:fe97:6882/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:143839395 errors:0 dropped:0 overruns:7660706 frame:0
TX packets:78108678 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:56720182566 (56.7 GB) TX bytes:7408859473 (7.4 GB)
Memory:df720000-df740000
eth1 Link encap:Ethernet HWaddr 00:25:90:97:68:83
inet addr:192.168.1.11 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::225:90ff:fe97:6883/64 Scope:Link
UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1
RX packets:89060556 errors:0 dropped:0 overruns:8050921 frame:0
TX packets:78019479 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:8384089287 (8.3 GB) TX bytes:7110520607 (7.1 GB)
Memory:df700000-df720000
###配置Nova
/etc/nova/nova.conf 全部配置如下：
# LOGS/STATE
verbose=True
logdir=/var/log/nova
state_path=/var/lib/nova
lock_path=/var/lock/nova
rootwrap_config=/etc/nova/rootwrap.conf
# SCHEDULER
compute_scheduler_driver=nova.scheduler.filter_scheduler.FilterScheduler
# VOLUMES
volume_api_class=nova.volume.cinder.API
volume_driver=nova.volume.driver.ISCSIDriver
volume_group=cinder-volumes
volume_name_template=volume-%s
iscsi_helper=tgtadm
# DATABASE
sql_connection=mysql://root:111111@127.0.0.1/nova
# COMPUTE
libvirt_type=qemu
compute_driver=libvirt.LibvirtDriver
instance_name_template=instance-%08x
api_paste_config=/etc/nova/api-paste.ini
# COMPUTE/APIS: if you have separate configs for separate services
# this flag is required for both nova-api and nova-compute
#allow_resize_to_same_host=True
# APIS
osapi_compute_extension=nova.api.openstack.compute.contrib.standard_extensions
ec2_dmz_host=127.0.0.1
s3_host=127.0.0.1
enabled_apis=ec2,osapi_compute,metadata
# RABBITMQ
rabbit_host=localhost
rabbit_port=5672
rabbit_userid=guest
rabbit_password=321321
rabbit_virtual_host=/
# GLANCE
image_service=nova.image.glance.GlanceImageService
glance_api_servers=127.0.0.1:9292
# NETWORK
network_manager=nova.network.manager.FlatDHCPManager
force_dhcp_release=True
dhcpbridge_flagfile=/etc/nova/nova.conf
firewall_driver=nova.virt.libvirt.firewall.IptablesFirewallDriver
# Change my_ip to match each host
my_ip=192.168.1.148
public_interface=eth0
#vlan_interface=eth0
flat_interface=eth1
flat_network_bridge=br100
fixed_range=192.168.100.0/24
use_ipv6=false
# NOVNC CONSOLE
vnc_enabled = true
vncserver_listen = 0.0.0.0
vncserver_proxyclient_address = 192.168.1.11
xvpvncproxy_base_url = http://192.168.1.148:6081/console
novncproxy_base_url = http://192.168.1.148:6080/vnc_auto.html
# AUTHENTICATION
auth_strategy=keystone
[keystone_authtoken]
auth_host = 127.0.0.1
auth_port = 35357
auth_protocol = http
admin_tenant_name = admin
admin_user = admin
admin_password = admin
signing_dirname = /tmp/keystone-signing-nova
注意这几个IP
my_ip=192.168.1.148 vncserver_listen = 0.0.0.0 vncserver_proxyclient_address = 192.168.1.11 xvpvncproxy_base_url = http://192.168.1.148:6081/console novncproxy_base_url = http://192.168.1.148:6080/vnc_auto.html
修改/etc/nova/api-paste.ini
[filter:authtoken]
admin_tenant_name = admin
admin_user = admin
admin_password = 123456
创建相应目录
mkdir -p /var/log/nova
mkdir -p /var/lib/nova/instances
###初始化数据库
nova-manage db sync
###启动服务
nova-api
nova-conductor
nova-network
nova-scheduler
nova-compute
注意：终端必须使用英文环境
###创建Endpoint
keystone service-create --name=nova --type=compute --description="Nova Compute Service"
+-------------+----------------------------------+
| Property | Value |
+-------------+----------------------------------+
| description | Nova Compute Service |
| id | e8f13ca5e3de451887059358cce1071a |
| name | nova |
| type | compute |
+-------------+----------------------------------+
keystone endpoint-create \
--service-id=e8f13ca5e3de451887059358cce1071a \
--publicurl='http://localhost:8774/v2/%(tenant_id)s' \
--internalurl='http://localhost:8774/v2/%(tenant_id)s' \
--adminurl='http://localhost:8774/v2/%(tenant_id)s'
+-------------+----------------------------------------+
| Property | Value |
+-------------+----------------------------------------+
| adminurl | http://localhost:8774/v2/%(tenant_id)s |
| id | 30c72b9d0d794fa79201bbdd2aa10fa8 |
| internalurl | http://localhost:8774/v2/%(tenant_id)s |
| publicurl | http://localhost:8774/v2/%(tenant_id)s |
| region | regionOne |
| service_id | e8f13ca5e3de451887059358cce1071a |
+-------------+----------------------------------------+
###验证一下
$ nova-manage service list
Binary Host Zone Status State Updated_At
nova-conductor precise64 internal enabled :-) 2013-10-17 15:52:40
nova-network precise64 internal enabled :-) 2013-10-17 15:52:47
nova-scheduler precise64 internal enabled :-) 2013-10-17 15:52:43
nova-compute precise64 nova enabled :-) 2013-10-17 15:52:49
$ nova-manage version
2014.1
nova image-list输出结果应该和glance image-list相同
$ nova image-list
+--------------------------------------+------------+--------+--------+
| ID | Name | Status | Server |
+--------------------------------------+------------+--------+--------+
| 1a736b75-3e49-4fed-97f1-f3257a75b3b8 | test image | ACTIVE | |
+--------------------------------------+------------+--------+--------+
$ glance image-list
+--------------------------------------+------------+-------------+------------------+------+--------+
| ID | Name | Disk Format | Container Format | Size | Status |
+--------------------------------------+------------+-------------+------------------+------+--------+
| 1a736b75-3e49-4fed-97f1-f3257a75b3b8 | test image | aki | aki | 1024 | active |
+--------------------------------------+------------+-------------+------------------+------+--------+
###配置网络
将网卡eth1设为混杂模式promiscuous mode
ip link set eth1 promisc on
增加br100的配置到/etc/network/interfaces
# Bridge network interface for VM networks
auto br100
iface br100 inet static
address 192.168.100.1
netmask 255.255.255.0
bridge_stp off
bridge_fd 0
增加桥接设备（取名br100），重启网络生效
brctl addbr br100
/etc/init.d/networking restart
检查一下
$ ifconfig
br100 Link encap:Ethernet HWaddr 00:25:90:97:68:83
inet addr:192.168.100.1 Bcast:192.168.100.255 Mask:255.255.255.0
inet6 addr: fe80::90a5:deff:fe52:ccfd/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:3977 errors:0 dropped:0 overruns:0 frame:0
TX packets:1799 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:455641 (455.6 KB) TX bytes:279552 (279.5 KB)
eth0 Link encap:Ethernet HWaddr 00:25:90:97:68:82
inet addr:192.168.1.148 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::225:90ff:fe97:6882/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:143840605 errors:0 dropped:0 overruns:7660706 frame:0
TX packets:78109048 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:56720315738 (56.7 GB) TX bytes:7408903837 (7.4 GB)
Memory:df720000-df740000
eth1 Link encap:Ethernet HWaddr 00:25:90:97:68:83
inet6 addr: fe80::225:90ff:fe97:6883/64 Scope:Link
UP BROADCAST RUNNING PROMISC MULTICAST MTU:1500 Metric:1
RX packets:89230246 errors:0 dropped:0 overruns:8050921 frame:0
TX packets:78019553 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:8428094346 (8.4 GB) TX bytes:7110538291 (7.1 GB)
Memory:df700000-df720000
virbr0 Link encap:Ethernet HWaddr b6:f1:f3:8f:63:e6
inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
vnet1 Link encap:Ethernet HWaddr fe:16:3e:52:85:28
inet6 addr: fe80::fc16:3eff:fe52:8528/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:524 errors:0 dropped:0 overruns:0 frame:0
TX packets:3608 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:500
RX bytes:96902 (96.9 KB) TX bytes:435329 (435.3 KB)
eth1目前看不到IP地址，可通过如下方式查看：
$ ip a
14: br100: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP
link/ether 00:25:90:97:68:83 brd ff:ff:ff:ff:ff:ff
inet 192.168.100.1/24 brd 192.168.100.255 scope global br100
inet 192.168.1.11/24 brd 192.168.1.255 scope global br100
inet6 fe80::90a5:deff:fe52:ccfd/64 scope link
valid_lft forever preferred_lft forever
###创建虚机使用的内部网络
nova-manage network create private --fixed_range_v4=192.168.100.0/24 --bridge_interface=br100
###放开访问限制
查看安全分组
$ nova secgroup-list
+----+---------+-------------+
| Id | Name | Description |
+----+---------+-------------+
| 1 | default | default |
+----+---------+-------------+
放开SSH和ICMP（Ping）的访问限制
$ nova secgroup-add-rule default tcp 22 22 0.0.0.0/0
$ nova secgroup-add-rule default icmp -1 -1 0.0.0.0/0
$ nova secgroup-list-rules default
注入SSH公钥到虚机并确认（需要虚机Image支持）
$ ssh-keygen -t rsa # 一路回车
$ nova keypair-add --pub-key ~/.ssh/id_rsa.pub mykey
$ nova keypair-list
$ ssh-keygen -l -f ~/.ssh/id_rsa.pub
###打开ip_v4转发
先看看是否已经打开
$ sysctl net.ipv4.ip_forward
net.ipv4.ip_forward = 1
临时开启
$ sysctl -w net.ipv4.ip_forward=1
###创建虚机
先确认所有服务都在运行(libvirtd,nova-api,nova-scheduler,nova-compute,nova-network)
$ ps -ef | grep libvirtd
root 19970 1 0 14:04 ? 00:00:05 /usr/sbin/libvirtd -d
$ nova-manage service list
Binary Host Zone Status State Updated_At
nova-conductor precise64 internal enabled :-) 2013-10-17 15:52:40
nova-network precise64 internal enabled :-) 2013-10-17 15:52:47
nova-scheduler precise64 internal enabled :-) 2013-10-17 15:52:43
nova-compute precise64 nova enabled :-) 2013-10-17 15:52:49
启动实例
$ nova secgroup-list
+----+---------+-------------+
| Id | Name | Description |
+----+---------+-------------+
| 1 | default | default |
+----+---------+-------------+
$ nova flavor-list
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
| ID | Name | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
| 1 | m1.tiny | 512 | 1 | 0 | | 1 | 1.0 | True |
| 2 | m1.small | 2048 | 20 | 0 | | 1 | 1.0 | True |
| 3 | m1.medium | 4096 | 40 | 0 | | 2 | 1.0 | True |
| 4 | m1.large | 8192 | 80 | 0 | | 4 | 1.0 | True |
| 5 | m1.xlarge | 16384 | 160 | 0 | | 8 | 1.0 | True |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
$ nova image-list
+--------------------------------------+--------------+--------+--------+
| ID | Name | Status | Server |
+--------------------------------------+--------------+--------+--------+
| 5ef6d78b-dd3e-4575-ad52-692552f3ddd3 | Cirros 0.3.0 | ACTIVE | |
+--------------------------------------+--------------+--------+--------+
$ nova boot --flavor 1 --image 5ef6d78b-dd3e-4575-ad52-692552f3ddd3 --security_group default cirros
查看实例状态(启动需要一些时间)
$ nova list
+--------------------------------------+--------+--------+------------+-------------+-----------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+--------+------------+-------------+-----------------------+
| 2c0c5c9b-2511-4616-8186-3843b0800da1 | cirros | BUILD | spawning | NOSTATE | private=192.168.100.2 |
+--------------------------------------+--------+--------+------------+-------------+-----------------------+
$ nova list
+--------------------------------------+--------+--------+------------+-------------+-----------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+--------+--------+------------+-------------+-----------------------+
| 2c0c5c9b-2511-4616-8186-3843b0800da1 | cirros | ACTIVE | None | Running | private=192.168.100.2 |
+--------------------------------------+--------+--------+------------+-------------+-----------------------+
查看引导信息（如果启动失败，能看到报错信息）
$ nova console-log cirros
... （此处省略N行）
Oct 17 10:02:00 cirros kern.info kernel: [ 6.980753] ip_tables: (C) 2000-2006 Netfilter Core Team
Oct 17 10:02:13 cirros kern.debug kernel: [ 19.977012] eth0: no IPv6 routers present
Oct 17 10:03:29 cirros authpriv.info dropbear[301]: Running in background
############ debug end ##############
____ ____ ____
/ __/ __ ____ ____ / __ \/ __/
/ /__ / // __// __// /_/ /\ \
\___//_//_/ /_/ \____/___/
http://cirros-cloud.net
login as 'cirros' user. default password: 'cubswin:)'. use 'sudo' for root.
cirros login:
虚机应该可以Ping通，然后SSH登陆（密码：cubswin:)），最后从虚机应该可以Ping通公网IP
ssh cirros@192.168.100.2
##安装Horizon
获取源码
# commit ae6abf715701b7ce026efb16c7af20b16cc90ee2
git clone https://github.com/openstack/horizon.git
安装
cd horizon
pip install -r requirements.txt
python setup.py install
cd ..
创建配置文件
cd horizon/openstack_dashboard/local
cp local_settings.py.example local_settings.py
cd -
创建默认角色Member
keystone role-create --name Member
启动（使用空闲端口）
horizon/manage.py runserver 0.0.0.0:8888
访问页面
- http://192.168.1.148:8888/ （登录：admin,123456）
###通过Web访问VNC Console
要想Horizon的Console页面正常显示，需要noVNC，原理如下：
vnc.html ---> nova-novncproxy(6080) ---> vnc server(5900)
获取noVNC
# commit 75d69b9f621606c3b2db48e4778ff41307f65c6d
git clone https://github.com/kanaka/noVNC.git
启动服务
noVNC/utils/nova-novncproxy --config-file /etc/nova/nova.conf --web `pwd`/noVNC/
nova-consoleauth
###通过Client访问VNC Console
工作原理
xvpvncviewer ---> nova-xvpvncproxy(6081) ---> vnc server(5900)
安装
# commit fc292084732bd20bc69746a0567001293b63608f
git clone https://github.com/cloudbuilders/nova-xvpvncviewer
cd nova-xvpvncviewer/viewer
make
启动服务
nova-xvpvncproxy --config-file=/etc/nova/nova.conf
手动获取URL
nova get-vnc-console [vm_id or vm_name] xvpvnc
启动客户端
java -jar VncViewer.jar url [url]
###使用Apache提供Web服务
见官方文档
#Troubleshooting
[keystone] {“error”: {“message”: “The resource could not be found.”, “code”: 404, “title”: “Not Found”}}
如果RESTful API的权限是Admin，用5000端口访问就会报错，35357正常。
Expecting an auth URL via either –os-auth-url or env[OS_AUTH_URL]
缺少环境变量，使用admin_token验证方式设置如下（SERVICE_TOKEN的值取自/etc/keystone/keystone.conf的admin_token字段）
export SERVICE_TOKEN=ADMIN
export SERVICE_ENDPOINT=http://127.0.0.1:35357/v2.0/
或者创建用户的环境变量快速设置脚本，并运行
cat > ~/keystonerc_joe << EOF
export OS_USERNAME=joe
export OS_TENANT_NAME=trial
export OS_PASSWORD=123123
export OS_AUTH_URL=http://127.0.0.1:5000/v2.0/
export PS1="[\u@\h \W(keystone_joe)]\$ "
EOF
. ~/keystonerc_joe
注：管理员端口为35357，普通用户是5000，参考/etc/keystone/keystone.conf的配置
Unable to authorize user
可能是数据库中不存在identity这个endpoint, 且/etc/keystone/keystone.conf又配置为从数据读取
[catalog]
driver = keystone.catalog.backends.sql.Catalog
# driver = keystone.catalog.backends.templated.TemplatedCatalog
# template_file = default_catalog.templates
可配置为从模板读取
[catalog]
# driver = keystone.catalog.backends.sql.Catalog
driver = keystone.catalog.backends.templated.TemplatedCatalog
template_file = default_catalog.templates
如果一定要从数据库读取，先增加admin_token方式验证的环境变量，然后手动增加endpoint信息，可参考/etc/keystone/default_catalog.templates
[swift, pip install -r reuqirements.txt] ERROR： “c/_cffi_backend.c:14:17: fatal error: ffi.h: No such file or directory”
注释掉requirements.txt中的xattr,安装完依赖后自己手动安装python-xattr包
pip install -r requirements.txt
apt-get install python-xattr
[swift-init all start] ERROR: “NameError: name ‘_’ is not defined”
/usr/local/lib/python2.7/dist-packages/keystone/exception.py 增加：
import gettext
_ = gettext.gettext
No module named swift_auth
/etc/swift/proxy-server.conf 修改：
[filter:keystone]
# paste.filter_factory = keystone.middleware.swift_auth:filter_factory
use = egg:swift#keystoneauth
[swift list] Endpoint for object-store not found
如果/etc/keystone/proxy-server.conf配置为从模版读取,那么必须手动添加endpoint到模版，数据库创建语句无效。
[catalog]
# dynamic, sql-based backend (supports API/CLI-based management commands)
#driver = keystone.catalog.backends.sql.Catalog
# static, file-based backend (does *NOT* support any management commands)
driver = keystone.catalog.backends.templated.TemplatedCatalog
template_file = default_catalog.templates
/etc/keystone/default_catalog.templates 增加:
catalog.RegionOne.object-store.publicURL = http://localhost:8080/v1/AUTH_$(tenant_id)s
catalog.RegionOne.object-store.adminURL = http://localhost:8080/v1/AUTH_$(tenant_id)s
catalog.RegionOne.object-store.internalURL = http://localhost:8080/v1/AUTH_$(tenant_id)s
catalog.RegionOne.object-store.name = Object Store Service
[swift-init all start] Unable to locate config for object-expirer
/etc/swift/object-server.conf 增加：
[object-expirer]
新建/etc/swift/object-expirer.conf
cat > /etc/swift/object-expirer.conf << EOF
[DEFAULT]
[object-expirer]
interval = 300
[pipeline:main]
pipeline = catch_errors cache proxy-server
[app:proxy-server]
use = egg:swift#proxy
[filter:cache]
use = egg:swift#memcache
[filter:catch_errors]
use = egg:swift#catch_errors
EOF
设置权限
chown -R swift:swift /etc/swift
[swift-init all start] Unable to locate config for proxy-server
缺少/etc/swift/proxy-server.conf文件
[Log] No such file or directory: ‘/var/cache/swift/object.recon’
proxy-server.conf增加：
[filter:recon]
use = egg:swift#recon
recon_cache_path = /var/cache/swift
mkdir /var/cache/swift
chmod 777 /var/cache/swift
[glance-control api start] __init__() got an unexpected keyword argument ‘parents’
pip freeze | grep oslo
# oslo.config==1.2.0a3
pip uninstall oslo.config
pip install oslo.config==1.1.0
没有glance命令
glance命令在包glanceclient中，该包是独立的，可以直接用pip快速安装：
pip install python-glanceclient
[glance add] Authorization Failed: *** (HTTP Unable to establish connection to http://127.0.0.1:35357/v2.0/tokens)
确认keystone服务是否启动
ps -Af | grep keystone
keystone-all
[glance add] Authorization Failed: *** (HTTP Unable to establish connection to https://127.0.0.1:35357/v2.0/tokens)
注意，这里的报错是https，检查配置文件/etc/glance/glance-api.conf
# Valid schemes are 'http://' and 'https://'
# If no scheme specified, default to 'https://'
swift_store_auth_address = http://127.0.0.1:35357/v2.0/
注意注释部分，如果没有http://则默认使用https://
[glance add] code 400, message Bad HTTP/0.9 request type
启动命令换成如下，可看到日志错误提示信息：
glance-api --config-file /etc/glance/glance-api.conf
glance-registry --config-file /etc/glance/glance-registry.conf
[swift upload] 404 Not Found. The resource could not be found.
chown -R swift:swift /srv/node (目录写权限问题)
[glance index] WARNING keystone.common.controller [-] RBAC: Bypassing authorization
可能是用admin验证引起的（启动方式glance-control api/registry start）
也可能是启动方式问题，使用glance-api和glance-registry启动后消失
[glance add, /var/log/glance/api.log] Container HEAD failed: http://localhost:8080/v1/AUTH_9cb8bbc75bdb4484af790cfc3e4343e5/glance 404 Not Found
swift中没有glance这个container，可以手动创建，也可以修改配置/etc/glance/glance-api.conf
swift_store_container = glance
# Do we create the container if it does not exist?
swift_store_create_container_on_put = True
[glance-api –config-file /etc/glance/glance-api.conf] Stderr: ‘/bin/sh: 1: collie: not found\n’
apt-get install sheepdog
[glance add] ClientException: Unauthorised. Check username, password and tenant name/id
账户设置有问题，可以检查配置/etc/glance/glance-api.conf，也可以在报错文件的语句前插入打印语句查看
swift_store_auth_address = http://127.0.0.1:35357/v2.0/
swift_store_user = admin:admin
swift_store_key = 123456
[glance image-list] HTTPInternalServerError (HTTP 500)
- 确认安装
curl。加上-d参数，可看到执行了curl命令，手动执行后报错The program 'curl' is currently not installed. - 确认
glance db_sync执行成功。查看数据库glance，发现没有表，检查glance-*.conf的sql-connection配置 - 确认
glance-api.conf文件中的swift_store_auth_address = http://127.0.0.1:35357/v2.0/是http
[nova, pvcreate /dev/loop2] Device /dev/loop2 not found (or ignored by filtering)
可能是修改了/etc/lvm/lvm.conf中的filter造成的
[cinder create] ERROR cinder.scheduler.filters.capacity_filter [***] Free capacity not set: volume node info collection broken.
[cinder create] ERROR cinder.volume.flows.create_volume [***] Failed to schedule_create_volume: No valid host was found.
使用cinder-all启动所有服务，然后cinder create时会就遇到这个报错；
使用如下启动方式时正常：
cinder-volume --config-file=/etc/cinder/cinder.conf
cinder-api --config-file=/etc/cinder/cinder.conf
cinder-scheduler --config-file=/etc/cinder/cinder.conf
[cinder list] Status一直都是creating
cinder list
+--------------------------------------+----------+--------------+------+-------------+----------+-------------+
| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+----------+--------------+------+-------------+----------+-------------+
| fbda9189-26e2-4e42-9622-f707be57d565 | creating | test | 1 | None | False | |
+--------------------------------------+----------+--------------+------+-------------+----------+-------------+
首先确定数据库cinder中是否有表，即确保cinder-manage db sync执行成功
[cinder create] Status是error，cinder-volume报错：Exit code: 5
确定配置文件/etc/cinder/cinder.conf包含如下内容
state_path=/var/lib/cinder
volumes_dir=$state_path/volumes
[cinder-volume] AMQP server on localhost:5672 is unreachable
在不使用nova的情况下，确认/etc/cinder/cinder.conf
rabbit_virtual_host=/
[nova-compute] ImportError: No module named libvirt
apt-get install python-libvirt
[nova-api] Address already in use
先确定是否已经有nova-api进程在运行
ps -ef | grep nova
如果没有，杀掉占用8777的进程
netstat -apn | grep 8777
[nova image-list] ERROR: printt
novaclient代码有bug，修改/usr/lib/python2.7/dist-packages/novaclient/utils.py
def print_list(objs, fields, formatters={}):
//此处省略N行
print pt.get_string(sortby=fields[0])
#pt.printt(sortby=fields[0])
安装novnc会作为依赖安装novaclient包，如果比较早的版本可能会有问题，用如下方式安装
apt-get download novnc
dpkg --force-all -i novnc_*.deb
[nova image-list] ERROR: Unauthorized (HTTP 401)
修改/etc/nova/api-paste.ini
[filter:authtoken]
admin_tenant_name = admin
admin_user = admin
admin_password = 123456
[nova net-list] ERROR: HTTPConnectionPool(host=’10.0.2.15’, port=8774): Max retries exceeded with url: /v2/dd3d73c9f6e64acca28376d9bad0fc58/os-tenant-networks (Caused by <class ‘socket.error’>: [Errno 111] Connection refused)
使用devstack在虚拟机安装后，执行nova net-list报错，执行netstat查看8774端口没有被监听，然后发现nova-api没有起来，手动启动后报错OSError: [Errno 12] Cannot allocate memory，当前虚拟及内存只分配了1G，扩大到2G后正常。
[nova-compute] libvirtError: internal error Cannot find suitable emulator for x86_64
apt-get install guestmount
[nova-network] nova.openstack.common.rpc.amqp OSError: [Errno 2] No such file or directory
- 确定有该命令：
dhcp_release，安装包dnsmasq-utils
[Ping] 虚机Ping不通
- 确认打开SSH和ICMP访问限制
- 确认打开ip_v4转发
- 确认
nova.conf配置use_ipv6=false - 参考链接：https://ask.openstack.org/en/question/120/cantt-ping-my-vm-from-controller-node/
[创建项目] NotFound: ***“Member”
Horizon的“项目”页面点击“创建项目”按钮报错，因为缺少默认角色Member，创建即可
keystone role-create --name Member
[nova-consoleauth] UnsupportedRpcVersion: Specified RPC version, 1.0, not supported by this endpoint.
Horizon的Console页面不显示，发现nova-consoleauth报错
noVNC给nova-consoleauth发了一个check_token的RPC，RPC版本为空则默认设为1.0，而nova-consoleauth这边默认是2.0的API，在检查API版本兼容性时报错，可以硬改成2.0，也能过；
但是最后页面还是显示不出来，用xvpvncviewer能接上，但看不到任何东西，暂不能确定问题所在。