SAIO Swift All In One Diablo版安装指南 Alpha

SAIO Swift All In One Diablo版安装指南 Alpha
Note

在阅读本文之外,你可以参考来自于zzcase精心制作的简明swift安装指南和使用已经打包好的配置文件

以及笨笨blog所写的Swift在Ubuntu系统上的安装与配置

按照本人的一贯风格，采用注解和部分翻译的方式来介绍Swift的SAIO安装

Alpha:Created in 2011.9.24

Updated:

1st 2011.9.27 修正了调试结果

2rd 2011.9.29 增加一些注释
Instructions for setting up a development VM 搭建开发虚拟机

This documents setting up a virtual machine for doing Swift development. The virtual machine will emulate running a four node Swift cluster.

Get the Ubuntu 10.04 LTS (Lucid Lynx)server image:

Ubuntu Server ISO: http://releases.ubuntu.com/lucid/ubuntu-10.04.2-server-amd64.iso (717 MB)

Ubuntu Live/Install: http://cdimage.ubuntu.com/releases/lucid/release/ubuntu-10.04.2-dvd-amd64.iso (4.2 GB)

Ubuntu Mirrors: https://launchpad.net/ubuntu/+cdmirrors

本人用的是Ubuntu 11.04 i386版本，一切正常，您可以自行决定选择何种版本

Create guest virtual machine from the Ubuntu image.

Additional information about setting up a Swift development snapshot on other distributions is available on the wiki at http://wiki.openstack.org/SAIOInstructions.
Installing dependencies and the core code 安装依赖性包和核心代码
- As root on guest (you’ll have to log in as you, then sudo su -):
  
  apt-get install python-software-properties
  
  add-apt-repository ppa:swift-core/ppa
  
  apt-get update
  
  apt-get install curl gcc bzr memcached python-configobj python-coverage python-dev python-nose python-setuptools python-simplejson python-xattr sqlite3 xfsprogs python-webob python-eventlet python-greenlet python-pastedeploy python-netifaces
  
  Install anything else you want, like screen, ssh, vim, etc.
  
  Next, choose either Using a partition for storage or Using a loopback device for storage.
  
  本文选择的是使用环回设备用于存储，哥没第二块硬盘，也无空余分区...
Using a partition for storage 使用一个新分区作为存储(跳过此段）

If you are going to use a separate partition for Swift data, be sure to add another device when creating the VM, and follow these instructions.

fdisk /dev/sdb (set up a single partition)

mkfs.xfs -i size=1024 /dev/sdb1

Edit /etc/fstab and add

/dev/sdb1 /mnt/sdb1 xfs noatime,nodiratime,nobarrier,logbufs=8 0 0

mkdir /mnt/sdb1

mount /mnt/sdb1

mkdir /mnt/sdb1/1 /mnt/sdb1/2 /mnt/sdb1/3 /mnt/sdb1/4

chown <your-user-name>:<your-group-name> /mnt/sdb1/*

mkdir /srv

for x in {1..4}; do ln -s /mnt/sdb1/$x /srv/$x; done

mkdir -p /etc/swift/object-server /etc/swift/container-server /etc/swift/account-server /srv/1/node/sdb1 /srv/2/node/sdb2 /srv/3/node/sdb3 /srv/4/node/sdb4 /var/run/swift

chown -R <your-user-name>:<your-group-name> /etc/swift /srv/[1-4]/ /var/run/swift – Make sure to include the trailing slash after /srv/[1-4]/

Add to /etc/rc.local (before the exit 0):

mkdir /var/run/swift chown <your-user-name>:<your-group-name> /var/run/swift

Next, skip to Setting up rsync.
Using a loopback device for storage 使用环回设备用于存储

关于环回设备

环回设备（loopback device）

Linux内核用结构体struct net_device表示一个网络设备接口，该结构体的成员hard_start_xmit是个函数指针，用于完成数据报在网络上的发送工作，其原型是：
int (*hard_start_xmit)( struct sk_buff *skb, struct net_device *dev );
skb是待发送的数据缓冲区，dev是该网络设备接口本身的一个指针。
环回设备接口由于是把数据报发给本机，所以其发送数据报函数比较特别，他把skb稍加处理后，又转回给协议栈的数据报接收函数netif_rx。其发送函数的函数名是loopback_xmit。


首先，loopback_xmit调用skb_orphan把skb孤立，使他跟发送socket和协议栈不再有任何联系，也即对本机来说，这个skb的数据内容已发送出去了，而skb相当于已被释放掉了。skb_orphan所做的实际事情是，首先从skb->sk(发送这个skb的那个socket)的sk_wmem_alloc减去skb->truesize，也即从socket的已提交发送队列的字节数中减去这个skb，表示这个skb已发送出去了，同时，假如有进程在这个socket上写等待，则唤醒这些进程继续发送数据报，然后把socket的引用计数减1，最后，令sk->destructor和skb->sk都为NULL，使skb完全孤立。实际上，对于环回设备接口来说，数据的发送工作至此已全部完成，接下来，只要把这个实际上还未被释放的skb传回给协议栈的接收函数即可。
在传回去之前，还需要做一些工作，因为协议栈在发送数据报时，为数据报打以太网首部时，skb->data是指向以太网首部的开始位置的，网络设备接口传回的数据报是需要已剥离了以太网首部的，所以令skb->data加上ETH_HLEN(14)，令skb->mac.raw指向原来data的位置，即以太网首部。然后，需要确定skb->pkt_type的值，即该数据报的类型，假如以太网首部中的目的mac地址是个组播或广播地址，则skb->pkt_type为PACKET_BROADCAST或PACKET_MULTICAST，关于MAC地址类型的判断方法以后再周详分析。否则，假如目的mac地址不等于本接口设备的mac地址，则skb->pkt_type为PACKET_OTHERHOST，否则就为默认值PACKET_HOST。最后，配置skb->protocol(ETH_P_IP，ETH_P_ARP或其他)，配置skb->dev，再更新一下统计值，把skb交回给协议协栈即可。
struct net_device更有一些跟协议栈的处理流程关系比较密切的成员函数，下面一一介绍。
hard_header，该成员被以太网设备驱动程式用于为每一个待发送数据报构建以太网首部，系统中任何以太网设备驱动程式共享一个函数即eth_header。任何数据报在传递给该函数之前，其skb头部预留了以太网首部的空间，data成员指向网络层首部，eth_header将data成员指向以太网首部，并为以太网首部填入目的以太网地址，源以太网地址和网络层协议类型(ETH_P_IP或ETH_P_ARP)，该函数在协议栈中主要有两处被用到，一是ARP模块中，发送ARP请求或应答前，构建以太网首部用；另一处是在IP数据发送过程中，构建以太网首部用。
hard_header_cache，用于创建以太网首部的高速缓冲，每一个邻居节点都有一个struct hh_cache *hh成员，用于缓冲该邻居节点的以太网首部，有了这个缓冲，以后再向这个邻居发数IP数据的时候，不必再调用hard_header构建以太网首部，而是直接从hh中拷贝即可。

If you want to use a loopback device instead of another partition, follow these instructions.

mkdir /srv

dd if=/dev/zero of=/srv/swift-disk bs=1024 count=0 seek=1000000

(modify seek to make a larger or smaller partition

dd是转换并复制文件命令，参数if指输入文件，of指输出文件，bs是每次读写bs大小的bytes，count是指复制count个输入块。调整seek参数的值以分配分区大小，swift-disk的大小=1024*1000000)

mkfs.xfs -i size=1024 /srv/swift-disk    #i是指inode_options，size是指文件系统的inode大小是1024bytes

编辑 /etc/fstab 增加   /srv/swift-disk /mnt/sdb1 xfs loop,noatime,nodiratime,nobarrier,logbufs=8 0 0
# /etc/fstab是用来存放文件系统的静态信息的文件。位于/etc/目录下，可以用命令less /etc/fstab 来查看。当系统启动的时候，系统会自动地从这个文件读取信息，并且会自动将此文件中指定的文件系统挂载到指定的目录，详细介绍。
参数loop:表示loop设备
参数noatime:Do not update inode access times on this filesystem (e.g, for faster access on the news spool to speed up news servers).
参数 nodiratime： Do not update directory inode access times on this filesystem.
参数nobarrier:This disables the use of write barriers in the jbd code.Write barriers enforce proper on-disk ordering of journal commits, making volatile disk write caches safe to use, at some performance penalty.If your disks are battery-backed in one way or another, disabling barriers may safely improve performance.
参数logbufs:Set the number of in-memory log buffers. 默认值是8，表示文件系统的块大小是64KiB。 **Kibibyte是一种资讯计量单位，代表1024字节，即2¹⁰字节，一般简称为KiB。

mkdir /mnt/sdb1

mount /mnt/sdb1

mkdir /mnt/sdb1/1 /mnt/sdb1/2 /mnt/sdb1/3 /mnt/sdb1/4

chown -R swift:swift /mnt/sdb1/*

for x in {1..4}; do ln -s /mnt/sdb1/$x /srv/$x; done

mkdir -p /etc/swift/object-server /etc/swift/container-server /etc/swift/account-server /srv/1/node/sdb1 /srv/2/node/sdb2 /srv/3/node/sdb3 /srv/4/node/sdb4 /var/run/swift

chown -R swift:swift /etc/swift /srv/[1-4]/ /var/run/swift – Make sure to include the trailing slash after /srv/[1-4]/

Add to /etc/rc.local (before the exit 0): mkdir /var/run/swift chown swift:swift /var/run/swift   #/etc/rc.local 是一个开机可自动执行的任务脚本，也就是说，如果你想让电脑在开机时自动执行的任务、程序，只要写进其中即可，/var/run 目录中存放的是自系统启动以来描述系统信息的文件
Setting up rsync 设置rsync

Create /etc/rsyncd.conf:

uid = swift
gid = swift
log file = /var/log/rsyncd.log
pid file = /var/run/rsyncd.pid
address = 127.0.0.1

[account6012]
max connections = 25
path = /srv/1/node/
read only = false
lock file = /var/lock/account6012.lock

[account6022]
max connections = 25
path = /srv/2/node/
read only = false
lock file = /var/lock/account6022.lock

[account6032]
max connections = 25
path = /srv/3/node/
read only = false
lock file = /var/lock/account6032.lock

[account6042]
max connections = 25
path = /srv/4/node/
read only = false
lock file = /var/lock/account6042.lock

[container6011]
max connections = 25
path = /srv/1/node/
read only = false
lock file = /var/lock/container6011.lock

[container6021]
max connections = 25
path = /srv/2/node/
read only = false
lock file = /var/lock/container6021.lock

[container6031]
max connections = 25
path = /srv/3/node/
read only = false
lock file = /var/lock/container6031.lock

[container6041]
max connections = 25
path = /srv/4/node/
read only = false
lock file = /var/lock/container6041.lock

[object6010]
max connections = 25
path = /srv/1/node/
read only = false
lock file = /var/lock/object6010.lock

[object6020]
max connections = 25
path = /srv/2/node/
read only = false
lock file = /var/lock/object6020.lock

[object6030]
max connections = 25
path = /srv/3/node/
read only = false
lock file = /var/lock/object6030.lock

[object6040]
max connections = 25
path = /srv/4/node/
read only = false
lock file = /var/lock/object6040.lock

Edit the following line in /etc/default/rsync:

RSYNC_ENABLE=true #这步别忘了

service rsync restart
Optional: Setting up rsyslog for individual logging 设置rsylog来生成独立日志

Create /etc/rsyslog.d/10-swift.conf:

# Uncomment the following to have a log containing all logs together
#local1,local2,local3,local4,local5.* /var/log/swift/all.log

# Uncomment the following to have hourly proxy logs for stats processing
#$template HourlyProxyLog,"/var/log/swift/hourly/%$YEAR%%$MONTH%%$DAY%%$HOUR%"
#local1.*;local1.!notice ?HourlyProxyLog

local1.*;local1.!notice /var/log/swift/proxy.log
local1.notice /var/log/swift/proxy.error
local1.* ~

local2.*;local2.!notice /var/log/swift/storage1.log
local2.notice /var/log/swift/storage1.error
local2.* ~

local3.*;local3.!notice /var/log/swift/storage2.log
local3.notice /var/log/swift/storage2.error
local3.* ~

local4.*;local4.!notice /var/log/swift/storage3.log
local4.notice /var/log/swift/storage3.error
local4.* ~

local5.*;local5.!notice /var/log/swift/storage4.log
local5.notice /var/log/swift/storage4.error
local5.* ~

Edit /etc/rsyslog.conf and make the following change:

$PrivDropToGroup adm

mkdir -p /var/log/swift/hourly

chown -R syslog.adm /var/log/swift

service rsyslog restart
Getting the code and setting up test environment 获得代码和设置测试环境

Sample configuration files are provided with all defaults in line-by-line comments.

Do these commands as you on guest. The bazaar configuration is optional; you can always do a bzr branch command regardless of whether you have a Launchpad account（这里我没有执行成功，研究了好久的bzr和LaunchPad啊...哪位同学可以指点一下...更新，已经搞定，具体见下）:

mkdir ~/bin

(optional) mkdir ~/.bazaar

(optional) Create ~/.bazaar/bazaar.conf:

[DEFAULT] email = Your Name <your-email-address>

(optional) If you are using launchpad to get the code or make changes, run bzr launchpad-login <launchpad_id>

Create the swift repo with bzr init-repo swift

Check out a bzr branch of swift, for example: cd ~/swift; bzr branch lp:swift trunk （我卡在这里了，后来我去注册来Launchpad帐号，依然没有成功，错误原因 bzr: ERROR: Not a branch: "bzr+ssh://bazaar.launchpad.net/%2Bbranch/swift/"。去官网下了最新的Diablo版，自行安装。更新，已经解决。办法有两种：1.可以使用bzr branch http://bazaar.launchpad.net/~hudson-openstack/swift/trunk/ 2.由于openstack的代码整体已迁到github上了，可以使用git clone https://github.com/openstack/swift.git

Build a development installation of swift, for example: cd ~/swift/trunk; sudo python setup.py develop

Edit ~/.bashrc and add to the end:

export SWIFT_TEST_CONFIG_FILE=/etc/swift/func_test.conf
export PATH=${PATH}:~/bin

. ~/.bashrc
Configuring each node 配置各个节点

Sample configuration files are provided with all defaults in line-by-line comments.

Create /etc/swift/proxy-server.conf: #这个文件请确认无误，当前使用的认证方式是tempauth

[DEFAULT]
bind_port = 8080
user = swift
log_facility = LOG_LOCAL1

[pipeline:main]
pipeline = healthcheck cache tempauth proxy-server

[app:proxy-server]
use = egg:swift#proxy
allow_account_management = true

[filter:tempauth]
use = egg:swift#tempauth
user_admin_admin = admin .admin .reseller_admin
user_test_tester = testing .admin
user_test2_tester2 = testing2 .admin
user_test_tester3 = testing3

[filter:healthcheck]
use = egg:swift#healthcheck

[filter:cache]
use = egg:swift#memcache

Create /etc/swift/swift.conf:　　

[swift-hash] # random unique string that can never change (DO NOT LOSE)
swift_hash_path_suffix = changeme #这个字段你可以随意设置

Create /etc/swift/account-server/1.conf:

[DEFAULT]
devices = /srv/1/node
mount_check = false
bind_port = 6012
user = <your-user-name>
log_facility = LOG_LOCAL2

[pipeline:main]
pipeline = account-server

[app:account-server]
use = egg:swift#account

[account-replicator]
vm_test_mode = yes

[account-auditor]

[account-reaper]

Create /etc/swift/account-server/2.conf:

[DEFAULT]
devices = /srv/2/node
mount_check = false
bind_port = 6022
user = <your-user-name>
log_facility = LOG_LOCAL3

[pipeline:main]
pipeline = account-server

[app:account-server]
use = egg:swift#account

[account-replicator]
vm_test_mode = yes

[account-auditor]

[account-reaper]

Create /etc/swift/account-server/3.conf:

[DEFAULT]
devices = /srv/3/node
mount_check = false
bind_port = 6032
user = <your-user-name>
log_facility = LOG_LOCAL4

[pipeline:main]
pipeline = account-server

[app:account-server]
use = egg:swift#account

[account-replicator]
vm_test_mode = yes

[account-auditor]

[account-reaper]

Create /etc/swift/account-server/4.conf:

[DEFAULT]
devices = /srv/4/node
mount_check = false
bind_port = 6042
user = <your-user-name>
log_facility = LOG_LOCAL5

[pipeline:main]
pipeline = account-server

[app:account-server]
use = egg:swift#account

[account-replicator]
vm_test_mode = yes

[account-auditor]

[account-reaper]

Create /etc/swift/container-server/1.conf:

[DEFAULT]
devices = /srv/1/node
mount_check = false
bind_port = 6011
user = <your-user-name>
log_facility = LOG_LOCAL2

[pipeline:main]
pipeline = container-server

[app:container-server]
use = egg:swift#container

[container-replicator]
vm_test_mode = yes

[container-updater]

[container-auditor]

[container-sync]

Create /etc/swift/container-server/2.conf:

[DEFAULT]
devices = /srv/2/node
mount_check = false
bind_port = 6021
user = <your-user-name>
log_facility = LOG_LOCAL3

[pipeline:main]
pipeline = container-server

[app:container-server]
use = egg:swift#container

[container-replicator]
vm_test_mode = yes

[container-updater]

[container-auditor]

[container-sync]

Create /etc/swift/container-server/3.conf:

[DEFAULT]
devices = /srv/3/node
mount_check = false
bind_port = 6031
user = <your-user-name>
log_facility = LOG_LOCAL4

[pipeline:main]
pipeline = container-server

[app:container-server]
use = egg:swift#container

[container-replicator]
vm_test_mode = yes

[container-updater]

[container-auditor]

[container-sync]

Create /etc/swift/container-server/4.conf:

[DEFAULT]
devices = /srv/4/node
mount_check = false
bind_port = 6041
user = <your-user-name>
log_facility = LOG_LOCAL5

[pipeline:main]
pipeline = container-server

[app:container-server]
use = egg:swift#container

[container-replicator]
vm_test_mode = yes

[container-updater]

[container-auditor]

[container-sync]

Create /etc/swift/object-server/1.conf:

[DEFAULT]
devices = /srv/1/node
mount_check = false
bind_port = 6010
user = <your-user-name>
log_facility = LOG_LOCAL2

[pipeline:main]
pipeline = object-server

[app:object-server]
use = egg:swift#object

[object-replicator]
vm_test_mode = yes

[object-updater]

[object-auditor]

Create /etc/swift/object-server/2.conf:

[DEFAULT]
devices = /srv/2/node
mount_check = false
bind_port = 6020
user = <your-user-name>
log_facility = LOG_LOCAL3

[pipeline:main]
pipeline = object-server

[app:object-server]
use = egg:swift#object

[object-replicator]
vm_test_mode = yes

[object-updater]

[object-auditor]

Create /etc/swift/object-server/3.conf:

[DEFAULT]
devices = /srv/3/node
mount_check = false
bind_port = 6030
user = <your-user-name>
log_facility = LOG_LOCAL4

[pipeline:main]
pipeline = object-server

[app:object-server]
use = egg:swift#object

[object-replicator]
vm_test_mode = yes

[object-updater]

[object-auditor]

Create /etc/swift/object-server/4.conf:

[DEFAULT]
devices = /srv/4/node
mount_check = false
bind_port = 6040
user = <your-user-name>
log_facility = LOG_LOCAL5

[pipeline:main]
pipeline = object-server

[app:object-server]
use = egg:swift#object

[object-replicator]
vm_test_mode = yes

[object-updater]

[object-auditor]
Setting up scripts for running Swift 设置运行Swift的脚本

Create ~/bin/resetswift.

If you are using a loopback device substitute /dev/sdb1 with /srv/swift-disk.

If you did not set up rsyslog for individual logging, remove the find /var/log/swift... line:

#!/bin/bash
swift-init all stop
find /var/log/swift -type f -exec rm -f {} \;
sudo umount /mnt/sdb1
sudo mkfs.xfs -f -i size=1024 /dev/sdb1
sudo mount /mnt/sdb1
sudo mkdir /mnt/sdb1/1 /mnt/sdb1/2 /mnt/sdb1/3 /mnt/sdb1/4
sudo chown <your-user-name>:<your-group-name> /mnt/sdb1/*
mkdir -p /srv/1/node/sdb1 /srv/2/node/sdb2 /srv/3/node/sdb3 /srv/4/node/sdb4
sudo rm -f /var/log/debug /var/log/messages /var/log/rsyncd.log /var/log/syslog
sudo service rsyslog restart
sudo service memcached restart

Create ~/bin/remakerings:

#!/bin/bash
cd /etc/swift

rm -f *.builder *.ring.gz backups/*.builder backups/*.ring.gz

swift-ring-builder object.builder create 18 3 1
swift-ring-builder object.builder add z1-127.0.0.1:6010/sdb1 1
swift-ring-builder object.builder add z2-127.0.0.1:6020/sdb2 1
swift-ring-builder object.builder add z3-127.0.0.1:6030/sdb3 1
swift-ring-builder object.builder add z4-127.0.0.1:6040/sdb4 1
swift-ring-builder object.builder rebalance
swift-ring-builder container.builder create 18 3 1
swift-ring-builder container.builder add z1-127.0.0.1:6011/sdb1 1
swift-ring-builder container.builder add z2-127.0.0.1:6021/sdb2 1
swift-ring-builder container.builder add z3-127.0.0.1:6031/sdb3 1
swift-ring-builder container.builder add z4-127.0.0.1:6041/sdb4 1
swift-ring-builder container.builder rebalance
swift-ring-builder account.builder create 18 3 1
swift-ring-builder account.builder add z1-127.0.0.1:6012/sdb1 1
swift-ring-builder account.builder add z2-127.0.0.1:6022/sdb2 1
swift-ring-builder account.builder add z3-127.0.0.1:6032/sdb3 1
swift-ring-builder account.builder add z4-127.0.0.1:6042/sdb4 1
swift-ring-builder account.builder rebalance

Create ~/bin/startmain:

#!/bin/bash
swift-init main start

Create ~/bin/startrest:

#!/bin/bash
swift-init rest start

chmod +x ~/bin/*

remakerings    运行结果如下：

Device z1-127.0.0.1:6010/sdb1_"" with 1.0 weight got id 0
Device z2-127.0.0.1:6020/sdb2_"" with 1.0 weight got id 1
Device z3-127.0.0.1:6030/sdb3_"" with 1.0 weight got id 2
Device z4-127.0.0.1:6040/sdb4_"" with 1.0 weight got id 3
Reassigned 262144 (100.00%) partitions. Balance is now 0.00.
Device z1-127.0.0.1:6011/sdb1_"" with 1.0 weight got id 0
Device z2-127.0.0.1:6021/sdb2_"" with 1.0 weight got id 1
Device z3-127.0.0.1:6031/sdb3_"" with 1.0 weight got id 2
Device z4-127.0.0.1:6041/sdb4_"" with 1.0 weight got id 3
Reassigned 262144 (100.00%) partitions. Balance is now 0.00.
Device z1-127.0.0.1:6012/sdb1_"" with 1.0 weight got id 0
Device z2-127.0.0.1:6022/sdb2_"" with 1.0 weight got id 1
Device z3-127.0.0.1:6032/sdb3_"" with 1.0 weight got id 2
Device z4-127.0.0.1:6042/sdb4_"" with 1.0 weight got id 3
Reassigned 262144 (100.00%) partitions. Balance is now 0.00.

cd ~/swift/trunk; ./.unittests 这步单元测试，出错，出错原因是找不到目录下测试用的两个db数据库，我暂时把test_db.py的相应代码注释掉了(现在已经解决，注意你若使用的是zzcase提供的配置文件，需要注意到1.4使用的是tempauth，和1.1是不同的，请按本文修改你的配置文件)

swift@ubuntu:~/swift-1.4.3$ ./.unittests
..........................................SSSSSSSS.........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
Name                                   Stmts   Exec  Cover   Missing
--------------------------------------------------------------------
swift                                     13     13   100%
swift.account                              1      1   100%
swift.account.auditor                     57     12    21%   30-37, 41-62, 66-84, 93-103
swift.account.reaper                     204     23    11%   55-74, 78-82, 86-90, 94-98, 106-113, 122-132, 147-174, 213-266, 304-364, 387-415
swift.account.replicator                   8      8   100%
swift.account.server                     215    171    79%   62-63, 66, 69, 82-83, 86, 114, 137-138, 141, 156-158, 172, 255-269, 275-276, 280, 283, 286, 301, 307-311, 315, 327, 335-337
swift.common                               0      0   100%
swift.common.bench                       177     31    17%   32-33, 36, 42-78, 83-84, 91-104, 107-116, 119, 125-129, 132-139, 145-148, 151-157, 161-177, 183-186, 189-205, 211-218, 222-249
swift.common.bufferedhttp                 65     52    80%   63-71, 92, 122, 156, 160, 162
swift.common.client                      454    359    79%   28-29, 33-34, 39-43, 82, 124, 129, 134, 160, 193-196, 222-223, 228-230, 234, 236, 238, 254, 298-307, 337-349, 354, 356, 358, 360, 375, 404-407, 460, 525-538, 567-570, 614, 620, 622, 626, 628, 630, 634, 641-652, 791, 793, 797, 818, 840, 871
swift.common.constraints                  73     73   100%
swift.common.daemon                       38     35    92%   46-48
swift.common.db                          809    675    83%   135-136, 231, 242, 259, 273-295, 304-305, 315-319, 345-348, 383-389, 401-403, 454-456, 472, 513, 519-521, 547, 576-582, 594, 629, 641, 644, 698, 781-783, 799, 811-812, 819-821, 849-852, 884, 890, 892, 915-917, 924, 945-947, 969, 972-975, 994, 1016-1022, 1066-1068, 1093, 1189, 1323, 1338-1339, 1346-1348, 1358-1360, 1393-1396, 1410-1412, 1458, 1460, 1468-1482, 1496-1498, 1525-1527, 1552-1554, 1576, 1637
swift.common.db_replicator               338    194    57%   61, 183, 191, 196-198, 223-227, 236, 269, 288-290, 296, 298-299, 301, 309-315, 339, 347-348, 352-353, 357-360, 367-377, 394-401, 404-408, 416-417, 419-430, 433, 443-448, 463-482, 485-532, 543-551, 557-568
swift.common.direct_client               193     20    10%   34-36, 57-87, 104-123, 145-175, 180-189, 214-233, 253-282, 308-338, 356-365, 389-398, 421-454
swift.common.exceptions                   25     24    96%   26
swift.common.manager                     321    319    99%   335-336
swift.common.memcached                   188    172    91%   81-85, 101, 170-171, 206-208, 245-246, 275-276, 311-312
swift.common.middleware                    1      1   100%
swift.common.middleware.acl               47     47   100%
swift.common.middleware.catch_errors      30     22    73%   40-42, 54-59
swift.common.middleware.domain_remap      56     51    91%   112-117
swift.common.middleware.healthcheck       15     12    80%   42-44
swift.common.middleware.memcache          14      9    64%   36-42
swift.common.middleware.ratelimit        124    124   100%
swift.common.middleware.staticweb        220    214    97%   114-115, 150, 511, 516, 519
swift.common.middleware.swift3           237    229    96%   225, 347, 405-408, 456-457, 470-471
swift.common.middleware.tempauth         279    184    65%   82, 85, 90, 121-137, 147-154, 206, 210-212, 215-233, 244-245, 306, 308-310, 319-323, 337-338, 343, 376-377, 400, 409-448, 454, 457, 461, 466, 469, 474
swift.common.ring                          2      2   100%
swift.common.ring.builder                258    226    87%   73-99, 102, 130, 147, 312, 341, 364
swift.common.ring.ring                    68     64    94%   33, 58, 67, 81
swift.common.utils                       572    478    83%   39-40, 76-77, 103, 139, 157, 266, 333, 632-635, 653-678, 704-708, 735-750, 761-767, 898-900, 936-939, 947, 952, 957, 1025, 1087-1106
swift.common.wsgi                        124     51    41%   79-81, 83, 102-191
swift.container                            1      1   100%
swift.container.auditor                   58     12    20%   30-38, 42-64, 68-87, 96-106
swift.container.replicator                 8      8   100%
swift.container.server                   269    223    82%   106, 126-127, 138-139, 143, 146, 161, 164, 167, 174-175, 179, 185, 187, 204, 230-231, 234, 262, 361, 365-374, 380-381, 385, 391, 393, 396, 417, 423-427, 439, 447-449
swift.container.sync                     196    195    99%   383
swift.container.updater                  166    119    71%   78-79, 89-93, 99, 108, 110, 113-121, 124, 126-133, 136-138, 149, 156-157, 203, 237-240, 265-278
swift.obj                                  1      1   100%
swift.obj.auditor                        126    124    98%   145-146
swift.obj.replicator                     371    254    68%   66, 93, 190-192, 206-209, 267-270, 275-280, 282, 285, 306, 319, 329, 355, 362-379, 394-448, 478, 483-487, 496, 506-509, 524-525, 528, 538-539, 563-565, 570-576, 588-592, 595-613
swift.obj.server                         462    428    92%   206-207, 255-256, 339, 431, 434, 467, 544, 619, 659, 686-703, 711, 718-721, 734, 740, 746-748
swift.obj.updater                        140     95    67%   63-101, 112-114, 134, 139, 142-146, 167-172, 186, 188-191
swift.proxy                                1      1   100%
swift.proxy.server                      1066    945    88%   163-164, 258-264, 392, 468, 470-471, 477-478, 617, 634-635, 639-640, 642-643, 749-757, 774-796, 806-819, 824-847, 850, 855-865, 899, 976-990, 1043, 1090, 1092-1105, 1108, 1114-1118, 1178-1180, 1190, 1212, 1264, 1353, 1391, 1411-1414, 1422, 1471-1474, 1480, 1607, 1641, 1683, 1696, 1719-1721
--------------------------------------------------------------------
TOTAL                                   8091   6302    77%
----------------------------------------------------------------------
Ran 683 tests in 22.676s

OK (SKIP=8)

startmain (The Unable to increase file descriptor limit. Running as non-root? warnings are expected and ok.出现该警告为预期结果，正常)

swift@ubuntu:~/bin$ ./startmain        #注意WARNING是正常信息
WARNING: Unable to increase file descriptor limit.  Running as non-root?
auth-server running (6473 - /etc/swift/auth-server.conf)
auth-server already started...
WARNING: Unable to increase file descriptor limit.  Running as non-root?
proxy-server running (6475 - /etc/swift/proxy-server.conf)
proxy-server already started...
WARNING: Unable to increase file descriptor limit.  Running as non-root?
account-server running (6480 - /etc/swift/account-server/3.conf)
account-server running (6477 - /var/run/swift/account-server/0.pid)
account-server running (6478 - /etc/swift/account-server/1.conf)
account-server running (6479 - /etc/swift/account-server/2.conf)
account-server already started...
WARNING: Unable to increase file descriptor limit.  Running as non-root?
container-server running (6488 - /etc/swift/container-server/2.conf)
container-server running (6489 - /etc/swift/container-server/3.conf)
container-server running (6486 - /var/run/swift/container-server/0.pid)
container-server running (6487 - /etc/swift/container-server/1.conf)
container-server already started...
WARNING: Unable to increase file descriptor limit.  Running as non-root?
object-server running (6498 - /var/run/swift/object-server/0.pid)
object-server running (6499 - /etc/swift/object-server/1.conf)
object-server running (6500 - /etc/swift/object-server/2.conf)
object-server running (6501 - /etc/swift/object-server/3.conf)
object-server already started...

Get an X-Storage-Url and X-Auth-Token: curl -v -H 'X-Storage-User: test:tester' -H 'X-Storage-Pass: testing' http://127.0.0.1:8080/auth/v1.0

运行结果如下：

swift@ubuntu:~/bin$ curl -v -H 'X-Storage-User: test:tester' -H 'X-Storage-Pass: testing' http://127.0.0.1:8080/auth/v1.0
* About to connect() to 127.0.0.1 port 8080 (#0)
*   Trying 127.0.0.1... connected
* Connected to 127.0.0.1 (127.0.0.1) port 8080 (#0)
> GET /auth/v1.0 HTTP/1.1
> User-Agent: curl/7.21.3 (i686-pc-linux-gnu) libcurl/7.21.3 OpenSSL/0.9.8o zlib/1.2.3.4 libidn/1.18
> Host: 127.0.0.1:8080
> Accept: */*
> X-Storage-User: test:tester
> X-Storage-Pass: testing
>
< HTTP/1.1 204 No Content
< X-Storage-Url: http://127.0.0.1:8080/v1/AUTH_98a7125e8bb84ded9cfe15d8dd19bc6b   #下一步要用到的数据
< X-Storage-Token: AUTH_tkf4f5252a030c4640b8fb04942849148c
< X-Auth-Token: AUTH_tkf4f5252a030c4640b8fb04942849148c    #这个是我们下一步需要用的
< Content-Length: 0
< Date: Sun, 25 Sep 2011 03:09:52 GMT
<
* Connection #0 to host 127.0.0.1 left intact
* Closing connection #0

Check that you can GET account: curl -v -H 'X-Auth-Token: <token-from-x-auth-token-above>' <url-from-x-storage-url-above> 请注意这条语句中的空格，如果'X-Auth-Token: <token-from-x-auth-token-above>'间忽略了空格，将产生500 Internal Server Error。

swift@ubuntu:~/bin$ curl -v -H 'X-Auth-Token: AUTH_tkf4f5252a030c4640b8fb04942849148c' http://127.0.0.1:8080/v1/AUTH_98a7125e8bb84ded9cfe15d8dd19bc6b
* About to connect() to 127.0.0.1 port 8080 (#0)
*   Trying 127.0.0.1... connected
* Connected to 127.0.0.1 (127.0.0.1) port 8080 (#0)
> GET /v1/AUTH_98a7125e8bb84ded9cfe15d8dd19bc6b HTTP/1.1
> User-Agent: curl/7.21.3 (i686-pc-linux-gnu) libcurl/7.21.3 OpenSSL/0.9.8o zlib/1.2.3.4 libidn/1.18
> Host: 127.0.0.1:8080
> Accept: */*
> X-Auth-Token: AUTH_tkf4f5252a030c4640b8fb04942849148c
>
< HTTP/1.1 204 No Content
< X-Account-Object-Count: 0
< X-Account-Bytes-Used: 0
< X-Account-Container-Count: 0
< Content-Length: 0
< Date: Sun, 25 Sep 2011 03:15:33 GMT
<
* Connection #0 to host 127.0.0.1 left intact
* Closing connection #0

Check that swift works: swift -A http://127.0.0.1:8080/auth/v1.0 -U test:tester -K testing stat    运行结果如下：

swift@ubuntu:~/bin$ swift -A http://127.0.0.1:8080/auth/v1.0 -U test:tester -K testing stat
   Account: AUTH_98a7125e8bb84ded9cfe15d8dd19bc6b
Containers: 0
   Objects: 0
     Bytes: 0

cp ~/swift/trunk/test/functional/sample.conf /etc/swift/func_test.conf

cd ~/swift/trunk; ./.functests (Note: functional tests will first delete everything in the configured accounts.)

cd ~/swift/trunk; ./.probetests (Note: probe tests will reset your environment as they call resetswift for each test.) 本步仍存在问题

If you plan to work on documentation (and who doesn’t?!老外好搞...):

On Ubuntu:

sudo apt-get install python-sphinx   installs Sphinx.

python setup.py build_sphinx   builds the documentation.

文档可以在/doc/build/html/index.html处浏览

On MacOS:

sudo easy_install -U sphinx installs Sphinx.

python setup.py build_sphinx builds the documentation.
Debugging Issues 调试问题

If all doesn’t go as planned, and tests fail, or you can’t auth, or something doesn’t work, here are some good starting places to look for issues:

Everything is logged in /var/log/syslog, so that is a good first place to look for errors (most likely python tracebacks 确切地说会把出错记录和Python的trackback记录在此，调试的好东西).

Make sure all of the server processes are running. For the base functionality, the Proxy, Account, Container, and Object servers should be running

If one of the servers are not running, and no errors are logged to syslog, it may be useful to try to start the server manually, for example: swift-object-server /etc/swift/object-server/1.conf will start the object server. If there are problems not showing up in syslog, then you will likely see the traceback on startup.
None
相关阅读:
影响Scala语言设计的因素列表
 mysql查询不区分大小写问题分析和解决
 mysql基础之三：char与varchar区别，varchar(M)能存多少
 Springboot Actuator之三：spring boot健康检查对Redis的连接检查的调整
 nginx实现带参数目录域名重定向二级域名方法
 Nginx正则表达式之匹配操作符详解
 微服务API网关 vs. 传统企业级API网关
 无法打开SQL Server的连接
 URAL 1146 Maximum Sum（最大子矩阵的和 DP）
leetCode 70.Climbing Stairs （爬楼梯）解题思路和方法
原文地址：https://www.cnblogs.com/yuxc/p/2188295.html

SAIO Swift All In One Diablo版 安装指南 Alpha

Instructions for setting up a development VM 搭建开发虚拟机

Installing dependencies and the core code 安装依赖性包和核心代码

Using a partition for storage 使用一个新分区作为存储(跳过此段）

Using a loopback device for storage 使用环回设备用于存储

Setting up rsync 设置rsync

Optional: Setting up rsyslog for individual logging 设置rsylog来生成独立日志

Getting the code and setting up test environment 获得代码和设置测试环境

Configuring each node 配置各个节点

Setting up scripts for running Swift 设置运行Swift的脚本

Debugging Issues 调试问题

SAIO Swift All In One Diablo版安装指南 Alpha