http://docs.openstack.org/user-guide/cli_nova_launch_instance_from_volume.html
http://docs.openstack.org/admin-guide-cloud/blockstorage-manage-volumes.html
Manage volumes
Volume-backed image
从image创建volume,当dirvier的volume clone快的话,性能要比其他store如file/swift好。
1 设置cinder为glance的存储后端:
glance_store section of the glance-api.conf file:
stores = file, http, swift, cinder
2显示 locations information
DEFAULT section of theglance-api.conf file:
show_multiple_locations = True
3 To enable the Block Storage services to create a new volume by cloning Image- Volume
DEFAULT section of the cinder.conf file. For example:
glance_api_version = 2
allowed_direct_url_schemes = cinder
4,让cinder upload-to-image来从image-Volume创建一个volume
back-end section of the cinder.conf file:
image_upload_use_cinder_backend = True
Creating a Volume-backed image
注册volume为 new Volume-backed image
$ glance image-create --disk-format raw --container-format bare --name <name>
$ glance location-add <image-uuid> --url cinder://<volume-uuid>
必须是raw和bare否则就存早glance的默认store中。
Note
Currently, the cinder store of the Image services does not support uploading and downloading of image data. By this limitation, Volume-backed images can only be used to create a new volume.
以cinder作为store的glance不支持image的upload/download,仅仅支持创建一个新volume。
Configure and use volume number weigher
http://docs.openstack.org/admin-guide-cloud/blockstorage_volume_number_weigher.html
cinder scheduler是根据free_capacity and allocated_capacity
但也可以volume 数量:
set the scheduler_default_weighers toVolumeNumberWeigher flag in the cinder.conf file
实例:
创建2个lvm backend,
在创建一个lvm type:
Define a volume type in Block Storage:
$ cinder type-create lvm
Create an extra specification that links the volume type to a back-end name:
$ cinder type-key lvm set volume_backend_name=LVM
创建6个1g的volume
$ cinder create --volume-type lvm 1
6个volume各自3个分布在2个backend上。
Migrate volumes
http://docs.openstack.org/admin-guide-cloud/blockstorage_volume_migration.html
cinder可以多个back-ends之前迁移volumes
流程如下:
- 如果storage可以自己migrate the volume,那它自己做,否则
- 2. 如果not attached, the Block Storage service创建一个volume并copy数据
Note
While most back-ends support this function, not all do. See the driver documentation in the OpenStack Configuration Reference for more details.
- 如果 volume is attached, the Block Storage创建一个volume并calls Compute copy数据. 目前仅仅支持Compute libvirt driver.
以下例子中,2个back end,采用方案3.
# cinder get-pools
Note
Only Block Storage V2 API supports get-pools.
或者
# cinder-manage host list
server1@lvmstorage-1 zone1
server2@lvmstorage-2 zone1
$ cinder show 6088f80a-f116-4331-ad48-9afb0dfb196c
$ cinder migrate 6088f80a-f116-4331-ad48-9afb0dfb196c
server2@lvmstorage-2#lvmstorage-2
cinder show来查看迁移状态
Note
Migrating volumes that have snapshots are currently not allowed.
Back up Block Storage service disks
使用LVM snapshot来创建 snapshots时,也可以用它来back up 你的volumes。使用LVM snapshot,你可以减少backup的size,它仅仅backup存在的数据而不是整个的volume。
Backup时volume不能被使用,必须数据都flush到guest文件系统,通常要求文件系统被unmounted,snapshot完成之后在mounted。
下面例子中,100 GB volume named volume-00000001只有4 GB 数据。se commands to back up only those 4 GB:
- lvm2 command. Directly manipulates the volumes.
- kpartx command. Discovers the partition table created inside the instance.
- tar command. Creates a minimum-sized backup.
- sha1sum command. Calculates the backup checksum to check its consistency.
You can apply this process to volumes of any size.
To back up Block Storage service disks
- Create a snapshot of a used volume
- Use this command to list all volumes
o # lvdisplay
o # lvcreate --size 10G --snapshot --name volume-00000001-snapshot
o /dev/cinder-volumes/volume-00000001
The --sizeparameter defines the space that LVM reserves for the snapshot volume.
- Run the lvdisplay command again to verify the snapshot:
o --- Logical volume ---
o LV Name /dev/cinder-volumes/volume-00000001
o VG Name cinder-volumes
o LV UUID gI8hta-p21U-IW2q-hRN1-nTzN-UC2G-dKbdKr
o LV Write Access read/write
o LV snapshot status source of
o /dev/cinder-volumes/volume-00000026-snap [active]
o LV Status available
o # open 1
o LV Size 15,00 GiB
o Current LE 3840
o Segments 1
o Allocation inherit
o Read ahead sectors auto
o - currently set to 256
o Block device 251:13
o
o --- Logical volume ---
o LV Name /dev/cinder-volumes/volume-00000001-snap
o VG Name cinder-volumes
o LV UUID HlW3Ep-g5I8-KGQb-IRvi-IRYU-lIKe-wE9zYr
o LV Write Access read/write
o LV snapshot status active destination for /dev/cinder-volumes/volume-00000026
o LV Status available
o # open 0
o LV Size 15,00 GiB
o Current LE 3840
o COW-table size 10,00 GiB
o COW-table LE 2560
o Allocated to snapshot 0,00%
o Snapshot chunk size 4,00 KiB
o Segments 1
o Allocation inherit
o Read ahead sectors auto
o - currently set to 256
o Block device 251:14
- Partition table discovery
为了tar 打包snapshot,使用kpartx 发现分区
o $ ls /dev/mapper/nova*
可以看见 cinder--volumes-volume--00000001--snapshot1 partition.,如果volume上有多个分区还可以看见: cinder--volumes-volume--00000001--snapshot2, cinder--volumes-volume--00000001--snapshot3, and so on.
- Mount your partition
o # mount /dev/mapper/cinder--volumes-volume--volume--00000001--snapshot1 /mnt
- Use the tar command to create archives
Create a backup of the volume:
$ tar --exclude="lost+found" --exclude="some/data/to/exclude" -czf
volume-00000001.tar.gz -C /mnt/ /backup/destination
只会打包已有的数据
- Checksum calculation I
- After work cleaning
$ sha1sum volume-00000001.tar.gz > volume-00000001.checksum
- Unmount the volume:
- Delete the partition table:
- Remove the snapshot:
o $ umount /mnt
o $ kpartx -dv /dev/cinder-volumes/volume-00000001-snapshot
o $ lvremove -f /dev/cinder-volumes/volume-00000001-snapshot
Repeat these steps for all your volumes.
- Automate your backups
可以用这个script来自动backup
和cinder backup的关系:
这里是backup cinder 服务的disks。
下面backup volumes:
Back up and restore volumes
$ cinder backup-create [--incremental] [--force] VOLUME
Volume在使用中需要force flag
The incremental and force flags are only available for block storage API v2.
The force flag is new in OpenStack Liberty.
The incremental backup is based on a parent backup。
第一次backup必须是full backup。
$ cinder backup-restore BACKUP_ID
Because volume backups are dependent on the Block Storage database, you must also back up your Block Storage database regularly to ensure data recovery.
DB也需要定期backup来保存backup metadata
如果只想backup 特定的一些可以you can export and save the metadata of selected volume backups
Backup 后端默认的是swift ,可以配置NFS:
backup_driver = cinder.backup.drivers.nfs
backup_share = HOST:EXPORT_PATH
backup_compression_algorithm = zlib
backup_sha_block_size_bytes = 32768
backup_file_size = 1999994880
Export and import backup metadata
http://docs.openstack.org/admin-guide-cloud/blockstorage_volume_backups_export_import.html
$ cinder backup-export BACKUP_ID
$ cinder backup-import METADATA
Use LIO iSCSI support¶
The default mode for the iscsi_helper tool is tgtadm. To use LIO iSCSI, install the python-rtslib package, and set iscsi_helper=lioadm in the cinder.conf file.
Once configured, you can use the cinder-rtstool command to manage the volumes. This command enables you to create, delete, and verify volumes and determine targets and add iSCSI initiators to the system.
Consistency groups
http://docs.openstack.org/admin-guide-cloud/blockstorage-consistency-groups.html
用来支持group snapshot
A consistency group can only contain volumes hosted by the same back end.
Create a consistency group:
cinder consisgroup-create
[--name name]
[--description description]
[--availability-zone availability-zone]
volume-types
Create a volume and add it to a consistency group:
Create a snapshot for a consistency group:
$ cinder cgsnapshot-create 1de80c27-3b2f-47a6-91a7-e867cbe36462
当一个volume在一个sg中,不支持一下操作:
- Volume migration.
- Volume retype.
- Volume deletion.
Oversubscription in thin provisioning
http://docs.openstack.org/admin-guide-cloud/blockstorage_over_subscription.html
Configure an NFS storage back end
http://docs.openstack.org/admin-guide-cloud/blockstorage_nfs_backend.html
NFS如何提供block volume:
cinder.volume.drivers.nfs.NfsDriver
def _create_sparsed_file(self, path, size):
"""Creates file with 0 disk usage."""
self._execute('truncate', '-s', '%sG' % size,
path, run_as_root=True)
def _create_regular_file(self, path, size):
"""Creates regular file of given size. Takes a lot of time for large
files.
"""
block_size_mb = 1
block_count = size * units.GiB / (block_size_mb * units.MiB)
self._execute('dd', 'if=/dev/zero', 'of=%s' % path,
'bs=%dM' % block_size_mb,
'count=%d' % block_count,
run_as_root=True)