linux btrfs文件系统及管理
什么是btrfs?
Btrfs(B-tree文件系统,通常念成Butter FS,Better FS或B-tree FS),linux文件系统,具有写时复制COW(copy-on-write),改善ext3文件系统单文件大小限制,并加入其他特性,如可写快照,快照的快照,内建RAID,子卷(subvloume),专注于容错,修复和易于管理。单文件可达16EB,最大文件数量2^64,最大卷容量16EB,等。
btrfs功能特性
1,COW:写时复制,每次写入数据时,先将数据写入到新的block,写入成功后,更改旧数据块指针到新数据块,而非更改本身。
2,多物理卷支持,btrfs内建raid,可在线增删磁盘设备,可在线扩展和缩减磁盘空间。
3,数据和元数据校验码,checksum
4,子卷,可单独挂载子卷
5,可写快照,快照的快照,单个文件快照。
6,透明压缩
7,ext3/4和btrfs无痛互转
btrfs 基本用法:
- [root@localhost~]#btrfs--help#查看帮助可以看到btrfs有很多子命令,用法也很多,这里只举例常用选项。
- usage:btrfs[--help][--version]<group>[<group>...]<command>[<args>]
- btrfssubvolumecreate[-i<qgroupid>][<dest>/]<name>#创建子卷
- Createasubvolume
- btrfssubvolumedelete[options]<subvolume>[<subvolume>...]#删除子卷
- Deletesubvolume(s)
- btrfssubvolumelist[options][-G[+|-]value][-C[+|-]value][--sort=gen,ogen,rootid,path]<path>#显示子卷列表
- Listsubvolumes(andsnapshots)
- btrfssubvolumesnapshot[-r][-i<qgroupid>]<source><dest>|[<dest>/]<name>#创建子卷快照
- Createasnapshotofthesubvolume
- btrfssubvolumeget-default<path>#获取子卷默认的文件系统
- Getthedefaultsubvolumeofafilesystem
- btrfssubvolumeset-default<subvolid><path>#设置默认系统给子卷
- Setthedefaultsubvolumeofafilesystem
- btrfssubvolumefind-new<path><lastgen>#列出btrfs文件系统中最近修改的文件,结合find命令
- Listtherecentlymodifiedfilesinafilesystem
- btrfssubvolumeshow<subvol-path>#显示更多的子卷信息
- Showmoreinformationofthesubvolume
- btrfssubvolumesync<path>[<subvol-id>...]#子卷同步,类似mount同步模式,内存数据同步到磁盘,有待查证。
- Waituntilgivensubvolume(s)arecompletelyremovedfromthefilesystem.
- btrfsfilesystemdf[options]<path>#显示挂载的文件系统详细信息。
- Showspaceusageinformationforamountpoint
- btrfsfilesystemshow[options][<path>|<uuid>|<device>|label]#显示创建文件系统的磁盘信息。
- Showthestructureofafilesystem
- btrfsfilesystemsync<path>#强制文件系统同步,
- Forceasynconafilesystem
- btrfsfilesystemdefragment[options]<file>|<dir>[<file>|<dir>...]#碎片整理
- Defragmentafileoradirectory
- btrfsfilesystemresize[devid:][+/-]<newsize>[kKmMgGtTpPeE]|[devid:]max<path>#btrfs文件系统在线扩展和缩减空间
- Resizeafilesystem
- btrfsfilesystemlabel[<device>|<mount_point>][<newlabel>]#改变btrfs文件系统卷标
- Getorchangethelabelofafilesystem
- btrfsfilesystemusage[options]<path>[<path>..]#显示文件系统当前的使用信息。
- Showdetailedinformationaboutinternalfilesystemusage.
- btrfsbalancestart[options]<path>#改变磁盘chunk,在线改数据和元数据存储方式,单盘改raid,前提满足raid要求。
- Balancechunksacrossthedevices
- btrfsbalancepause<path>#暂停chunk更改,数据量较大,转换时间较长时,先暂停。
- Pauserunningbalance
- btrfsbalancecancel<path>#取消chunk更改,如上
- Cancelrunningorpausedbalance
- btrfsbalanceresume<path>#中断balance的操作,如上
- Resumeinterruptedbalance
- btrfsbalancestatus[-v]<path>#显示balance操作状态如上
- Showstatusofrunningorpausedbalance
- btrfsdeviceadd[options]<device>[<device>...]<path>#文件系统增加磁盘
- Addadevicetoafilesystem
- btrfsdevicedelete<device>[<device>...]<path>#文件系统删除磁盘
- Removeadevicefromafilesystem
- btrfsdevicescan[(-d|--all-devices)|<device>[<device>...]]#文件系统磁盘扫描
- Scandevicesforabtrfsfilesystem
- btrfsdeviceready<device>#猜测是检测加入的设备有没有被挂载
- Checkdevicetoseeifithasallofitsdevicesincacheformounting
- btrfsdevicestats[-z]<path>|<device>#显示文件系统的设备状态
- ShowcurrentdeviceIOstats.-ztoresetstatsafterwards.
- btrfsdeviceusage[options]<path>[<path>..]#显示文件系统内部设备详细使用信息
- Showdetailedinformationaboutinternalallocationsindevices.
btrfs文件系统管理
为分区创建btrfs文件系统
- [root@localhost~]#fdisk-l|grep"^Disk/dev/sd[a-z]"#准备sd{b,c,d,e}4块20G磁盘,未做任何分区。
- Disk/dev/sda:107.4GB,107374182400bytes,209715200sectors
- Disk/dev/sdb:21.5GB,21474836480bytes,41943040sectors
- Disk/dev/sdc:21.5GB,21474836480bytes,41943040sectors
- Disk/dev/sde:21.5GB,21474836480bytes,41943040sectors
- Disk/dev/sdd:21.5GB,21474836480bytes,41943040sectors
创建单分区btrfs并查看
- [root@localhost~]#mkfs.btrfs-L'btrfs'/dev/sdb
- btrfs-progsv3.19.1
- Seehttp://btrfs.wiki.kernel.orgformoreinformation.
- TurningONincompatfeature'extref':increasedhardlinklimitperfileto65536
- TurningONincompatfeature'skinny-metadata':reduced-sizemetadataextentrefs
- fscreatedlabelbtrfson/dev/sdb
- nodesize16384leafsize16384sectorsize4096size20.00GiB
- [root@localhost~]#btrfsfilesystemshow
- Label:'btrfs'uuid:2a9f0d3d-f8a0-4757-9f4e-d1efa04a683a
- Totaldevices1FSbytesused112.00KiB
- devid1size20.00GiBused2.04GiBpath/dev/sdb
- btrfs-progsv3.19.1
- [root@localhost~]#mount-ocompress=lzo-Lbtrfs/btrfs/挂载时可以设定透明压缩机制。
- [root@localhost~]#btrfsfilesystemdf/btrfs
- Data,single:total=8.00MiB,used=256.00KiB
- System,DUP:total=8.00MiB,used=16.00KiB
- System,single:total=4.00MiB,used=0.00B
- Metadata,DUP:total=1.00GiB,used=112.00KiB
- Metadata,single:total=8.00MiB,used=0.00B
- GlobalReserve,single:total=16.00MiB,used=0.00B
再添加一块磁盘
- [root@localhost~]#btrfsdeviceadd/dev/sdc/btrfs#添加磁盘,删除用btrfsdevicedelete/dev/sdc/btrfs
- [root@localhost~]#btrfsfish
- Label:'btrfs'uuid:2a9f0d3d-f8a0-4757-9f4e-d1efa04a683a
- Totaldevices2FSbytesused384.00KiB
- devid1size20.00GiBused2.04GiBpath/dev/sdb
- devid2size20.00GiBused0.00Bpath/dev/sdc
- btrfs-progsv3.19.1
- [root@localhost~]#
在线增加或缩减空间,在线改变空间,可以让lvm坐冷板凳了。
- [root@localhost~]#btrfsfiresize-10G/btrfs/#在线缩减空间
- Resize'/btrfs/'of'-10G'
- [root@localhost~]#btrfsfish
- Label:'btrfs'uuid:2a9f0d3d-f8a0-4757-9f4e-d1efa04a683a
- Totaldevices2FSbytesused384.00KiB
- devid1size10.00GiBused2.04GiBpath/dev/sdb
- devid2size20.00GiBused0.00Bpath/dev/sdc
- btrfs-progsv3.19.1
- [root@localhost~]#btrfsfiresize+7G/btrfs/#在线增加空间
- Resize'/btrfs/'of'+7G'
- [root@localhost~]#btrfsfish
- Label:'btrfs'uuid:2a9f0d3d-f8a0-4757-9f4e-d1efa04a683a
- Totaldevices2FSbytesused384.00KiB
- devid1size17.00GiBused2.04GiBpath/dev/sdb
- devid2size20.00GiBused0.00Bpath/dev/sdc
- btrfs-progsv3.19.1
- [root@localhost~]#
在线更改数据和元数据的结构
- [root@localhost~]#btrfsfidf/btrfs/
- Data,single:total=8.00MiB,used=256.00KiB
- System,DUP:total=8.00MiB,used=16.00KiB
- System,single:total=4.00MiB,used=0.00B
- Metadata,DUP:total=1.00GiB,used=112.00KiB
- Metadata,single:total=8.00MiB,used=0.00B
- GlobalReserve,single:total=16.00MiB,used=0.00B
- [root@localhost~]#btrfsbalancestart-mconvert=raid1/btrfs/#-mconvert为改变metadata元数据区的存储结构
- Done,hadtorelocate4outof5chunks
- [root@localhost~]#btrfsfish
- Label:'btrfs'uuid:2a9f0d3d-f8a0-4757-9f4e-d1efa04a683a
- Totaldevices2FSbytesused192.00KiB
- devid1size17.00GiBused296.00MiBpath/dev/sdb
- devid2size20.00GiBused288.00MiBpath/dev/sdc
- btrfs-progsv3.19.1
- [root@localhost~]#btrfsfidf/btrfs/
- Data,single:total=8.00MiB,used=64.00KiB
- System,RAID1:total=32.00MiB,used=16.00KiB
- Metadata,RAID1:total=256.00MiB,used=112.00KiB#对比上改为了raid1
- GlobalReserve,single:total=16.00MiB,used=0.00B
- [root@localhost~]#btrfsbalancestart-dconvert=raid1/btrfs/#-dconvert为改变data数据区的存储结构
- Done,hadtorelocate1outof3chunks
- [root@localhost~]#btrfsfidf/btrfs/
- Data,RAID1:total=1.00GiB,used=320.00KiB#对比上面改为了raid1
- System,RAID1:total=32.00MiB,used=16.00KiB
- Metadata,RAID1:total=256.00MiB,used=112.00KiB
- GlobalReserve,single:total=16.00MiB,used=0.00B
- [root@localhost~]#
显示当前文件系统使用信息
- [root@localhostbtrfs]#btrfsfiusage/btrfs/
- Overall:
- Devicesize:37.00GiB#总的空间
- Deviceallocated:2.56GiB#分给元数据管理区的空间
- Deviceunallocated:34.44GiB#未分出去的
- Devicemissing:0.00B
- Used:896.00KiB#使用了的空间
- Free(estimated):18.22GiB(min:18.22GiB)#可用空间,这里因是raid1镜像卷
- Dataratio:2.00
- Metadataratio:2.00
- Globalreserve:16.00MiB(used:0.00B)
- Data,RAID1:Size:1.00GiB,Used:320.00KiB
- /dev/sdb1.00GiB
- /dev/sdc1.00GiB
- Metadata,RAID1:Size:256.00MiB,Used:112.00KiB
- /dev/sdb256.00MiB
- /dev/sdc256.00MiB
- System,RAID1:Size:32.00MiB,Used:16.00KiB
- /dev/sdb32.00MiB
- /dev/sdc32.00MiB
- Unallocated:
- /dev/sdb15.72GiB#这里2各磁盘分配的空间不同,可以说明btrfs的内建raid1不是按物理盘划分的,而是按chunk,
- /dev/sdc18.72GiB#可以看到具体某块磁盘的使用状况。
- [root@localhostbtrfs]#btrfsdevicestats/btrfs/#查看磁盘错误信息
- [/dev/sdb].write_io_errs0
- [/dev/sdb].read_io_errs0
- [/dev/sdb].flush_io_errs0
- [/dev/sdb].corruption_errs0
- [/dev/sdb].generation_errs0
- [/dev/sdc].write_io_errs0
- [/dev/sdc].read_io_errs0
- [/dev/sdc].flush_io_errs0
- [/dev/sdc].corruption_errs0
- [/dev/sdc].generation_errs0
- [root@localhostbtrfs]#btrfsdeviceusage/btrfs/#磁盘的空间使用状态
- /dev/sdb,ID:1
- Devicesize:20.00GiB
- Data,RAID1:1.00GiB
- Metadata,RAID1:256.00MiB
- System,RAID1:32.00MiB
- Unallocated:15.72GiB
- /dev/sdc,ID:2
- Devicesize:20.00GiB
- Data,RAID1:1.00GiB
- Metadata,RAID1:256.00MiB
- System,RAID1:32.00MiB
- Unallocated:18.72GiB
- 压缩测试
- [root@localhostbtrfs22]#du-sh/btrfs/btrfs22
- 5.1G/btrfs
- 5.1G/btrfs22
- [root@localhostbtrfs22]#btrfsfishow
- Label:'btrfs'uuid:2a9f0d3d-f8a0-4757-9f4e-d1efa04a683a
- Totaldevices2FSbytesused178.63MiB#btrfs挂载采用lzo压缩,空间被压缩,因是文本文档压缩效果很明显。
- devid1size17.00GiBused1.28GiBpath/dev/sdb
- devid2size20.00GiBused1.28GiBpath/dev/sdc
- Label:'btrfs22'uuid:d4da4497-b82e-4846-b51c-cd7127ff5c74
- Totaldevices2FSbytesused5.01GiB#btrfs22挂载没有启用压缩功能。
- devid1size20.00GiBused4.04GiBpath/dev/sdd
- devid2size20.00GiBused4.00GiBpath/dev/sde
- btrfs-progsv3.19.1
子卷和快照的管理
- btrfssubvolume
- [root@localhostbtrfs22]#btrfssubvolumecreate/btrfs/btrfs.sub#创建子卷
- Createsubvolume'/btrfs/btrfs.sub'
- [root@localhostbtrfs22]#btrfssubvolumelist/btrfs#显示子卷
- ID259gen43toplevel5pathbtrfs.sub
- [root@localhostbtrfs22]#umount/btrfs
- [root@localhost~]#mount-osubvol=btrfs.sub/dev/sdc/btrfs.sub/#单独挂载子卷
- [root@localhost~]#btrfssubvolumeshow/btrfs.sub/
- /btrfs.sub
- Name:btrfs.sub
- uuid:811deb2f-764f-6440-899c-cddb2b9867e2
- Parentuuid:-
- Creationtime:2016-05-1108:43:51
- ObjectID:259
- Generation(Gen):43
- Genatcreation:43
- Parent:5
- TopLevel:5
- Flags:-
- Snapshot(s):
子卷删除
- [root@localhost~]#umount/btrfs.sub/#卸卸载子卷
- [root@localhost~]#btrfssubvolumedelete/btrfs/btrfs.sub
- #执行删除命令
- [root@localhost~]#btrfssubvolumelist/btrfs
- #查看已经被删除
- ID260gen45toplevel5pathbtrfs.sub22
子卷快照,类似创建子卷
- [root@localhost~]#btrfssubvolumelist/btrfs
- ID260gen45toplevel5pathbtrfs.sub22
- [root@localhost~]#btrfssubvolumesnapshot/btrfs/btrfs.sub22//btrfs/btrfs.sub22_snapshot
- Createasnapshotof'/btrfs/btrfs.sub22/'in'/btrfs/btrfs.sub22_snapshot'
- [root@localhost~]#btrfssubvolumelist/btrfs
- ID260gen50toplevel5pathbtrfs.sub22
- ID262gen50toplevel5pathbtrfs.sub22_snapshot
单个文件快照
- [root@localhostbtrfs]#cp--relinkhostnamehostname_snap
- cp:unrecognizedoption'--relink'
- Try'cp--help'formoreinformation.
- [root@localhostbtrfs]#cp--reflinkhostnamehostname_snap
- [root@localhostbtrfs]#cp--reflinkhostnamehostname_snap^C
- [root@localhostbtrfs]#echo"magedu.com">>hostname
- [root@localhostbtrfs]#cathostname
- localhost.localdomain
- magedu.com
- [root@localhostbtrfs]#cathostname_snap
- localhost.localdomain
- [root@localhostbtrfs]#
ext文件系统转换为btrfs
- [root@localhost~]#cp-r/tmp/*/sdf/
- [root@localhost~]#cd/sdf/
- [root@localhostsdf]#ls
- ks-script-OqV4Gblost+foundyum.log
- [root@localhost~]#umount/sdf/#第一步,先卸载需要转换的ext分区
- [root@localhost~]#fsck-f/dev/sdf#第二步,强制检测磁盘
- fsckfromutil-linux2.23.2
- e2fsck1.42.9(28-Dec-2013)
- Pass1:Checkinginodes,blocks,andsizes
- Pass2:Checkingdirectorystructure
- Pass3:Checkingdirectoryconnectivity
- Pass4:Checkingreferencecounts
- Pass5:Checkinggroupsummaryinformation
- /dev/sdf:13/1310720files(0.0%non-contiguous),126323/5242880blocks
- [root@localhost~]#btrfs-convert/dev/sdf#第三步,执行转换命令
- creatingbtrfsmetadata.
- copyinodes[o][0/13]
- creatingext2fsimagefile.
- cleaningupsystemchunk.
- conversioncomplete.
- [root@localhost~]#mount/dev/sdf/sdf/
- [root@localhost~]#cd/sdf/
- [root@localhostsdf]#ls
- ext2_savedks-script-OqV4Gblost+foundyum.log#转换产生的ext2_saved,不可删除,删除就无法转回ext文件系统
- [root@localhostsdf]#catks-script-OqV4Gb#转换后查看文件正常。
- restorecon-ir/etc/sysconfig/network-scripts/var/lib/etc/lvm\
- /dev/etc/iscsi/var/lib/iscsi/root/var/lock/var/log\
- /etc/modprobe.d/etc/sysconfig/var/cache/yum
- #AlsorelabeltheOSTreevariantsofthenormalmounts(iftheyexist)
- restorecon-ir/var/roothome/var/home/var/opt/var/srv/var/media/var/mnt
- restorecon-i/etc/rpm/macros/etc/dasd.conf/etc/zfcp.conf/lib64/usr/lib64\
- /etc/blkid.tab*/etc/mtab/etc/fstab/etc/resolv.conf\
- /etc/modprobe.conf*/var/log/*tmp/etc/crypttab\
- /etc/mdadm.conf/etc/sysconfig/network/root/install.log*\
- /etc/*shadow*/etc/dhcp/dhclient-*.conf/etc/localtime\
- /etc/hostname/root/install.log*
- if[-e/etc/zipl.conf];then
- restorecon-i/etc/zipl.conf
- fi
- [root@localhostsdf]#blkid/dev/sdf
- /dev/sdf:UUID="20bd2176-28d9-49fb-88e9-b746f5ea2736"UUID_SUB="9076e700-22a2-420e-81df-feb79449ab7c"TYPE="btrfs"#查看文件系统,已经变为btrfs
- btrfs转回ext3
- [root@localhost~]#umount/sdf/#第一步,卸载
- [root@localhost~]#btrfs-convert-r/dev/sdf#第二步,执行转换命令
- rollbackcomplete.
- [root@localhost~]#blkid/dev/sdf
- /dev/sdf:UUID="8d6c4b81-9602-428a-a340-f01b176fa82b"SEC_TYPE="ext2"TYPE="ext3"#查看转换结果,已经变为etx3格式。
- [root@localhost~]#
总结:初步了解btrfs,首先,扩展性基于B-tree架构,单个文件,磁盘,文件个数,大大超过现在对扩展性的要求,其次,数据一致性,基于COW和checksum确保数据正常(btrfs的数据检测,修复,恢复相关的命令操作后面补充),再次,设备管理功能强大,内建raid,联机raid调整,联机空间扩展和缩减,联机物理卷增删,快照,子卷,可脱离raid和lvm.
以上个人总结,不足之处欢迎指正,谢谢。
版权声明:本站文章来源标注为YINGSOO的内容版权均为本站所有,欢迎引用、转载,请保持原文完整并注明来源及原文链接。禁止复制或仿造本网站,禁止在非www.yingsoo.com所属的服务器上建立镜像,否则将依法追究法律责任。本站部分内容来源于网友推荐、互联网收集整理而来,仅供学习参考,不代表本站立场,如有内容涉嫌侵权,请联系alex-e#qq.com处理。