GlusterFS

GlusterFS 3.5 is the oldest stable release that is still getting updates. Yesterday GlusterFS 3.5.4 has been released, and the volunteering packagers have already provided RPM packages for different Fedora and EPEL versions. If you are running the 3.5 ...

GlusterFS 3.5 is the oldest stable release that is still getting updates. Yesterday GlusterFS 3.5.4 has been released, and the volunteering packagers have already provided RPM packages for different Fedora and EPEL versions. If you are running the 3.5 ...

On May 12 and 13th, the Gluster contributor community came together to discuss the state of Gluster and the plans for the future in sunny Barcelona, Spain. We had 32 active contributors present and 21 presentations. We discussed a wide range of materia...

Yesterday morning in Barcelona, the day after the Gluster Summit, GlusterFS 3.7.0 got released. Close to 600 bug reports, a mix of feature requests, enhancements and problems have been addressed in a little over 1220 patches since July last year.This ... [More] release marks the end of life of the maintenance of GlusterFS 3.4.x, users of the 3.4 stable version should consider upgrading.The upcoming Fedora 23 (currently Rawhide) will be the first release that comes with 3.7.x by default, older Fedora releases will be kept on their stable Gluster versions. Packages for different distributions and versions will become available shortly on download.gluster.org. Once packages are available, announcements will be made on the Gluster Users list.These Release Notes below have been put together with help from many engineers that worked on features and testing. You can also find the release notes in the repositories along with the rest of the code.Major Changes and FeaturesDocumentation about major changes and features is included in the doc/features/ directory of GlusterFS repository.Bitrot DetectionBitrot detection is a technique used to identify an “insidious” type of disk error where data is silently corrupted with no indication from the disk to the storage software layer that an error has occurred. When bitrot detection is enabled on a volume, gluster performs signing of all files/objects in the volume and scrubs data periodically for signature verification. All anomalies observed will be noted in log files. For more information, refer here.Multi threaded epoll for performance improvementsGluster 3.7 introduces multiple threads to dequeue and process more requests from epoll queues. This improves performance by processing more I/O requests. Workloads that involve read/write operations on a lot of small files can benefit from this enhancement. For more information refer here.Volume Tiering [Experimental]Policy based tiering for placement of files. This feature will serve as a foundational piece for building support for data classification. For more information refer here. Volume Tiering is marked as an experimental feature for this release. It is expected to be fully supported in a 3.7.x minor release.TrashcanThis feature will enable administrators to temporarily store deleted files from Gluster volumes for a specified time period. For more information refer here.Efficient Object Count and Inode Quota SupportThis improvement enables an easy mechanism to retrieve the number of objects per directory or volume. Count of objects/files within a directory hierarchy is stored as an extended attribute of a directory. The extended attribute can be queried to retrieve the count. For more information refer here. This feature has been utilized to add support for inode quotas. For more details about inode quotas, refer here.Pro-active Self healing for Erasure CodingGluster 3.7 adds pro-active self healing support for erasure coded volumes.Exports and Netgroups Authentication for NFSThis feature adds Linux-style exports & netgroups authentication to the native NFS server. This enables administrators to restrict access to specific clients & netgroups for volume/sub-directory NFSv3 exports. For more information refer here.GlusterFindGlusterFind is a new tool that provides a mechanism to monitor data events within a volume. Detection of events like modified files is made easier without having to traverse the entire volume. For more information refer here.Rebalance Performance ImprovementsRebalance and remove brick operations in Gluster get a performance boost by speeding up identification of files needing movement and a multi-threaded mechanism to move all such files. For more information refer here.NFSv4 and pNFS supportGluster 3.7 supports export of volumes through NFSv4, NFSv4.1 and pNFS. This support is enabled via NFS Ganesha. Infrastructure changes done in Gluster 3.7 to support this feature include:Addition of upcall infrastructure for cache invalidation.Support for lease locks and delegations.Support for enabling Ganesha through Gluster CLI.Corosync and pacemaker based implementation providing resource monitoring and failover to accomplish NFS HA.For more information refer the below links:NFS Ganesha IntegrationUpcall InfrastructureGluster CLI for NFS GaneshaHigh Availability for NFS GaneshapNFS support for GlusterpNFS support for Gluster volumes and NFSv4 delegations are in beta for this release. Infrastructure changes to support Lease locks and NFSv4 delegations are targeted for a 3.7.x minor release.Snapshot SchedulingWith this enhancement, administrators can schedule volume snapshots. For more information, see here.Snapshot CloningVolume snapshots can now be cloned to create a new writeable volume. For more information, see here.Sharding [Experimental]Sharding addresses the problem of fragmentation of space within a volume. This feature adds support for files that are larger than the size of an individual brick. Sharding works by chunking files to blobs of a configurabe size. For more information, see here. Sharding is an experimental feature for this release. It is expected to be fully supported in a 3.7.x minor release.RCU in glusterdThread synchronization and critical section access has been improved by introducing userspace RCU in glusterdArbiter VolumesArbiter volumes are 3 way replicated volumes where the 3rd brick of the replica is automatically configured as an arbiter. The 3rd brick contains only metadata which provides network partition tolerance and prevents split-brains from happening. For more information, see here.Better split-brain resolutionsplit-brain resolutions can now be also driven by users without administrative intervention. For more information, see the 'Resolution of split-brain from the mount point' section here.Geo-replication improvementsThere have been several improvements in geo-replication for stability and performance. For more details, see here.Minor ImprovementsMessage ID based logging has been added for several translators.Quorum support for reads.Snapshot names contain timestamps by default.Subsequent access to the snapshots should be done by the name listed in gluster snapshot listSupport for gluster volume get added.libgfapi has added handle based functions to get/set POSIX ACLs based on common libacl structures.Known IssuesEnabling Bitrot on volumes with more than 2 bricks on a node is known to cause problems.Addition of bricks dynamically to cold or hot tiers in a tiered volume is not supported.The following configuration changes are necessary for qemu and samba integration with libgfapi to work seamlessly: # gluster volume set server.allow-insecure onEdit /etc/glusterfs/glusterd.vol to contain this line: option rpc-auth-allow-insecure on Post 1, restarting the volume would be necessary: # gluster volume stop # gluster volume start Post 2, restarting glusterd would be necessary: # service glusterd restartor # systemctl restart glusterdUpgrading to 3.7.0Instructions for upgrading from previous versions of GlusterFS are maintained on this wiki page. [Less]

Yesterday morning in Barcelona, the day after the Gluster Summit, GlusterFS 3.7.0 got released. Close to 600 bug reports, a mix of feature requests, enhancements and problems have been addressed in a little over 1220 patches since July last year.This ... [More] release marks the end of life of the maintenance of GlusterFS 3.4.x, users of the 3.4 stable version should consider upgrading.The upcoming Fedora 23 (currently Rawhide) will be the first release that comes with 3.7.x by default, older Fedora releases will be kept on their stable Gluster versions. Packages for different distributions and versions will become available shortly on download.gluster.org. Once packages are available, announcements will be made on the Gluster Users list.These Release Notes below have been put together with help from many engineers that worked on features and testing. You can also find the release notes in the repositories along with the rest of the code.Major Changes and FeaturesDocumentation about major changes and features is included in the doc/features/ directory of GlusterFS repository.Bitrot DetectionBitrot detection is a technique used to identify an “insidious” type of disk error where data is silently corrupted with no indication from the disk to the storage software layer that an error has occurred. When bitrot detection is enabled on a volume, gluster performs signing of all files/objects in the volume and scrubs data periodically for signature verification. All anomalies observed will be noted in log files. For more information, refer here.Multi threaded epoll for performance improvementsGluster 3.7 introduces multiple threads to dequeue and process more requests from epoll queues. This improves performance by processing more I/O requests. Workloads that involve read/write operations on a lot of small files can benefit from this enhancement. For more information refer here.Volume Tiering [Experimental]Policy based tiering for placement of files. This feature will serve as a foundational piece for building support for data classification. For more information refer here. Volume Tiering is marked as an experimental feature for this release. It is expected to be fully supported in a 3.7.x minor release.TrashcanThis feature will enable administrators to temporarily store deleted files from Gluster volumes for a specified time period. For more information refer here.Efficient Object Count and Inode Quota SupportThis improvement enables an easy mechanism to retrieve the number of objects per directory or volume. Count of objects/files within a directory hierarchy is stored as an extended attribute of a directory. The extended attribute can be queried to retrieve the count. For more information refer here. This feature has been utilized to add support for inode quotas. For more details about inode quotas, refer here.Pro-active Self healing for Erasure CodingGluster 3.7 adds pro-active self healing support for erasure coded volumes.Exports and Netgroups Authentication for NFSThis feature adds Linux-style exports & netgroups authentication to the native NFS server. This enables administrators to restrict access to specific clients & netgroups for volume/sub-directory NFSv3 exports. For more information refer here.GlusterFindGlusterFind is a new tool that provides a mechanism to monitor data events within a volume. Detection of events like modified files is made easier without having to traverse the entire volume. For more information refer here.Rebalance Performance ImprovementsRebalance and remove brick operations in Gluster get a performance boost by speeding up identification of files needing movement and a multi-threaded mechanism to move all such files. For more information refer here.NFSv4 and pNFS supportGluster 3.7 supports export of volumes through NFSv4, NFSv4.1 and pNFS. This support is enabled via NFS Ganesha. Infrastructure changes done in Gluster 3.7 to support this feature include:Addition of upcall infrastructure for cache invalidation.Support for lease locks and delegations.Support for enabling Ganesha through Gluster CLI.Corosync and pacemaker based implementation providing resource monitoring and failover to accomplish NFS HA.For more information refer the below links:NFS Ganesha IntegrationUpcall InfrastructureGluster CLI for NFS GaneshaHigh Availability for NFS GaneshapNFS support for GlusterpNFS support for Gluster volumes and NFSv4 delegations are in beta for this release. Infrastructure changes to support Lease locks and NFSv4 delegations are targeted for a 3.7.x minor release.Snapshot SchedulingWith this enhancement, administrators can schedule volume snapshots. For more information, see here.Snapshot CloningVolume snapshots can now be cloned to create a new writeable volume. For more information, see here.Sharding [Experimental]Sharding addresses the problem of fragmentation of space within a volume. This feature adds support for files that are larger than the size of an individual brick. Sharding works by chunking files to blobs of a configurabe size. For more information, see here. Sharding is an experimental feature for this release. It is expected to be fully supported in a 3.7.x minor release.RCU in glusterdThread synchronization and critical section access has been improved by introducing userspace RCU in glusterdArbiter VolumesArbiter volumes are 3 way replicated volumes where the 3rd brick of the replica is automatically configured as an arbiter. The 3rd brick contains only metadata which provides network partition tolerance and prevents split-brains from happening. For more information, see here.Better split-brain resolutionsplit-brain resolutions can now be also driven by users without administrative intervention. For more information, see the 'Resolution of split-brain from the mount point' section here.Geo-replication improvementsThere have been several improvements in geo-replication for stability and performance. For more details, see here.Minor ImprovementsMessage ID based logging has been added for several translators.Quorum support for reads.Snapshot names contain timestamps by default.Subsequent access to the snapshots should be done by the name listed in gluster snapshot listSupport for gluster volume get added.libgfapi has added handle based functions to get/set POSIX ACLs based on common libacl structures.Known IssuesEnabling Bitrot on volumes with more than 2 bricks on a node is known to cause problems.Addition of bricks dynamically to cold or hot tiers in a tiered volume is not supported.The following configuration changes are necessary for qemu and samba integration with libgfapi to work seamlessly: # gluster volume set server.allow-insecure onEdit /etc/glusterfs/glusterd.vol to contain this line: option rpc-auth-allow-insecure on Post 1, restarting the volume would be necessary: # gluster volume stop # gluster volume start Post 2, restarting glusterd would be necessary: # service glusterd restartor # systemctl restart glusterdUpgrading to 3.7.0Instructions for upgrading from previous versions of GlusterFS are maintained on this wiki page. [Less]

You can download the packages (tarball and RPMs) for glusterfs-3.5.4beta1 from download.gluster.org.23 bugs have been fixed. Once the fixes have been confirmed, we will do a real 3.5.4 (non-beta) release and update the packages in Fedora 20/21.Release ...

You can download the packages (tarball and RPMs) for glusterfs-3.5.4beta1 from download.gluster.org.23 bugs have been fixed. Once the fixes have been confirmed, we will do a real 3.5.4 (non-beta) release and update the packages in Fedora 20/21.Release ...

GlusterFS 3.7 beta1 RPMs for RHEL, CentOS, (except EL5) and Fedora are available at download.gluster.org.     http://download.gluster.org/pub/gluster/glusterfs/qa-releases/3.7.0beta1/ Please test it out (not on your production system!), and let us ... [More] know of any problems you hit via either BugZilla or our mailing lists! https://bugzilla.redhat.com/enter_bug.cgi?product=GlusterFS http://www.gluster.org/community/ [Less]

Over the past few days we’ve upgraded the version of Gerrit running on review.gluster.org, and moved to using GitHub as the authentication source for user accounts. This switch to GitHub as the authentication source has been fairly painful though. There is a manual step (merging of accounts) needed the first time an existing user (of […]

The Gluster community is please to announce the release of GlusterFS-3.4.7. The GlusterFS 3.4.7 release is focused on bug fixes: 33608f5 cluster/dht: Changed log level to DEBUG 076143f protocol: Log ENODATA & ENOATTR at DEBUG in removexattr_cbk ... [More] a0aa6fb build: argp-standalone, conditional build and build with gcc-5 35fdb73 api: versioned symbols in libgfapi.so for compatibility 8bc612d […] [Less]