View source for OneFS distributed file system

{{Short description|File system}}
{{Infobox Filesystem
| name = OneFS
| full_name = OneFS
| developer = [[Isilon Systems]]
| introduction_os = OneFS 1.0 -- based on [[FreeBSD]]
| introduction_date = {{Start date and age|2003}}
| partition_id = 
| directory_struct = [[B+ tree]]s
| file_struct = [[B+ tree]]s
| bad_blocks_struct = 
| max_filename_size = 255 [[byte]]s
| max_files_no = Cluster size dependent
| max_volume_size = 66PB+ (144+ nodes at 470TB+ each);<ref name="isilon810techspecs">{{cite web|url=https://support.emc.com/docu84267_Isilon-OneFS-8.1.0-and-IsilonSD-Edge:-Technical-Specifications-Guide.pdf | title=Isilon OneFS and IsilonSD Edge: Technical Specifications Guide|date=June 2018 | publisher = Dell Inc.}}</ref> 65535 nodes theoretical limit
| max_file_size = 16TB
| max_directory_depth = 509 (suggested, to fit within PATH_MAX of 1023)<ref name="isilon810techspecs"/>
| dates_recorded = Create time, rename time, [[MAC times|mtime, ctime, atime]]
| date_range = 1970 to 2038
| date_resolution = Nanosecond
| forks_streams = Yes (extended attributes and [[Alternate Data Streams]])
| attributes = 
| file_system_permissions = Yes ([[POSIX]] permissions and [[NTFS]] [[Access control list|ACLs]])
| compression = Yes<ref>{{cite web | url = https://www.storagereview.com/dell_emc_launches_allflash_isilon_f810 | title = Dell EMC Launches All-Flash Isilon F810 | date=12 February 2019 | publisher = Flying Pig Ventures | author = Adam Armstrong }}</ref>
| encryption = Integrated with Self-encrypting Drives for encryption of "''data at rest''"<ref name="h8202-onefs"/>
| data_deduplication = Offline only
| OS = OneFS
| filename_character_set = Many (UTF-8, EUC-JP, CP932, CP1252, ISO-8859-*, EUC-KR, CP949).  {{resize|75%|Encoding is per-directory entry, not per-filesystem.  So multiple encodings may be used in a single volume.  UTF-8 is encouraged as normative.  <code>NUL</code> and <code>/</code> are not allowed in individual directory entries in any encoding.}}
| copy_on_write = Yes (for snapshots)
}}
The '''OneFS File System''' is a [[distributed file system|parallel distributed networked file system]] designed by [[Isilon Systems]] and is the basis for the ''Isilon Scale-out Storage Platform''.<ref name="h8202-onefs"/>  The OneFS file system is controlled and managed by the '''OneFS Operating System''', a [[FreeBSD]] variant.<ref name="h8202-onefs"/>

== On-disk Structure ==
All data structures in the OneFS file system maintain their own protection information. This means in the same filesystem, one file may be protected at +1 (basic parity protection) while another may be protected at +4 (resilient to four failures) while yet another file may be protected at 2x ([[Disk mirroring|mirror]]ing); this feature is referred to as FlexProtect.<ref>[http://isilon.custhelp.com/ci/fattach/get/494/1313000035/redirect/1 "Data Protection and Backup"]{{dead link|date=April 2019}}</ref> FlexProtect is also responsible for automatically rebuilding the data in the event of a failure. The protection levels available are based on the number of nodes in the cluster and follow the [[Reed–Solomon error correction|Reed Solomon Algorithm]]. Blocks for an individual file are spread across the nodes. This allows entire nodes to fail without losing access to any data. File [[metadata]], directories, [[Snapshot (computer storage)|snapshot]] structures, [[Disk quota|quota]]s structures, and a logical [[inode]] mapping structure are all based on mirrored [[B+ tree]]s. Block addresses are generalized 64-bit [[pointer (computer programming)|pointer]]s that reference (node, drive, blknum) [[tuple]]s. The native block size is 8192 bytes; inodes are 512 bytes on disk (for disks with 512 byte sectors) or 8KB (for disks with 4KB sectors).

One distinctive characteristic of OneFS is that metadata is spread throughout the nodes in a homogeneous fashion.  There are no dedicated metadata servers. The only piece of metadata that is replicated on every node is the address list of root btree blocks of the inode mapping structure. Everything else can be found from that starting point, following the generalized 64-bit pointers.

== Clustering ==
The collection of computer hosts that comprise a OneFS System is referred to as a "''cluster''".
A computer host that is a member of a OneFS cluster is referred to as a "''node''" (plural "''nodes''").

The nodes that comprise a OneFS System must be connected by a high performance, low-latency back-end network for optimal performance. OneFS 1.0-3.0 used Gigabit Ethernet as that back-end network. Starting with OneFS 3.5, Isilon offered [[InfiniBand]] models. From about 2007 until mid-2018, all nodes sold utilized an InfiniBand back-end.  Starting with OneFS 8.1.0 and Gen6 models, Isilon again offers Ethernet back-end network (10, 25, 40, or 100 Gigabit).<ref name="emcworld2017">{{cite web | url = https://emcworldonline.com/2017/connect/fileDownload/session/8D604A7EAE5220ED0429D93D5057DEEE/storage57.Isilon-An_Insider_Peek_Info_OneFS_Enhancements.pdf | title = Isilon Gen6 Performance | publisher=Dell Inc.}}</ref>

Data, metadata, locking, transaction, group management, allocation, and event traffic are communicated using an [[Remote procedure call|RPC]] mechanism traveling over the back-end network of the OneFS cluster. All data and metadata transfers are [[zero-copy]]. All modification operations to on-disk structures are transactional and [[Journaling file system|journaled]].

== Protocols ==
OneFS supports accessing stored files using common computer network protocols including [[Network File System|NFS]], [[Server Message Block|CIFS/SMB]], [[File Transfer Protocol|FTP]], [[Hypertext Transfer Protocol|HTTP]], and [[HDFS]].<ref name="h8202-onefs"/> It can utilize non-local authentication such as [[Active Directory]], [[LDAP]], and [[Network Information Service|NIS]]. It is capable of interfacing with external backup devices and applications that use [[NDMP|NDMP protocol]].<ref name="h8202-onefs">{{cite web| url = https://www.dellemc.com/resources/en-us/asset/white-papers/products/storage/h8202-isilon-onefs-wp.pdf | publisher=Dell Inc.|date=February 2019 |title=Dell EMC Isilon OneFS Operating System - Powering the Isilon Scale-out Storage Platform | version=9.0}}</ref>

== OneFS Operating System ==
The OneFS File System is a proprietary file system that can only be managed and controlled by the [[FreeBSD|FreeBSD-derived]] OneFS Operating System.<ref name="h8202-onefs"/>

[[zsh]] is the default login shell of the OneFS Operating System.  OneFS presents a specialized command set to administer the OneFS File System.<ref>{{cite web| url=http://isilon.custhelp.com/ci/fattach/get/262/1303833600/redirect/1|title=OneFS Command Line Reference}}{{dead link|date=April 2019}}</ref>  Most specialized shell programs start with letters ''isi''.  Notable exceptions are the Isilon extensions to the FreeBSD [[Ls|<code>ls</code>]] and [[Chmod|<code>chmod</code>]] programs.<ref>{{cite web|url=http://www.emc.com/collateral/software/white-papers/h10920-wp-onefs-multiprotocol.pdf | title=Isilon OneFS Authentication, Identity Management, & Authorization - Multiprotocol Data Access with a Unified Security Model | publisher=Dell EMC | date=November 2018 |author=Aqib Kazi}}</ref>

== Versions ==

{{columns-start}}
* 1.0 "Bell," 2.0 "Jalapeno," 3.0 "Serrano," 3.5 "Tabasco"
* 4.0 "Poblano," 4.1 "Anaheim," 4.5 "Thai," 4.6 "Ancho"
* 4.7 "Chiltepin"
** 4.7.1 to .11
* 5.0 "Jamaican"
** 5.0.0 to .8
* 5.5 "Scotch Bonnet" (based on FreeBSD 6.1)<ref name="sysparam">Determined by the <code>__FreeBSD_version</code> [[C preprocessor|definition]] in <code>/usr/include/sys/param.h</code>. See ''FreeBSD Porter's Handbook'' for more information.</ref><ref name="prthdbook">{{cite book
 | url = https://www.freebsd.org/doc/en/books/porters-handbook/versions.html
 | chapter = 18
 | title = FreeBSD Porter's Handbook
 | author = The FreeBSD Documentation Project | access-date = 1 December 2011
}}</ref>
** 5.5.1 to .2
** 5.5.3 - OS updates with rolling reboots of individual nodes.
** 5.5.4 - Adds [[iSCSI]]
** 5.5.5 to .7
* 6.0 "Habanero" - Up to 10.4 PB in a single file system
** 6.0.1 to .4
* 6.5 "Chopu" (based on FreeBSD 7.3)<ref name="sysparam" />
** 6.5.1 to .5
* 7.0 "Mavericks" - released November 2012;<ref>{{cite web | url = http://bigdatablog.emc.com/2012/11/16/emc-isilon-onefs-7-0-converging-big-data-and-the-enterprise/ | title = EMC Isilon OneFS 7.0: Converging Big Data and The Enterprise | date = 16 November 2012 | access-date = 18 January 2013 | first = Mona | last = Patel | work = EMC Big Data Blog | archive-date = 12 February 2013 | archive-url = https://web.archive.org/web/20130212203504/http://bigdatablog.emc.com/2012/11/16/emc-isilon-onefs-7-0-converging-big-data-and-the-enterprise/ | url-status = dead }}</ref> (based on FreeBSD 7.4-STABLE)<ref name="sysparam" />
** 7.0.1 to .2
* 7.1 "Waikiki" - released October 2013<ref>{{cite web
 | url = http://pulseblog.emc.com/2013/10/30/the-wait-is-over-isilon-onefs-7-1-now-generally-available/
 | title = Isilon OneFS 7.1 Big Data Scale Out Storage Is Finally Here!
 | date = 30 October 2013 | access-date = 30 October 2013
 | first = Sam | last = Grocott | work = EMC Pulse Blog
}}</ref>
** 7.1.1 "Jaws" - released July 2014<ref>{{cite web
 | url = https://twitter.com/carolyn_hugs/status/486524819832188929
 | title = "Happy launch, @EMCIsilon! 2 fantastic new platforms, flash as cache, new HDFS, and performance galore on OneFS 7.1.1 "Jaws!" Way to go team!"
 | date = 8 July 2014 | access-date = 2 September 2014
 | first = Carolyn | last = Hughes | work = @carolyn_hugs Twitter
}}</ref>
* 7.2 "Moby" - released November 2014 <ref>{{cite web|url=https://www.dell.com/community/Isilon/OneFS-7-2-x-Release/td-p/7096370 |title=OneFS 7.2.x Release|publisher=Dell Inc. | date=31 October 2014 }}</ref>
** 7.2.0, 7.2.1 "Orca"
{{column}}
* 8.0 "Riptide" (based on FreeBSD 10) - released February 2016<ref>
{{cite web | url = http://isiblog.emc.com/2016/02/announcing-onefs-8-0-0/ | title = Announcing OneFS 8.0.0 | first = Risa | last = Galant | date = 1 February 2016 }}
</ref> - [[iSCSI]] deprecated
** 8.0.1 "Halfpipe" - released October 2016<ref>{{cite web | url = https://blog.dellemc.com/en-us/announcing-onefs-8-0-0/ | title = Announcing Isilon OneFS 8.0.1 | first = David | last = Noy | date = 25 October 2016 }}</ref>
* 8.1 "Freight Trains" - released June 2017<ref>{{cite web | url = https://blog.dellemc.com/en-us/dell-emc-announces-the-release-of-isilon-generation-6-platform-and-onefs-8-1/ | title = Dell EMC Announces the Release of Isilon Generation 6 Platform and OneFS 8.1 | first = Todd | last = Jolley | date = 21 June 2017 | publisher = Dell Inc.}}</ref>
** 8.1.1 "Niijima" - released January 2018<ref>
{{cite web | url = https://community.emc.com/community/products/isilon/blog/2018/01/29/onefs-8110-and-cloudera-cdh-514--support-for-cloudera-navigator | title = OneFS 8.1.1.0 and Cloudera CDH 5.13+ Support for Cloudera Navigator | first = Russ | last = Stevenson | date = 29 January 2018 }}
</ref><ref>
{{cite web | url = https://support.emc.com/docu87518_Isilon-OneFS-8.1.1-Release-Notes.pdf?language=en_US | title = Isilon OneFS Version 8.1.1 Release Notes | date = 1 January 2018 | publisher=Dell Inc. }}
</ref>
** 8.1.2 "Kanagawa" - Released August 2018<ref>{{cite web | url = https://community.emc.com/docs/DOC-67098 | title =OneFS 8.1.2 Documentation - Isilon Info Hub | date = 3 August 2018  | publisher = Dell Inc.}}</ref> 
** 8.1.3 "Seismic" - Released January 2019
* 8.2.0 "Pipeline" (based on FreeBSD 11) - Released May 2019<ref>{{cite web | url = https://support.emc.com/docu93613_Isilon-OneFS-8.2.0-Release-Notes.pdf?language=en_US | title = OneFS 8.2.0 Release Notes | date = 3 May 2019 | publisher = Dell Inc.}}</ref>
** 8.2.1 "Acela" - Released September 2019<ref>{{cite web | url = https://support.emc.com/ngoeSitecacheDocs/en_US/support_zone_content/product_documentation/release_notes/isilon_onefs_8-2-1_release_notes.pdf | title = OneFS 8.2.1 Release Notes | date = 6 September 2019 | publisher = Dell}}</ref>
** 8.2.2 "Beachcomber" - Released January 2020<ref>{{cite web | url = https://support.emc.com/ngoeSitecacheDocs/en_US/support_zone_content/product_documentation/release_notes/isilon_onefs_8-2-2_release_notes.pdf | title = OneFS 8.2.2 Release Notes | date = 16 January 2020 | publisher = Dell}}</ref>
* 9.0.0 "Cascades" - Released June 2020
** 9.1.0 "Deccan" - Released October 2020<ref>{{cite web | url = https://www.storagereview.com/news/dell-technologies-powerscale-onefs-9-1-released | title = Dell Technologies' PowerScale OneFS 9.1 Released | first = Juan | last = Mulford | date = 2020-10-08 | work = Storage Review }}</ref>
** 9.2.0 "Empire" - Released April 2021<ref name="onefsrelease">{{cite web | url = https://www.delltechnologies.com/asset/en-us/products/storage/industry-market/h18031-wp-powerscale-onefs-prior-release-contents.pdf.external | title = Dell PowerScale OneFS: Release Contents | date = January 2023 | first = Nick | last = Trimbee | publisher = Dell Inc. }}</ref>
** 9.2.1 "Flying Scotsman" - Released May 2021<ref name="onefsrelease" />
** 9.3 "Gotham" - Released October 2021<ref name="onefsrelease" />
** 9.4 "Hexie" - Released April 2022<ref name="onefsrelease" />
** 9.5 "Islander" - Released January 2023<ref name="onefsrelease" />
** 9.6 "Jet Rocket" - Released May 2023<ref name="onefs_jet_rocket">{{cite web | url = https://www.dell.com/support/manuals/en-us/isilon-onefs/ifs_pub_onefs_release_notes_9600/new-features?guid=guid-ddb4cc8e-70c4-4547-8815-d703c5536722&lang=en-us | title = PowerScale OneFS 9.6.x.x. Release Notes | date = May 2023 | publisher = Dell Inc. }}</ref>
** 9.7 "Key West" - Released December 2023<ref name="onefs_9_7">{{Cite web | url = https://infohub.delltechnologies.com/en-US/p/powerscale-onefs-9-7/ | date = 2023-12-13 | title = PowerScale OneFS 9.7 | first = Nick | last = Trimbee }}</ref>
** 9.8 - Released April 2024<ref name="onefsrelease" />
** 9.9 - Released August 2024<ref name="onefsrelease" />
** 9.10 - Released December 2024<ref name="onefsrelease" />
{{columns-end}}

== See also ==
* [[List of file systems]]
* [[Clustered file system]]

==References==
{{Reflist|2}}

== External links ==
* {{Official website|https://www.dellemc.com/en-us/storage/isilon/onefs-operating-system.htm}}

{{File systems}}

[[Category:Distributed file systems]]