Comparison of cluster software

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search

Template:Short description The following tables compare general and technical information for notable computer cluster software. This software can be grossly separated in four categories: Job scheduler, nodes management, nodes installation and integrated stack (all the above).

General information

Template:Sort-under

Software Maintainer Category Development status Latest release ArchitectureOCS High-Performance / High-Throughput Computing License Platforms supported Cost Template:Verth
Template:Rh | Amoeba No active development Template:Open source
Template:Rh | Base One Foundation Component Library Proprietary
Template:Rh class="table-rh" | DIET INRIA, SysFera, Open Source All in one GridRPC, SPMD, Hierarchical and distributed architecture, CORBA HTC/HPC Template:Open source Unix-like, Mac OS X, AIX Free
Template:Rh | DxEnterprise DH2i Nodes management Actively developed v23.0 Proprietary Windows 2012R2/2016/2019/2022 and 8+, RHEL 7/8/9, CentOS 7, Ubuntu 16.04/18.04/20.04/22.04, SLES 15.4 Cost Yes
Template:Rh class="table-rh" | Enduro/X Mavimax, Ltd. Job/Data Scheduler Actively developed SOA Grid HTC/HPC/HA GPLv2 or Commercial Linux, FreeBSD, MacOS, Solaris, AIX Free / Cost Yes
Template:Rh class="table-rh" | Ganglia Monitoring Actively developed Template:Wikidata Template:Wikidata; Script error: No such module "Time ago". (Template:Wikidata)Script error: No such module "Check for unknown parameters". Template:BSD-lic Unix, Linux, Microsoft Windows NT/XP/2000/2003/2008, FreeBSD, NetBSD, OpenBSD, DragonflyBSD, Mac OS X, Solaris, AIX, IRIX, Tru64, HPUX. Free
Template:Rh | Grid MP Univa (formerly United Devices) Job Scheduler No active development Distributed master/worker HTC/HPC Proprietary Windows, Linux, Mac OS X, Solaris Cost
Template:Rh class="table-rh" | Apache Mesos Apache Actively developed Template:Open source Linux Free Yes
Template:Rh class="table-rh" | Moab Cluster Suite Adaptive Computing Job Scheduler Actively developed HPC Proprietary Linux, Mac OS X, Windows, AIX, OSF/Tru-64, Solaris, HP-UX, IRIX, FreeBSD & other UNIX platforms Cost Yes
Template:Rh class="table-rh" | NetworkComputer Runtime Design Automation Actively developed HTC/HPC Proprietary Unix-like, Windows Cost
Template:Rh class="table-rh" | OpenHPC OpenHPC project all in one Actively developed v2.61 February 2, 2023; Script error: No such module "Time ago". (2023-02-02)Script error: No such module "Check for unknown parameters". HPC Linux (CentOS / OpenSUSE Leap) Free No
Template:Rh class="table-rh" | OpenLava Template:CNone Formerly Teraproc Job Scheduler Halted by injunction Master/Worker, multiple admin/submit nodes HTC/HPC Illegal due to being a pirated version of IBM Spectrum LSF Linux Not legally available No
Template:Rh class="table-rh" | PBS Pro Altair Job Scheduler Actively developed Master/worker distributed with fail-over HPC/HTC AGPL or Proprietary Linux, Windows Free or Cost Yes
Template:Rh class="table-rh" | Proxmox Virtual Environment Proxmox Server Solutions Complete Actively developed Template:Open source Linux, Windows, other operating systems are known to work and are community supported Free Yes
Template:Rh | Rocks Cluster Distribution Open Source/NSF grant All in one Actively developed Template:Wikidata (Manzanita) Template:Wikidata; Script error: No such module "Time ago". (Template:Wikidata)Script error: No such module "Check for unknown parameters". HTC/HPC Template:Open source CentOS Free
Template:Rh | Popular Power
Template:Rh | ProActive INRIA, ActiveEon, Open Source All in one Actively developed Master/Worker, SPMD, Distributed Component Model, Skeletons HTC/HPC GNU GPL Unix-like, Windows, Mac OS X Free
Template:Rh | RPyC Tomer Filiba Actively developed Template:Open source *nix/Windows Free
Template:Rh | SLURM SchedMD Job Scheduler Actively developed v23.11.3 January 24, 2024; Script error: No such module "Time ago". (2024-01-24)Script error: No such module "Check for unknown parameters". HPC/HTC GNU GPL Linux/*nix Free Yes
Template:Rh class="table-rh" | Spectrum LSF IBM Job Scheduler Actively developed Master node with failover/exec clients, multiple admin/submit nodes, Suite addOns HPC/HTC Proprietary Unix, Linux, Windows Cost and Academic - model - Academic, Express, Standard, Advanced and Suites Yes
Template:Rh | Oracle Grid Engine (Sun Grid Engine, SGE) Altair Job Scheduler active Development moved to Altair Grid Engine Master node/exec clients, multiple admin/submit nodes HPC/HTC Proprietary *nix/Windows Cost
Template:Rh | Some Grid Engine / Son of Grid Engine / Sun Grid Engine daimh Job Scheduler Actively developed (stable/maintenance) Master node/exec clients, multiple admin/submit nodes HPC/HTC Template:Open source *nix Free No
Template:Rh | SynfiniWay Fujitsu Actively developed HPC/HTC ? Unix, Linux, Windows Cost
Template:Rh class="table-rh" | Techila Distributed Computing Engine Techila Technologies Ltd. All in one Actively developed Master/worker distributed HTC Proprietary Linux, Windows Cost Yes
Template:Rh | TORQUE Resource Manager Adaptive Computing Job Scheduler Actively developed Proprietary Linux, *nix Cost Yes
Template:Rh | TrinityX ClusterVision All in one Actively developed v15 February 27, 2025; Script error: No such module "Time ago". (2025-02-27)Script error: No such module "Check for unknown parameters". HPC/HTC GNU GPL v3 Linux/*nix Free Yes
Template:Rh class="table-rh" | UniCluster Univa All in One Functionality and development moved to UniCloud (see above) Free Yes
Template:Rh | UNICORE
Template:Rh | Xgrid Apple Computer
Template:Rh | Warewulf Provision and clusters management Actively developed v4.4.1 July 6, 2023; Script error: No such module "Time ago". (2023-07-06)Script error: No such module "Check for unknown parameters". HPC Template:Open source Linux Free
Template:Rh | xCAT Provision and clusters management Actively developed v2.16.5 March 7, 2023; Script error: No such module "Time ago". (2023-03-07)Script error: No such module "Check for unknown parameters". HPC Eclipse Public License Linux Free
Software Maintainer Category Development status Latest release Architecture High-Performance/ High-Throughput Computing License Platforms supported Cost Template:Verth

Table explanation

  • Software: The name of the application that is described

Technical information

Template:Sort-under

Software Implementation Language Authentication Encryption Integrity Global File System Global File System + Kerberos Heterogeneous/ Homogeneous exec node Jobs priority Group priority Queue type SMP aware Max exec node Max job submitted CPU scavenging Parallel job Job checkpointing Template:Verth
Template:Rh class="table-rh" | Enduro/X C/C++ OS Authentication GPG, AES-128, SHA1 Template:CNone Any cluster Posix FS (gfs, gpfs, ocfs, etc.) Any cluster Posix FS (gfs, gpfs, ocfs, etc.) Heterogeneous OS Nice level OS Nice level SOA Queues, FIFO Yes OS Limits OS Limits Yes Yes No No
Template:Rh class="table-rh" | HTCondor C++ GSI, SSL, Kerberos, Password, File System, Remote File System, Windows, Claim To Be, Anonymous None, Triple DES, BLOWFISH None, MD5 None, NFS, AFS Template:Unofficial Heterogeneous Yes Yes Fair-share with some programmability basic (hard separation into different node) tested ~10000? tested ~100000? Yes MPI, OpenMP, PVM Yes Yes[1]
Template:Rh class="table-rh" | PBS Pro C/Python OS Authentication, Munge Any, e.g., NFS, Lustre, GPFS, AFS Limited availability Heterogeneous Yes Yes Fully configurable Yes tested ~50,000 Millions Yes MPI, OpenMP Yes Yes[2]
Template:Rh class="table-rh" | OpenLava C/C++ OS authentication Template:CNone NFS Heterogeneous Linux Yes Yes Configurable Yes Yes, supports preemption based on priority Yes Yes No
Template:Rh class="table-rh" | Slurm C Munge, None, Kerberos Heterogeneous Yes Yes Multifactor Fair-share Yes tested 120k tested 100k No Yes Yes Yes[3]
Template:Rh class="table-rh" | Spectrum LSF C/C++ Multiple - OS Authentication/Kerberos Optional Optional Any - GPFS/Spectrum Scale, NFS, SMB Any - GPFS/Spectrum Scale, NFS, SMB Heterogeneous - HW and OS agnostic (AIX, Linux or Windows) Policy based - no queue to computenode binding Policy based - no queue to computegroup binding Batch, interactive, checkpointing, parallel and combinations Yes and GPU aware (GPU License free) > 9.000 compute hots > 4 mio jobs a day Yes, supports preemption based on priority, supports checkpointing/resume Yes, fx parallel submissions for job collaboration over fx MPI Yes, with support for user, kernel or library level checkpointing environments Yes[4]
Template:Rh | Torque C SSH, munge None, any Heterogeneous Yes Yes Programmable Yes tested tested Yes Yes Yes Yes[5]
Software Implementation Language Authentication Encryption Integrity Global File System Global File System + Kerberos Heterogeneous/ Homogeneous exec node Jobs priority Group priority Queue type SMP aware Max exec node Max job submitted CPU scavenging Parallel job Job checkpointing Template:Verth

Table Explanation

  • Software: The name of the application that is described
  • SMP aware:
    • basic: hard split into multiple virtual host
    • basic+: hard split into multiple virtual host with some minimal/incomplete communication between virtual host on the same computer
    • dynamic: split the resource of the computer (CPU/Ram) on demand

See also

References

<templatestyles src="Reflist/styles.css" />

  1. ↑ https://github.com/dasayan05/condor, and native Python Binding
  2. ↑ https://github.com/prisms-center/pbs
  3. ↑ PySlurm
  4. ↑ https://github.com/IBMSpectrumComputing/lsf-python-api
  5. ↑ https://github.com/jkitchin/python-torque

Script error: No such module "Check for unknown parameters".

Retrieved from "http://debianws.lexgopc.com/wiki143/index.php?title=Comparison_of_cluster_software&oldid=6864719"