View source for Oracle Grid Engine

{{short description|Batch-queuing system for computer clusters}}
{{Redirect|Grid Engine|the latter proprietary version|Univa Grid Engine}}
{{Multiple issues|
{{update|date=October 2013}}
{{Lead rewrite|date=March 2021}}
}}
{{Infobox software
| name                   = Oracle Grid Engine
| logo                   = [[Image:GridEngine.png|middle|GridEngine Logo]]
| developer              = [[Oracle Corporation]] (formerly [[Sun Microsystems]]) in association with the community
| latest release version = 6.2u8; see the information on forks in the first section for sources for recent versions of the technology
| latest release date    = {{start date|2012|10|01}}
| latest preview version =
| latest preview date    =
| operating system       = [[Cross-platform]]
| genre                  = [[Grid computing]]
| license                = [[Sun Industry Standards Source License|SISSL]]
| website                = {{URL|http://www.oracle.com/technetwork/oem/grid-engine-166852.html}}
}}
'''Oracle Grid Engine''',<ref>{{cite web|url=http://www.sun.com/software/sge/|title=Oracle Grid Engine|date=2010-05-30|publisher=Oracle Corporation}}</ref> previously known as '''Sun Grid Engine''' ('''SGE'''), '''CODINE''' ('''Computing in Distributed Networked Environments''') or '''GRD''' ('''Global Resource Director'''),<ref>{{cite web|url=http://blogs.sun.com/templedf/entry/a_little_history_lesson|title=A Little History Lesson|date=2006-06-23|publisher=Sun Microsystems}}</ref> was a [[grid computing]] [[computer cluster]] software system (otherwise known as a [[batch-queuing system]]), acquired as part of a purchase of Gridware,<ref>{{cite web |url=https://www.cnet.com/news/sun-snaps-up-software-company-gridware/ |title = Sun snaps up software company Gridware - CNET}}</ref> then improved and supported by [[Sun Microsystems]] and later [[Oracle Corporation|Oracle]]. There have been open source versions and multiple commercial versions of this technology, initially from Sun, later from Oracle, then from [[Univa]] Corporation, and later from [[HPC Gridware]] as Gridware Cluster Scheduler. The open source version is still under active development under the [[SISSL]] license as Open Cluster Scheduler.<ref>{{cite web|title=Open Cluster Scheduler Github Repository|url=https://github.com/hpc-gridware/clusterscheduler| date=2024-12-01| access-date=December 1, 2024}}</ref>

On October 22, 2013 Univa announced it acquired the [[intellectual property]] and trademarks for the Grid Engine technology and that Univa will take over support.<ref>{{cite web|url=http://www.univa.com/about/news/press_2013/10222013.php|title=Univa Completes Acquisition of Grid Engine Assets, Becoming the Sole Commercial Provider of Grid Engine Software|date=2013-10-22|publisher=Univa Corporation}}</ref> Univa has since evolved the Grid Engine technology, e.g. improving scalability as demonstrated by a 1 million core cluster in [[Amazon Web Services]] (AWS) announced on June 24, 2018.<ref>{{cite web | url=https://blogs.univa.com/2018/06/univa-demonstrates-extreme-scale-automation-by-deploying-more-than-one-million-cores-in-a-single-univa-grid-engine-cluster-using-aws/ | title=Univa Demonstrates Extreme Scale Automation by Deploying More Than One Million Cores in a Single Univa Grid Engine Cluster using AWS | publisher=Univa | date=2018-06-24 | access-date=June 24, 2018}}</ref>

The original Grid Engine open-source project website closed in 2010, but versions of the technology are still available under its original [[Sun Industry Standards Source License]] (SISSL).<ref>{{cite web|url=http://arc.liv.ac.uk/repos/darcs/sge/LICENCES/SISSL|title=The Grid Engine Source License|date=2010-06-04|publisher=Sun MicroSystems|access-date=2013-10-23|archive-url=https://web.archive.org/web/20131112013604/http://arc.liv.ac.uk/repos/darcs/sge/LICENCES/SISSL|archive-date=2013-11-12|url-status=dead}}</ref> Those projects were forked from the original project code and are known as Son of Grid Engine,<ref name=son>{{cite web|url=https://arc.liv.ac.uk/trac/SGE|archive-url=https://web.archive.org/web/20210826220245/https://arc.liv.ac.uk/trac/SGE|archive-date=26 August 2021|title=Son of Grid Engine|publisher=University of Liverpool}}</ref> Open Grid Scheduler,<ref>{{cite web|url=http://gridscheduler.sourceforge.net/|title=Open Grid Scheduler|publisher=The Open Grid Scheduler Community}}</ref> [[Univa Grid Engine]].,<ref>{{cite web|url=https://github.com/gridengine/gridengine/|title=Univa Grid Engine|publisher=Univa}}</ref> Open Cluster Scheduler, and Gridware Cluster Scheduler.

Grid Engine is typically used on a computer farm or [[high-performance computing]] (HPC) [[cluster (computing)|cluster]] and is responsible for accepting, scheduling, dispatching, and managing the remote and distributed execution of large numbers of standalone, parallel or interactive user jobs.  It also manages and schedules the allocation of distributed resources such as processors, memory, disk space, and [[software license]]s.

Grid Engine used to be the foundation of the [[Sun Grid]] [[utility computing]] system, made available over the [[Internet]] in the [[United States]] in 2006,<ref>{{cite web|url=http://www.sun.com/smi/Press/sunflash/2006-03/sunflash.20060322.1.xml|title=World's First Utility Grid Comes Alive on the Internet|date=2006-03-22|publisher=Sun Microsystems}}</ref> later becoming available in many other countries and having been an early version of a public [[cloud computing]] facility predating AWS, for instance.

==History==
In 2000, Sun acquired Gridware a privately owned commercial vendor of advanced computing resource management software with offices in San Jose, Calif., and Regensburg, Germany.<ref>{{cite web|date=2000-07-24|title=Gridware's resource management software increases efficiency and productivity in compute-intensive technical computing environments|url=http://www.sun.com/smi/Press/sunflash/2000-07/sunflash.20000724.3.xml|publisher=Sun Microsystems}}</ref>  Later that year, Sun offered a free version of Gridware for Solaris and Linux, and renamed the product Sun Grid Engine.

In 2001, Sun made the [[source code]] available,<ref>{{cite web|date=2001-07-23|title=Sun Microsystems makes SUN GRID ENGINE software available to open source community|url=http://www.sun.com/smi/Press/sunflash/2001-07/sunflash.20010723.1.xml|publisher=Sun Microsystems}}</ref> and adopted the open source development model. Ports for Mac OS X and *BSD were contributed by the non-Sun open source developers.<ref>{{cite web|date=2010-05-14|title=Porting HPC Tools to FreeBSD|url=http://www.bsdcan.org/2010/schedule/events/169.en.html}}</ref>

In 2010, after the purchase of Sun by Oracle, the Grid Engine 6.2 update 6 source code was not included with the binaries, and changes were not put back to the project's source repository.<ref>{{Cite web|last=Eadline|first=Douglas|title=Grid Engine: Running on All Four Cylinders » ADMIN Magazine|url=http://www.admin-magazine.com/HPC/Articles/Grid-Engine-Running-on-All-Four-Cylinders|access-date=2021-03-05|website=ADMIN Magazine|language=en-US}}</ref> In response to this, the Grid Engine community started the Open Grid Scheduler project to continue to develop and maintain a free implementation of Grid Engine.<ref>[http://sourceforge.net/projects/gridscheduler/ Open Grid Scheduler]</ref><ref>{{cite web|last=Eadline, Ph.D.|first=Douglas|date=September 1, 2010|title=The State of Oracle/Sun Grid Engine|url=http://www.linux-mag.com/id/7850|archive-url=https://web.archive.org/web/20100904040116/http://www.linux-mag.com/id/7850|url-status=usurped|archive-date=September 4, 2010|access-date=2011-01-18|publisher=Linux Magazine}}</ref><ref>{{cite web|last=Templeton|first=Daniel|date=2010-12-23|title=Changes for a Bright Future at Oracle|url=http://markmail.org/message/hcxond5s4cywe5dv|access-date=2011-01-19}}</ref>

On January 18, 2011, it was announced that [[Univa]] had recruited several principal engineers from the former Sun Grid Engine team and that Univa would be developing their own [[Fork (software development)|forked]] version of Grid Engine.  The newly announced [[Univa Grid Engine]] did include commercial support and would compete with the official version of Oracle Grid Engine.<ref>{{cite press release|url=http://www.univa.com/about/news/press_2011/01172011.php|title=Univa Acquires Grid Engine Expertise|date=2011-01-18|publisher=Univa|access-date=2011-01-18|archive-url=https://web.archive.org/web/20110121055558/http://univa.com/about/news/press_2011/01172011.php|archive-date=2011-01-21|url-status=dead}}</ref><ref>{{cite web|last=Feldman|first=Michael|date=2011-01-18|title=Univa Rescues Grid Engine From Oracle|url=http://www.hpcwire.com/features/Univa-Rescues-Grid-Engine-From-Oracle-114140804.html|url-status=dead|archive-url=https://web.archive.org/web/20110124052006/http://www.hpcwire.com/features/Univa-Rescues-Grid-Engine-From-Oracle-114140804.html|archive-date=2011-01-24|access-date=2011-01-18|publisher=HPCwire}}</ref><ref>{{cite web|last=Morgan|first=Timothy Prickett|date=2011-01-18|title=Univa forks Oracle's Sun Grid Engine|url=https://www.theregister.co.uk/2011/01/18/univa_forks_oracle_grid_engine/|access-date=2011-01-18|publisher=The Register}}</ref>

On October 22, 2013 Univa has announced that it had acquired the [[intellectual property]] and trademarks pertaining to the Grid Engine technology and that Univa will take over support for Oracle Grid Engine customers.<ref>{{cite web|date=2013-10-22|title=Univa Completes Acquisition of Grid Engine Assets, Becoming the Sole Commercial Provider of Grid Engine Software|url=http://www.univa.com/about/news/press_2013/10222013.php|publisher=Univa Corporation}}</ref>

In September 2020, [[Altair Engineering]], a global technology company providing solutions in data analytics, product development, and high-performance computing (HPC) acquired Univa.<ref>{{cite web|date=September 14, 2020|title=Altair Acquires Univa|url=https://atc2020.virtual.altair.com/}}</ref>

2023 the lead developers of Sun Grid Engine, Oracle Grid Engine, Univa Grid Engine and successor decided to build
[[Gridware Cluster Scheduler]](GCS) based on their open source Open Cluster Scheduler which is 100% "SGE" backward compatible.<ref>{{cite web|title=HPC Gridware Github Repository|url=https://github.com/hpc-gridware| date=2024-12-01| access-date=December 1, 2024}}</ref>

== Cluster architecture ==
[[Image:Xml-qstat.jpg|thumb|290px|A screenshot of the xml-qstat web interface in 2007]]
A typical Grid Engine cluster consists of a master host and one or more execution hosts. Multiple ''shadow masters'' can also be configured as [[hot spare]]s, which take over the role of the master when the original master host crashes.<ref>{{Cite web |title= How to Install the Shadow Master Host |url= http://wikis.sun.com/display/gridengine62u3/How+to+Install+the+Shadow+Master+Host |work= Sun Grid Engine 6.2u3 blog |date= August 27, 2009 |access-date= October 6, 2011 |archive-url= https://web.archive.org/web/20111002183423/http://wikis.sun.com/display/gridengine62u3/How+to+Install+the+Shadow+Master+Host |archive-date= October 2, 2011 |url-status= dead }}</ref>

==Support and training==
[[Univa]] is providing commercial support and training for [[Univa Grid Engine]] and Oracle Grid Engine. Below is a description of some of the historic options.

Sun provided support contracts 
for the commercial version of Grid Engine on most [[UNIX]] platforms and [[Microsoft Windows|Windows]].<ref>{{cite web | url = http://store.sun.com/CMTemplate/CEServlet?process=SunStore&cmdViewProduct_CP&catid=115672 | title = Sun Store Grid Engine Entitlement Purchase | access-date = 2008-03-03 | publisher = Sun Microsystems |archive-url = https://web.archive.org/web/20061113110525/http://store.sun.com/CMTemplate/CEServlet?process=SunStore&cmdViewProduct_CP&catid=115672 <!-- Bot retrieved archive --> |archive-date = 2006-11-13}}</ref> Professional services, consulting, training, and support were provided by Sun Partners.<ref>{{cite web | url = http://www.sun.com/software/gridware/partners/index.xml | title = Sun Grid Engine 6 Partners | access-date = 2007-12-14 | publisher = Sun Microsystems }}</ref> Sun partners with [[Georgetown University]] to deliver Grid Engine administration classes.<ref>{{cite web | url = http://blogs.sun.com/templedf/entry/advanced_sun_grid_engine_configuration | title = Advanced Sun Grid Engine Configuration and Administration Class | access-date = 2007-12-14 | publisher = Sun Microsystems }}</ref> ''The Bioteam'' runs short SGE training workshops that are 1 or 2 days long.<ref>{{cite web | url = http://blog.bioteam.net/category/training/ | title = Training | access-date = 2008-03-24 | publisher = The Bioteam Inc.}}</ref>

Users obtained community support on the Grid Engine mailing lists.<ref>{{cite web | url = http://gridengine.sunsource.net/maillist.html |url-status= dead |title = Grid Engine Mail Lists |publisher = Sun Microsystems |archive-date= December 25, 2008 |archive-url= https://web.archive.org/web/20081225034600/http://gridengine.sunsource.net/maillist.html |access-date= October 6, 2011 }}</ref>
Grid Engine Workshops were held in 2002, 2003, 2007, 2009, and 2012 in [[Regensburg, Germany]].<ref>{{cite web | url = http://gridengine.sunsource.net/workshop.html |url-status= dead |title = Grid Engine Workshops |publisher = Sun Microsystems |archive-date= March 8, 2009 |archive-url= https://web.archive.org/web/20090308083532/http://gridengine.sunsource.net/workshop.html |access-date= October 6, 2011 }}</ref>

==Other Grid Engine based products==

The below contains historic information and some of the products and solutions are no longer available:

* [[Sun Constellation System]]
* [[Sun Visualization System]]
* Sun Compute Cluster<ref>{{cite web|url=http://www.sun.com/servers/hpc/computecluster/index.jsp|title=Sun Compute Cluster Solution|publisher=Sun Microsystems}}</ref>
* ClusterVisionOS Distribution
* [[Rocks Cluster Distribution]]
* [[Univa]]'s [[UniCluster Express]]
* [[Univa Grid Engine]] 
* Some Grid Engine<ref>{{cite web|url=https://github.com/daimh/sge|title=Some Grid Engine|publisher=Michigan Neuroscience Institute, University of Michigan}}</ref> {{En dash}} active free fork of SGE with "some" further modifications, Michigan Neuroscience Institute, University of Michigan (2021).
* Son of Grid Engine<ref name=son /> {{En dash}} inactive free fork of SGE with some enhancements, University of Liverpool, default Ubuntu/CentOS/RHEL gridengine package (2021).
* Open Cluster Scheduler<ref>{{cite web|url=https://github.com/hpc-gridware/clusterscheduler|title=Open Cluster Scheduler|publisher=
HPC-Gridware GmbH}}</ref> {{En dash}} active free fork based on the Univa Open Core Grid Engine, which in turn is based on the open source Sun Grid Engine (2025).
* BioTeam's iNquiry
* [[Nimbus (cloud computing)|Nimbus]] {{En dash}} uses Grid Engine as a virtual machine scheduler in a cloud computing environment

==See also==
{{Portal|Free and open-source software}}
*[[Sun Ops Center]] - Sun's datacenter automation tool
*[[Open Grid Forum]]

==References==
{{Reflist|30em}}{{Sun Microsystems}}
{{Oracle FOSS}}

[[Category:Sun Microsystems software]]
[[Category:Job scheduling]]
[[Category:Parallel computing]]
[[Category:Grid computing]]
[[Category:Cross-platform software]]
[[Category:Cluster computing]]
[[Category:2000 software]]