View source for XQuery

{{short description|Functional programming and query language for XML}}

{{Infobox programming language
| name                   = XQuery
| paradigm               = [[Declarative programming|declarative]], [[Functional programming|functional]], [[Modular programming|modular]]
| year                   = 2007
| designer               = [[W3C]]
| latest_release_version = [http://www.w3.org/TR/xquery-31/ 3.1]
| latest_release_date    = {{Start date and age|2017|03|21}}<ref>{{cite web|url=http://www.w3.org/TR/xquery-31/ | title=XQuery 3.1 Recommendation | date=2017-03-21}}</ref>
| typing                 = [[dynamic typing|dynamic]] or static,<ref>{{cite web|url=https://www.w3.org/TR/xquery-31/#id-static-typing-feature | date=2017-03-21| title=XQuery 3.1: An XML Query Language}}</ref><ref>{{cite web|url=https://technet.microsoft.com/en-us/library/ms190938.aspx | title=XQuery and Static Typing| date=3 April 2023}}</ref> [[strong typing|strong]]
| implementations        = [http://www.w3.org/XML/Query#implementations Many]
| influenced_by          = [[XPath]], [[SQL]], [[XSLT]]
| operating_system       = [[Cross-platform]]
| website                = {{URL|http://www.w3.org/XML/Query/}}
| file_ext               = .xq, .xql, .xqm, .xqy, .xquery
| wikibooks              = XQuery
}}'''XQuery''' ('''XML Query''') is a [[query language]] and [[functional programming]] language designed to query and transform collections of structured and [[unstructured data]], primarily in the form of [[XML]]. It also supports text data and, through implementation-specific extensions, other formats like [[Binary data|binary]] and [[Relational model|relational data]].

The language was developed by the XML Query [[working group]] of the [[World Wide Web Consortium|W3C]], with version 1.0 becoming a [[W3C Recommendation]] in January 2007. XQuery development is closely coordinated with the development of [[XSLT]] by the XSL Working Group. Both groups jointly maintain [[XPath]], a shared component of XQuery and XSLT. XQuery extends XPath with features like FLWOR (For, Let, Where, Order by, Return) expressions, making it semantically similar to [[SQL]] but optimized for [[Hierarchical data|hierarchical]] rather than [[Relational model|relational data]].

XQuery 3.1, published in March 2017, added support for [[JSON]] and introduced [[Map (higher-order function)|maps]], [[Array data structure|arrays]], and additional [[Higher-order function|higher-order functions]], significantly expanding the language's capabilities for modern [[data processing]].

XQuery is implemented by many [[Database management system|database systems]], [[XML database|XML databases]], and XML processors, including [[BaseX]], [[eXist]], [[MarkLogic]], [[Saxon XSLT|Saxon]], and [[Berkeley DB XML]], making it a cornerstone technology for processing XML data in [[enterprise software]] applications.

==Features==
XQuery's mission is to:

{{Blockquote|text="provide flexible query facilities to extract data from real and virtual documents on the World Wide Web, therefore finally providing the needed interaction between the Web world and the database world. Ultimately, collections of XML files will be accessed like databases."<ref>{{cite web|url=http://lists.w3.org/Archives/Public/www-tag/2003Oct/0115.html|title=cited by J.Robie |last=W3C|date=2003-10-25}}</ref>}}

It is a functional, [[Side effect (computer science)|side effect-free]], expression-oriented programming language with a simple [[type system]], summed up by Kilpeläinen:<ref>{{Cite journal| doi = 10.1002/spe.1140| title = Using XQuery for problem solving| journal = Software: Practice and Experience| volume = 42| issue = 12| pages = 1433–1465| year = 2012| last1 = Kilpeläinen | first1 = Pekka| s2cid = 15561027| url = http://www.cs.uef.fi/~kilpelai/RDK11/refs/xqueryProblems.pdf}}</ref>

{{blockquote|All XQuery expressions operate on sequences, and evaluate to sequences. ''Sequences'' are ordered lists of items. ''Items'' can be either ''nodes'', which represent components of XML documents, or ''atomic values'', which are instances of XML Schema base types like {{mono|xs:integer}} or {{mono|xs:string}}. Sequences can also be empty, or consist of a single item only. No distinction is made between a single item and a singleton sequence. (...) XQuery/XPath sequences differ from lists in languages like [[Lisp (programming language)|Lisp]] and [[Prolog]] by excluding nested sequences. Designers of XQuery may have considered nested sequences unnecessary for the manipulation of document contents. Nesting, or hierarchy of document structures is instead represented by nodes and their child-parent relationships}}

XQuery provides the means to extract and manipulate data from XML documents or any data source that can be viewed as XML, such as [[relational database]]s<ref>[http://www-01.ibm.com/support/knowledgecenter/SSEPGG_10.5.0/com.ibm.db2.luw.xml.doc/doc/c0023907.html?lang=en "Data retrieval with XQuery"]. Retrieved on 18 January 2016.</ref> or office documents.

XQuery contains a superset of [[XPath]] expression syntax to address specific parts of an XML document. It supplements this with a [[SQL]]-like "[[FLWOR]] expression" for performing joins. A FLWOR expression is constructed from the five clauses after which it is named: FOR, LET, WHERE, ORDER BY, RETURN.

The language also provides syntax allowing new XML documents to be constructed. Where the element and attribute names are known in advance, an XML-like syntax can be used; in other cases, expressions referred to as dynamic node constructors are available. All these constructs are defined as expressions within the language, and can be arbitrarily nested.

The language is based on the [[XQuery and XPath Data Model]] (XDM) which uses a tree-structured model of the information content of an XML document, containing seven kinds of nodes: document nodes, elements, attributes, text nodes, comments, processing instructions, and namespaces.

XDM also models all values as sequences (a singleton value is considered to be a sequence of length one). The items in a sequence can either be XML nodes or atomic values. Atomic values may be integers, strings, Booleans, and so on: the full list of types is based on the primitive types defined in [[XML Schema (W3C)|XML Schema]].

Features for updating XML documents or databases, and [[full text search]] capability, are not part of the core language, but are defined in add-on extension standards: XQuery Update Facility 1.0 supports update feature and XQuery and XPath Full Text 1.0 supports full text search in XML documents.

XQuery 3.0 adds support for full functional programming, in that functions are values that can be manipulated (stored in variables, passed to higher-order functions, and dynamically called).

==Examples==
The sample XQuery code below lists the unique speakers in each act of Shakespeare's play Hamlet, encoded in [http://www.ibiblio.org/xml/examples/shakespeare/hamlet.xml hamlet.xml]

<!-- --[[User:Bcmoney|Bcmoney]] 20:23, 5 May 2007 (UTC) CITATION NEEDED for hamlet.xml -->
<syntaxhighlight lang="xquery">
 <html><body>
 {
   for $act in doc("hamlet.xml")//ACT
   let $speakers := distinct-values($act//SPEAKER)
   return
     <div>
       <h1>{ string($act/TITLE) }</h1>
       <ul>
       {
         for $speaker in $speakers
         return <li>{ $speaker }</li>
       }
       </ul>
     </div>
 }
 </body></html>
</syntaxhighlight>
All XQuery constructs for performing computations are [[Expression (programming)|expressions]].  There are no [[Statement (programming)|statements]], even though some of the keywords appear to suggest statement-like behaviors.  To execute a function, the expression within the body is evaluated and its value is returned.  Thus to write a function to double an input value, one simply writes:

<syntaxhighlight lang="xquery">
declare function local:doubler($x) { $x * 2 }
</syntaxhighlight>

To write a full query saying 'Hello World', one writes the expression:

<syntaxhighlight lang="xquery">
 "Hello World"
</syntaxhighlight>

This style is common in [[functional programming|functional programming languages]].

==Applications==
{{unreferenced section|date=May 2020}}
Below are a few examples of how XQuery can be used:
#Extracting information from a database for use in a web service.
#Generating summary reports on data stored in an XML database.
#Searching textual documents on the Web for relevant information and compiling the results.
#Selecting and transforming XML data to XHTML to be published on the Web.
#Pulling data from databases to be used for the application integration.
#Splitting up an XML document that represents multiple transactions into multiple XML documents.

==XQuery and XSLT compared==
{{more citations needed section|date=May 2020}}

===Scope===
Although XQuery was initially conceived as a query language for large collections of XML documents, it is also capable of transforming individual documents. As such, its capabilities overlap with [[XSLT]], which was designed expressly to allow input XML documents to be transformed into HTML or other formats.

The XSLT 2.0 and XQuery standards were developed by separate working groups within [[W3C]], working together to ensure a common approach where appropriate. They share the same data model ([[XQuery and XPath Data Model|XDM]]), type system, and function library, and both include [[XPath]] 2.0 as a sublanguage.

===Origin===
The two languages, however, are rooted in different traditions and serve the needs of different communities. XSLT was primarily conceived as a stylesheet language whose primary goal was to render XML for the human reader on screen, on [[the web]] (as [[web template|web template language]]), or on paper. XQuery was primarily conceived as a [[database query language]] in the tradition of [[SQL]].

Because the two languages originate in different communities, XSLT is stronger{{according to whom|date=May 2015}} in its handling of narrative documents with more flexible structure, while XQuery is stronger in its data handling (for example, when performing relational joins).

===Versions===
XSLT 1.0 appeared as a Recommendation in 1999, whereas XQuery 1.0 only became a Recommendation in early 2007; as a result, XSLT is still much more widely used. Both languages have similar expressive power, though XSLT 2.0 has many features that are missing from XQuery 1.0, such as grouping, number and date formatting, and greater control over XML namespaces.<ref name="Kay">{{cite web|url=https://www.mscs.mu.edu/~praveen/Teaching/fa05/AdvDb/PaperTeams/XSLT2XQTeam/Comparing%20XSLT%20and%20XQuery.htm|title=Comparing XSLT and XQuery|first=Michael|last=Kay|date=May 2005}}</ref><ref name="Eisenberg">{{cite web|url=http://www.xml.com/pub/a/2005/03/09/xquery-v-xslt.html|title=Comparing XSLT and XQuery|first=J. David|last=Eisenberg|date=2005-03-09}}</ref><ref name="Smith">{{cite web|url=http://www.xmlhack.com/read.php?item=1080|title=XQuery, XSLT "overlap" debated|date=2001-02-23|first=Michael|last=Smith}}</ref>  Many of these features were planned for XQuery 3.0.<ref name="XQuery11">{{cite web|url=http://www.w3.org/TR/xquery-30-requirements/|title=XQuery 3.0 requirements}}</ref>

Any comparison must take into account the version of XSLT. XSLT 1.0 and XSLT 2.0 are very different languages. XSLT 2.0, in particular, has been heavily influenced by XQuery in its move to strong typing and schema-awareness.

===Strengths and weaknesses===
Usability studies have shown that XQuery is easier to learn than [[XSLT]], especially for users with previous experience of database languages such as SQL.<ref>Usability of XML Query Languages. Joris Graaumans. SIKS Dissertation Series No 2005-16, {{ISBN|90-393-4065-X}}</ref> This can be attributed to the fact that XQuery is a smaller language with fewer concepts to learn, and to the fact that programs are more concise. It is also true that XQuery is more orthogonal, in that any expression can be used in any syntactic context. By contrast, XSLT is a two-language system in which XPath expressions can be nested in XSLT instructions but not vice versa.

XSLT is currently stronger than XQuery for applications that involve making small changes to
a document (for example, deleting all the NOTE elements). Such applications are generally handled
in XSLT by use of a coding pattern that involves an identity template that copies all nodes unchanged, modified by specific templates that modify selected nodes. XQuery has no equivalent to this coding pattern, though in future versions it will be possible to tackle such problems using the update facilities in the language that are under development.<ref name="XQueryUpdate">{{cite web|url=http://www.w3.org/TR/xqupdate/|title=XQuery Update Facility}}</ref>

XQuery 1.0 lacked any kind of mechanism for dynamic binding or polymorphism; this has been remedied with the introduction of functions as first-class values in XQuery 3.0. The absence of this capability starts to become noticeable when writing large applications, or when writing code that is designed to be reusable in different environments.{{Citation needed|date=May 2015}} XSLT offers two complementary mechanisms in this area: the dynamic matching of template rules, and the ability to override rules using <code>xsl:import</code>, that make it possible to write applications with multiple customization layers.

The absence of these facilities from XQuery 1.0 was a deliberate design decision: it has the consequence that XQuery is very amenable to static analysis, which is essential to achieve the level of optimization needed in database query languages. This also makes it easier to detect errors in XQuery code at compile time.

The fact that XSLT 2.0 uses [[XML]] syntax makes it rather verbose in comparison to XQuery 1.0. However, many large applications take advantage of this capability by using XSLT to read, write, or modify stylesheets dynamically as part of a processing pipeline. The use of XML syntax also enables the use of XML-based tools for managing XSLT code. By contrast, XQuery syntax is more suitable for embedding in traditional programming languages such as [[Java (programming language)|Java]] (see [[XQuery API for Java]]) or [[C Sharp (programming language)|C#]]. If necessary, XQuery code can also be expressed in an XML syntax called XQueryX. The XQueryX representation of XQuery code is rather verbose and not convenient for humans, but can easily be processed with XML tools, for example transformed with XSLT stylesheets.<ref name="XQueryX">{{cite web|url=http://www.w3.org/TR/xqueryx/|title=XML Syntax for XQuery (XQueryX)}}</ref><ref>{{cite web|url=http://saxonica.blogharbor.com/blog/_archives/2007/1/20/2665644.html|title=Saxon diaries: How not to fold constants|author=Michael Kay}}</ref>

==Versions and extensions==

=== Versions ===
* '''XQuery 1.0''' became a [[W3C Recommendation]] on January 23, 2007.<ref>{{cite web |date=2012-02-04 |title=XML and Semantic Web W3C Standards Timeline |url=http://www.dblab.ntua.gr/~bikakis/XML%20and%20Semantic%20Web%20W3C%20Standards%20Timeline-History.pdf}}</ref>
* '''XQuery 3.0''' became a [[W3C Recommendation]] on April 8, 2014.<ref>{{cite web |date=2014-04-08 |title=XQuery 3.0 Recommendation |url=http://www.w3.org/TR/xquery-30/}}</ref>
* '''XQuery 3.1''' became a [[W3C Recommendation]] on March 21, 2017.<ref>{{cite web |date=2017-03-21 |title=XQuery 3.1 Recommendation |url=http://www.w3.org/TR/xquery-31/}}</ref>

=== W3C extensions ===
The [[World Wide Web Consortium]] (W3C) developed two major extensions to XQuery:

* XQuery 1.0 and XPath 2.0 Full-Text,<ref>[http://www.w3.org/TR/xquery-full-text/ XQuery and XPath Full Text 1.0]</ref> which extends XQuery with full-text search capabilities
* [[XQuery Update Facility]], which enables data modification in XQuery

Both became [[W3C Recommendation|W3C Recommendations]] as extensions to XQuery 1.0. Efforts to adapt them for XQuery 3.0 were abandoned due to resource constraints.

A scripting (procedural) extension for XQuery was proposed but never completed.<ref>[http://www.w3.org/TR/xquery-sx-10-requirements/ XQuery Scripting Extension 1.0 Requirements]</ref><ref>[https://www.w3.org/TR/2017/PR-xquery-31-20170117/ XQuery 1.0 Scripting Extension]</ref>

The EXPath Community Group<ref>[http://www.w3.org/community/expath/ EXPath Community Group]</ref> develops extensions for XQuery and related standards ([[XPath]], [[XSLT]], [[XProc]], and [[XForms]]). The following extensions are available:

* '''Packaging System''',<ref>[http://expath.org/spec/pkg/20120509 Packaging System]</ref> for managing XQuery libraries and modules.
* '''File Module''',<ref>[http://expath.org/spec/file/20120614 File Module]</ref> for file system operations.
* '''Binary Module''',<ref>[http://expath.org/spec/binary/20130312 Binary Module]</ref> for handling binary data.
* '''Web Applications''',<ref>[http://expath.org/spec/webapp/20130401 Web Applications]</ref> for building web-based applications

===Third-party extensions===
[[JSONiq]] is an extension of XQuery that adds support to extract and transform data from [[JSON]] documents. JSONiq is a superset of XQuery 3.0. 
It is published under the [[Creative Commons license|Creative Commons Attribution-ShareAlike 3.0]] license.

XQuery 3.1 de facto deprecates JSONiq as it has added full support for JSON.

The EXQuery<ref>{{cite web|title=Standard for portable XQuery applications|url=http://www.exquery.org/|access-date=12 December 2013}}</ref> project develops standards around creating portable XQuery applications. The following standards are currently available:
* RESTXQ<ref>{{Cite web|url=https://exquery.github.io/exquery/exquery-restxq-specification/restxq-1.0-specification.html|title = RESTXQ 1.0: RESTful Annotations for XQuery}}</ref>

==Further reading==
* Querying XML: XQuery, XPath, and SQL/XML in context. Jim Melton and Stephen Buxton. Morgan Kaufmann, 2006. {{ISBN|1-55860-711-0}}.
* {{cite book | last=Walmsley | first=Priscilla | date=2007 | title=XQuery, 1st Edition | publisher=O'Reilly Media | isbn=978-0-596-00634-1 }}
* {{cite book | last=Walmsley | first=Priscilla | date=2015 | title=XQuery, 2nd Edition | publisher=O'Reilly Media | isbn=978-1-4919-1510-3 }}
* XQuery: The XML Query Language. Michael Brundage. Addison-Wesley Professional, 2004. {{ISBN|0-321-16581-0}}.
* XQuery from the Experts: A Guide to the W3C XML Query Language. Howard Katz (ed). Addison-Wesley, 2004. {{ISBN|0-321-18060-7}}.
* An Introduction to the [http://www.stylusstudio.com/xquery_flwor.html XQuery FLWOR] Expression. Dr. [[Michael Howard Kay|Michael Kay]] (W3C XQuery Committee), 2005.

==Implementations==

{| class="wikitable sortable"
|+Overview of popular XQuery implementations
|-
!scope="col"| Name
!scope="col"| License
!scope="col"| Language
!scope="col"| XQuery 3.1
!scope="col"| XQuery 3.0
!scope="col"| XQuery 1.0
!scope="col"| XQuery Update 1.0
!scope="col"| XQuery Full Text 1.0
|-
!scope="row"| [[BaseX]]
| [[BSD license]]
| Java
| {{Yes}} || {{Yes}} || {{Yes}} || {{Yes}} || {{Yes}}
|-
!scope="row"|  [[eXist]]
| [[LGPL]]
| Java
| {{Partial}} || {{Partial}} || {{Yes}} || {{No}} || {{No}}
|-
!scope="row"|  [[MarkLogic]]
| Proprietary
| C++
| {{No}} || {{Partial}} || {{Yes}} || {{No}} || {{No}}
|-
!scope="row"|  [[Saxon XSLT|Saxon]] HE
| [[Mozilla Public License]]
| Java
| {{Partial}} || {{Partial}} || {{Yes}} || {{Yes}} || {{No}}
|-
!scope="row"|  [[Saxon XSLT|Saxon]] EE
| Proprietary
| Java
| {{Yes}} || {{Yes}} || {{Yes}} || {{Yes}} || {{No}}
|-
!scope="row"|  [[Xidel]]
| [[GPLv3+]]
| FreePascal
| {{Yes}} || {{Yes}} || {{Yes}} || {{No}} || {{No}}
|-
!scope="row"|  [[Zorba (XQuery processor)|Zorba]]
| [[Apache License]]
| C++
| {{No}} || {{Yes}} || {{Yes}} || {{Yes}} || {{Yes}}
|}

{{see also|Category:XQuery processors}}

==See also==
* [[XQuery API for Java]] (XQJ) [[Java Specification Request]]

==References==
{{Reflist|2}}
*''Portions borrowed with permission from the books "XML Hacks" ([[O'Reilly Media]]) and  "XQuery" ([[O'Reilly Media]]).''
*''Previous version based on an article at the [[:fr:XML Query|French language Wikipedia]]''

==External links==
{{Wikibooks|XQuery}}
* [http://www.w3.org/XML/Query W3C XML Query (XQuery)]

{{W3C Standards}}
{{Query languages}}

{{Authority control}}

{{DEFAULTSORT:Xquery}}
[[Category:Fourth-generation programming languages]]
[[Category:Functional languages]]
[[Category:Query languages]]
[[Category:World Wide Web Consortium standards]]
[[Category:XML data access]]