|
|
| (3 intermediate revisions by 3 users not shown) |
| Line 1: |
Line 1: |
| {{Short description|Software library designed for use in multiple programs}} | | {{Short description |Software library in memory that multiple executables can use at runtime}} |
| {{Cleanup split|Library (computing)|date=February 2025}}
| |
| {{More citations needed|date=July 2023}}
| |
| {{redirect|Shared object|the synchronization mechanism|Monitor (synchronization)}} | | {{redirect|Shared object|the synchronization mechanism|Monitor (synchronization)}} |
|
| |
|
| A '''shared library''' is a [[library (computing)|library]] that contains [[executable code]] designed to be used by multiple [[computer program]]s or other [[library (computing)|libraries]] at [[Runtime (program lifecycle phase)|runtime]], with only one copy of that code in memory, shared by all programs using the code.<ref>{{cite book |title=Linkers and Loaders |last=Levine |first=John R. |chapter=9. Shared Libraries |isbn=1-55860-496-0 |date=2000}}</ref><ref>{{cite book |title=UNIX System V/386 Release 3.2 Programmers Guide, Vol. 1 |url=http://www.bitsavers.org/pdf/att/unix/System_V_386_Release_3.2/UNIX_System_V_386_Release_3.2_Programmers_Guide_Vol1_1989.pdf |page=8{{hyp}}2 |isbn=0-13-944877-2 |date=1989}}</ref><ref>{{cite web |url=https://www.cs.cornell.edu/courses/cs414/2001FA/sharedlib.pdf |title=Shared Libraries in SunOS |pages=1,3}}</ref> | | A '''shared library''' is a [[library (computing)|library]] of [[executable code]] that is loaded in [[computer memory |memory]] such that multiple executables ([[computer program |programs]] and other libraries) can use it at [[Runtime (program lifecycle phase)|runtime]].<ref>{{cite book |title=Linkers and Loaders |last=Levine |first=John R. |chapter=9. Shared Libraries |isbn=1-55860-496-0 |date=2000}}</ref><ref>{{cite book |title=UNIX System V/386 Release 3.2 Programmers Guide, Vol. 1 |url=http://www.bitsavers.org/pdf/att/unix/System_V_386_Release_3.2/UNIX_System_V_386_Release_3.2_Programmers_Guide_Vol1_1989.pdf |page=8{{hyp}}2 |isbn=0-13-944877-2 |date=1989}}</ref><ref>{{cite web |url=https://www.cs.cornell.edu/courses/cs414/2001FA/sharedlib.pdf |title=Shared Libraries in SunOS |pages=1,3}}</ref> |
|
| |
|
| == Library types ==
| | In contrast, a [[static library]] is [[Static linking |copied]] into an executable. A static library can be [[software reuse |re-used]] (a form of sharing) in multiple executables, but each executable contains a copy of the library code instead of |
| A program that is configured to use a library can use either [[Static linking|static-linking]] or [[Dynamic linker|dynamic-linking]]. Historically, libraries could only be static.<ref>{{Cite web |date=2018-10-25 |title=Difference between Static and Shared libraries |url=https://www.geeksforgeeks.org/difference-between-static-and-shared-libraries/ |access-date=2025-02-02 |website=GeeksforGeeks |language=en-US}}</ref> For static-linking ([[.lib]]), the library is effectively embedded into the programs executable file, while for dynamic-linking the library can be [[Load time|loaded]] at [[Runtime (program lifecycle phase)|runtime]] from a shared location, such as [[System file|system files]].
| | sharing a copy in memory with other executables. Although not true today, historically, all libraries were static.<ref>{{Cite web |date=2018-10-25 |title=Difference between Static and Shared libraries |url=https://www.geeksforgeeks.org/difference-between-static-and-shared-libraries/ |access-date=2025-02-02 |website=GeeksforGeeks |language=en-US}}</ref> Although a shared library can have static linkage, such a library is not classified as a static library. |
|
| |
|
| A program requires a [[compiler]] and [[Linker (computing)|linker]] step to access a library. In static-linking, those references are fully resolved at compile-time,<ref>{{Cite web |last=Microsoft |date=2021-10-29 |title=Walkthrough: Create and use a static library (C++) |url=https://learn.microsoft.com/en-us/cpp/build/walkthrough-creating-and-using-a-static-library-cpp?view=msvc-170 |access-date=2025-02-01 |website=learn.microsoft.com |language=en-us |quote=Using a static library is a great way to reuse code. Rather than reimplementing the same routines in every app that requires the functionality, you write them one time in a static library and then reference it from the apps. Code linked from a static library becomes part of your app—you don't have to install another file to use the code.}}</ref> whereas in dynamic-linking those references are not fully resolved until runtime by the [[operating system]].
| | Often, a shared library is also a [[dynamic library]] loaded by a [[dynamic linker]], which generally makes use of the library easier for the [[programmer]] than if it instead it had static linkage. A dynamic library need not be accessible to multiple executables (shared library) and a shared library need not be loaded at consumer runtime (dynamic library). |
| | |
| == Formats ==
| |
| Many modern operating systems now use a unified format for their shared libraries and executable files. For example:
| |
| | |
| * [[Microsoft Windows]] uses the [[Portable Executable|Portable Executable (PE)]] format for [[.dll]] files;
| |
| * operating systems such as [[Oracle Solaris|Solaris]] and other [[System V Release 4]]-based systems, [[Linux]], and the free-software [[BSD]] operating systems use the [[Executable and Linkable Format]] (ELF) for [[.so file|.so]] files;
| |
| * [[Apple Inc.|Apple's]] [[Darwin (operating system)|Darwin]]-based operating systems, such as [[macOS]] and [[iOS]], use the [[Mach-O]] format for [[.dylib]] files.
| |
| | |
| This offers two main advantages: first, it requires only one loader (building and maintaining a single loader is considered well worth any added complexity). Secondly, it allows an executable file to be used as a shared library (if it has a [[symbol table]]).{{Citation Needed|date=April 2022}}
| |
| | |
| In some older environments such as [[16-bit Windows]] or [[HP Multi-Programming Executive|MPE]] for the [[HP 3000]], significant restrictions were placed on shared library code, such as only allowing stack-based (local) data.{{Citation Needed|date=April 2022}}
| |
|
| |
|
| ==Memory sharing== | | ==Memory sharing== |
| {{main|Shared memory}} | | {{main|Shared memory}} |
|
| |
|
| Library code may be shared in memory by multiple [[Process (computing)|process]]es, and on disk. If virtual memory is used, processes would execute the same physical page of RAM that is mapped into the different address spaces of the processes. This has advantages. For instance, on the [[OpenStep]] system, applications were often only a few hundred kilobytes in size and loaded quickly; most of their code was located in libraries that had already been loaded for other purposes by the operating system.{{Citation needed|date=December 2008}} | | Library code may be shared in memory by multiple [[Process (computing)|process]]es and on disk. If virtual memory is used, processes would execute the same physical page of RAM mapped into the processes' different address spaces. This has advantages. For instance, on the [[OpenStep]] system, applications were often only a few hundred kilobytes in size and loaded quickly; most of their code was located in libraries already loaded for other purposes by the operating system.{{Citation needed|date=December 2008}} |
|
| |
|
| Programs can accomplish RAM sharing by using [[position-independent code]], as in [[Unix]], which leads to a complex but flexible architecture, or by using common virtual addresses, as in Windows and [[OS/2]]. These systems ensure, by various means, like pre-mapping the address space and reserving slots for each shared library, that code has a high probability of being shared. A third alternative is [[single-level store]] with a [[single address space operating system|single address space]], as used by the [[IBM System/38]] and its successors. This allows position-dependent code, with programs and libraries assigned a permanent address in that address space. | | Programs can accomplish RAM sharing by using [[position-independent code]], as in [[Unix]], which leads to a complex but flexible architecture, or by using common virtual addresses, as in Windows and [[OS/2]]. These systems ensure that code has a high probability of being shared by various means, like pre-mapping the address space and reserving slots for each shared library. A third alternative is a [[single-level store]] with a [[single address space operating system|single address space]], as used by the [[IBM System/38]] and its successors. This allows position-dependent code, with programs and libraries assigned a permanent address in that address space. |
|
| |
|
| In some cases, different versions of shared libraries can cause problems, especially when libraries of different versions have the same file name, and different applications installed on a system each require a specific version. Such a scenario is known as [[DLL hell]], named after the Windows and OS/2 [[DLL file]]. Most modern operating systems after 2001 have clean-up methods to eliminate such situations or use application-specific "private" libraries.<ref name="endofdllhell">{{cite web | | In some cases, different versions of shared libraries can cause problems, especially when libraries of different versions have the same file name and various applications are installed on a system, each requiring a specific version. This scenario is known as [[DLL hell]], named after the Windows and OS/2 [[DLL file|DLL files]]. Most modern operating systems after 2001 have clean-up methods to eliminate such situations or use application-specific "private" libraries.<ref name="endofdllhell">{{cite web |
| | url=http://msdn.microsoft.com/library/techart/dlldanger1.htm | | | url=http://msdn.microsoft.com/library/techart/dlldanger1.htm |
| | title=The End of DLL Hell | | | title=The End of DLL Hell |
| Line 42: |
Line 29: |
| }}</ref> | | }}</ref> |
|
| |
|
| ==Dynamic linking== | | == Examples == |
| {{main|Dynamic linker}}
| | The following commonly-used library technologies are both shared and dynamic in nature. |
| | |
| Dynamic linking or [[late binding]] is linking performed while a program is being loaded ([[load time]]) or executed ([[Runtime (program lifecycle phase)|runtime]]), rather than when the executable file is created. A dynamically linked library ([[dynamic-link library]], or DLL, under [[Microsoft Windows|Windows]] and [[OS/2]]; shareable image under [[OpenVMS]];<ref>{{cite web|url=https://vmssoftware.com/docs/VSI_Linker_Manual.pdf|title=VSI OpenVMS Linker Utility Manual|date=August 2019|access-date=2021-01-31|publisher=VSI}}</ref> dynamic shared object, or DSO, under [[Unix-like]] systems) is a library intended for dynamic linking. Only a minimal amount of work is done by the [[Linker (computing)|linker]] when the executable file is created; it only records what library routines the program needs and the index names or numbers of the routines in the library. The majority of the work of linking is done at the time the application is loaded (load time) or during execution (runtime). Usually, the necessary linking program, called a ''dynamic linker'' or ''linking loader'', is actually part of the underlying [[operating system]]. (However, it is possible, and not exceedingly difficult, to write a program that uses dynamic linking and includes its own dynamic linker, even for an operating system that itself provides no support for dynamic linking.)
| |
| | |
| Programmers originally developed dynamic linking in the [[Multics]] operating system, starting in 1964, and the MTS ([[Michigan Terminal System]]), built in the late 1960s.<ref>{{cite journal | title=A History of MTS | journal=Information Technology Digest | volume=5 | issue=5}}</ref>
| |
| | |
| ==Optimizations==
| |
| Since shared libraries on most systems do not change often, systems can compute a likely load address for each shared library on the system before it is needed and store that information in the libraries and executables. If every shared library that is loaded has undergone this process, then each will load at its predetermined address, which speeds up the process of dynamic linking. This optimization is known as [[prebinding|prebinding or prelinking]] on macOS and Linux, respectively. IBM [[z/VM]] uses a similar technique, called "Discontinuous Saved Segments" (DCSS).<ref>{{cite book |last1=IBM Corporation |title=Saved Segments Planning and Administration |date=2011 |url=http://publibfp.boulder.ibm.com/epubs/pdf/hcsg4c10.pdf |access-date=Jan 29, 2022}}</ref> Disadvantages of this technique include the time required to precompute these addresses every time the shared libraries change, the inability to use [[address space layout randomization]], and the requirement of sufficient virtual address space for use (a problem that will be alleviated by the adoption of [[64-bit]] architectures, at least for the time being).
| |
| | |
| ==Locating libraries at runtime==
| |
| Loaders for shared libraries vary widely in functionality. Some depend on the executable storing explicit paths to the libraries. Any change to the library naming or layout of the file system will cause these systems to fail. More commonly, only the name of the library (and not the path) is stored in the executable, with the operating system supplying a method to find the library on disk, based on some algorithm.
| |
| | |
| If a shared library that an executable depends on is deleted, moved, or renamed, or if an incompatible version of the library is copied to a place that is earlier in the search, the executable would fail to load. This is called ''[[dependency hell]]'', existing on many platforms. The (infamous) Windows variant is commonly known as [[DLL hell]]. This problem cannot occur if each version of each library is uniquely identified and each program references libraries only by their full unique identifiers. The "DLL hell" problems with earlier Windows versions arose from using only the names of libraries, which were not guaranteed to be unique, to resolve dynamic links in programs. (To avoid "DLL hell", later versions of Windows rely largely on options for programs to install private DLLs—essentially a partial retreat from the use of shared libraries—along with mechanisms to prevent replacement of shared system DLLs with earlier versions of them.)
| |
| | |
| ===Microsoft Windows===
| |
| [[Microsoft Windows]] checks the [[Windows registry|registry]] to determine the proper place to load DLLs that implement [[Component Object Model|COM objects]], but for other DLLs it will check the directories in a defined order. First, Windows checks the directory where it loaded the program (''private DLL''<ref name="endofdllhell"/>); any directories set by calling the <code>SetDllDirectory()</code> function; the System32, System, and Windows directories; then the current working directory; and finally the directories specified by the PATH [[environment variable]].<ref>{{cite web
| |
| |url = http://msdn.microsoft.com/en-us/library/ms682586.aspx
| |
| |title = Dynamic-Link Library Search Order
| |
| |work = Microsoft Developer Network Library
| |
| |publisher = Microsoft
| |
| |date = 2012-03-06
| |
| |access-date = 2012-05-20
| |
| |url-status = live
| |
| |archive-url = https://web.archive.org/web/20120509160536/http://msdn.microsoft.com/en-us/library/ms682586.aspx
| |
| |archive-date = 9 May 2012
| |
| }}</ref> Applications written for the [[.NET Framework]] (since 2002), also check the [[Global Assembly Cache]] as the primary store of shared dll files to remove the issue of [[DLL hell]].
| |
|
| |
|
| ===OpenStep===
| | ; DLL: [[Windows]] uses the [[Portable Executable]] (PE) format for its [[dynamic-link library]] (DLL) technology. |
| [[OpenStep]] used a more flexible system, collecting a list of libraries from a number of known locations (similar to the PATH concept) when the system first starts. Moving libraries around causes no problems at all, although users incur a time cost when first starting the system. | |
|
| |
|
| ===Unix-like systems===
| | ; SO: [[Oracle Solaris |Solaris]] and other [[System V Release 4]]-based systems, [[Linux]], and current [[BSD]] systems use the [[Executable and Linkable Format]] (ELF) for the [[shared object]] (SO) technology, sometimes and more accurately called dynamic shared object (DSO). |
| Most [[Unix-like]] systems have a "search path" specifying file-system [[Directory (computing)|directories]] in which to look for dynamic libraries. Some systems specify the default path in a [[configuration file]], others hard-code it into the dynamic loader. Some [[executable|executable file]] formats can specify additional directories in which to search for libraries for a particular program. This can usually be overridden with an [[environment variable]], although it is disabled for [[setuid]] and setgid programs, so that a user can't force such a program to run arbitrary code with root permissions. Developers of libraries are encouraged to place their dynamic libraries in places in the default search path. On the downside, this can make installation of new libraries problematic, and these "known" locations quickly become home to an increasing number of library files, making management more complex.
| |
|
| |
|
| ==Dynamic loading==
| | ; DYLIB: [[Darwin (operating system)|Darwin]]-based operating systems, such as [[macOS]] and [[iOS]], use the [[Mach-O]] format for [[.dylib]] files. |
| {{Main|Dynamic loading}}
| |
| Dynamic loading, a subset of dynamic linking, involves a dynamically linked library loading and unloading at [[Runtime (program lifecycle phase)|runtime]] on request. Such a request may be made implicitly or explicitly. Implicit requests are made when a compiler or static linker adds library references that include file paths or simply file names.{{cn|date=March 2020}} Explicit requests are made when applications make direct calls to an operating system's API.
| |
|
| |
|
| Most operating systems that support dynamically linked libraries also support dynamically loading such libraries via a [[Runtime (program lifecycle phase)|run-time]] linker [[Application programming interface|API]]. For instance, [[Microsoft Windows]] uses the API functions <code>LoadLibrary</code>, <code>LoadLibraryEx</code>, <code>FreeLibrary</code> and <code>GetProcAddress</code> with [[Microsoft Dynamic Link Library|Microsoft Dynamic Link Libraries]]; [[POSIX]]-based systems, including most UNIX and UNIX-like systems, use <code>dlopen</code>, <code>dlclose</code> and <code>dlsym</code>. Some development systems automate this process.
| |
| ==Notes==
| |
| {{reflist|group=NB}}
| |
| ==See also== | | ==See also== |
| * {{Annotated link|Loadable kernel module}} | | * {{Annotated link |Loadable kernel module}} |
|
| |
|
| ==References== | | ==References== |
Template:Short description
Script error: No such module "redirect hatnote".
A shared library is a library of executable code that is loaded in memory such that multiple executables (programs and other libraries) can use it at runtime.[1][2][3]
In contrast, a static library is copied into an executable. A static library can be re-used (a form of sharing) in multiple executables, but each executable contains a copy of the library code instead of
sharing a copy in memory with other executables. Although not true today, historically, all libraries were static.[4] Although a shared library can have static linkage, such a library is not classified as a static library.
Often, a shared library is also a dynamic library loaded by a dynamic linker, which generally makes use of the library easier for the programmer than if it instead it had static linkage. A dynamic library need not be accessible to multiple executables (shared library) and a shared library need not be loaded at consumer runtime (dynamic library).
Memory sharing
Script error: No such module "Labelled list hatnote".
Library code may be shared in memory by multiple processes and on disk. If virtual memory is used, processes would execute the same physical page of RAM mapped into the processes' different address spaces. This has advantages. For instance, on the OpenStep system, applications were often only a few hundred kilobytes in size and loaded quickly; most of their code was located in libraries already loaded for other purposes by the operating system.Script error: No such module "Unsubst".
Programs can accomplish RAM sharing by using position-independent code, as in Unix, which leads to a complex but flexible architecture, or by using common virtual addresses, as in Windows and OS/2. These systems ensure that code has a high probability of being shared by various means, like pre-mapping the address space and reserving slots for each shared library. A third alternative is a single-level store with a single address space, as used by the IBM System/38 and its successors. This allows position-dependent code, with programs and libraries assigned a permanent address in that address space.
In some cases, different versions of shared libraries can cause problems, especially when libraries of different versions have the same file name and various applications are installed on a system, each requiring a specific version. This scenario is known as DLL hell, named after the Windows and OS/2 DLL files. Most modern operating systems after 2001 have clean-up methods to eliminate such situations or use application-specific "private" libraries.[5]
Examples
The following commonly-used library technologies are both shared and dynamic in nature.
- DLL
- Windows uses the Portable Executable (PE) format for its dynamic-link library (DLL) technology.
- SO
- Solaris and other System V Release 4-based systems, Linux, and current BSD systems use the Executable and Linkable Format (ELF) for the shared object (SO) technology, sometimes and more accurately called dynamic shared object (DSO).
- DYLIB
- Darwin-based operating systems, such as macOS and iOS, use the Mach-O format for .dylib files.
See also
References
<templatestyles src="Reflist/styles.css" />
- ↑ Script error: No such module "citation/CS1".
- ↑ Script error: No such module "citation/CS1".
- ↑ Script error: No such module "citation/CS1".
- ↑ Script error: No such module "citation/CS1".
- ↑ Script error: No such module "citation/CS1".
Script error: No such module "Check for unknown parameters".
Sources
- Script error: No such module "citation/CS1".
External links