Open-source intelligence: Difference between revisions

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search
imported>Seungri400
No edit summary
 
imported>Peaceray
→Further reading: |author2=UC Berkeley Human Rights Center |author2-link=Berkeley Human Rights Center
 
(2 intermediate revisions by 2 users not shown)
Line 7: Line 7:
{{Intelligence}}
{{Intelligence}}


'''Open-source intelligence''' ('''OSINT''') refers to the systematic collection, evaluation, and analysis of publicly available information from open sources to produce actionable intelligence. These sources include, but are not limited to, traditional media (newspapers, radio, television), government publications, academic research, commercial databases, public websites, social media platforms, geospatial data, and technical infrastructure information.
'''Open source intelligence''' ('''OSINT''') is the collection and analysis of data gathered from open sources (overt sources and publicly available information) to produce actionable intelligence. OSINT is primarily used in [[national security]], [[law enforcement]], and [[competitive intelligence|business intelligence]] functions and is of value to analysts who use non-sensitive intelligence in answering [[classified information|classified]], [[Classified information#Unclassified|unclassified]], or [[trade secret|proprietary intelligence]] [[intelligence requirement|requirements]] across the previous intelligence disciplines.<ref name="row-2022">{{cite web |last1=Schwartz |first1=Leo |title=Amateur open source researchers went viral unpacking the war in Ukraine |url=https://restofworld.org/2022/osint-viral-ukraine/ |website=Rest of World |access-date=8 March 2022 |date=March 7, 2022}}</ref>
 
OSINT is employed across a wide range of sectors including national security, law enforcement, corporate intelligence, journalism, cybersecurity, humanitarian aid, and academic research. It supports decision-making by providing timely, relevant, and verified insights derived from legally accessible and non-classified materials.
 
Unlike other forms of intelligence such as human intelligence (HUMINT), signals intelligence (SIGINT), or imagery intelligence (IMINT), OSINT does not rely on covert or classified means of collection. Instead, it leverages information that is freely accessible to the public, often through digital channels, though physical documents and broadcasts also remain valid sources.


== Categories ==
== Categories ==
Line 34: Line 30:


==Definition==
==Definition==
OSINT, broadly defined, involves gathering and analyzing publicly accessible information to produce actionable insights.<ref>{{Cite web |title=What is OSINT (Open-Source Intelligence?) {{!}} SANS Institute |url=https://www.sans.org/blog/what-is-open-source-intelligence/ |access-date=2025-02-18 |website=[[SANS Institute]]}}</ref>
OSINT, broadly defined, involves gathering and analyzing publicly accessible information to produce actionable insights.<ref>{{Cite web |title=What is OSINT (Open-Source Intelligence?) {{!}} SANS Institute |url=https://www.sans.org/blog/what-is-open-source-intelligence/ |access-date=2025-02-18 |website=[[SANS Institute]] |date=23 February 2023 }}</ref>


The [[United States Department of Homeland Security|U.S. Department of Homeland Security]] defines OSINT as intelligence derived from publicly available information, collected and disseminated promptly to address specific intelligence needs.<ref>''[https://www.dhs.gov/sites/default/files/2022-09/Ethical%20Frameworks%20in%20OSINT%20Final.pdf Ethical Frameworks in Open Source Intelligence]''. (Report) (2022). Part of the 2022 Public Private Partnership Analytic Exchange Program. Washington, DC: [[United States Department of Homeland Security|US Department of Homeland Security]].</ref>
The [[United States Department of Homeland Security|U.S. Department of Homeland Security]] defines OSINT as intelligence derived from publicly available information, collected and disseminated promptly to address specific intelligence needs.<ref>''[https://www.dhs.gov/sites/default/files/2022-09/Ethical%20Frameworks%20in%20OSINT%20Final.pdf Ethical Frameworks in Open Source Intelligence]''. (Report) (2022). Part of the 2022 Public Private Partnership Analytic Exchange Program. Washington, DC: [[United States Department of Homeland Security|US Department of Homeland Security]].</ref>
Line 63: Line 59:


=== Tools ===
=== Tools ===
[[File:Command Post Computing Environment multiple screens Photo US Army released to Public Domain.jpg|alt=<nowiki>Systematic Software Engineering uses open source intelligence, compiled by [[Janes Information Services]], as part of its intelligence platform.</nowiki>|thumb|Open source intelligence may be ingested to battle management systems such as CPCE by [[Systematic Software Engineering|Systematic]], which uses an open source feed from [[Janes Information Services]].]]
A guide by Ryan Fedasiuk, an analyst at the [[Center for Security and Emerging Technology]], lists six tools open-source analysts can use to stay safe and utilize operational security ([[Operations security|OPSEC]]) when conducting online investigations. These include [[VPNs]], cached webpages, [[Digital archiving|digital archive]] services, URL and file scanners, browser sandbox applications, and [[antivirus software]].<ref>{{Cite web |last=Fedasiuk |first=Ryan |date=2022-04-06 |title=Into the Jungle: Best Practices for Open-Source Researchers |url=https://cset.georgetown.edu/article/into-the-jungle-best-practices-for-open-source-researchers/ |access-date=2022-04-22 |website=Center for Security and Emerging Technology |language=en-US}}</ref>
Open-source intelligence (OSINT) relies on a wide range of tools and platforms to collect, analyze, and validate publicly available information. These tools vary from general-purpose web browsers to specialized software and frameworks designed specifically for open-source investigations.
 
=== 1. General Purpose Platforms ===
The web browser serves as a foundational tool in OSINT workflows, granting access to vast amounts of publicly available data across websites, forums, blogs, and databases. It also enables the use of both open-source and proprietary software tools—either purpose-built for OSINT or adaptable for intelligence-gathering purposes.
 
=== 2. Specialized OSINT Tools and Frameworks ===
A number of dedicated tools and platforms have been developed to streamline the process of gathering and analyzing open-source information. These include:
 
* Maltego : A data visualization tool used for link analysis and reconnaissance.
* Shodan : A search engine for internet-connected devices, often used in cybersecurity research.
* TheHarvester : A tool used for e-mail harvesting and subdomain enumeration.
* FOCA (Fingerprinting Organizations with Collected Archives) : Used to extract metadata and find hidden information in documents.
* Recon-ng : A full-featured web reconnaissance framework written in Python.
 
The OSINT Framework , an open-source project maintained on GitHub, provides a categorized directory of over 30 major types of OSINT tools, covering areas such as social media investigation, geolocation, domain analysis, and more.[3]
 
=== 3. Training and Educational Resources ===
Given the evolving nature of digital platforms and online tools, continuous learning is essential for effective OSINT practice. Numerous educational organizations, investigative groups, and training institutions offer resources to support skill development in this field. Notable contributors include:
 
* Bellingcat : An independent collective known for its open-source investigative journalism.
* SANS Institute : Offers courses and certifications focused on cybersecurity and digital forensics, including OSINT-related topics.
* IntelTechniques : Provides training materials and tools for journalists, law enforcement, and researchers.
 
Books such as ''Open Source Intelligence Techniques'' by Michael Bazzell serve as practical guides to navigating the digital landscape, offering curated lists of tools and techniques across multiple domains. However, due to the rapid pace of change in the online environment, the author emphasizes the importance of ongoing study, training, and adaptation to maintain relevance and effectiveness in OSINT operations.[1]
 
=== 4. Operational Security (OPSEC) Tools ===
As OSINT practitioners often conduct sensitive or public investigations, maintaining personal safety and operational security is critical. Analysts may employ various tools to protect their identity and digital footprint. Ryan Fedasiuk, an analyst at the Center for Security and Emerging Technology, recommends several OPSEC best practices and tools, including:


* Virtual Private Networks (VPNs)
Numerous lists of aggregated OSINT content are available on the web. The OSINT Framework contains over 30 primary categories of tools and is maintained as an open source project on [[GitHub]].<ref>{{Citation |title=OSINT Framework |date=2022-05-02 |url=https://github.com/lockfale/OSINT-Framework |publisher=lockFALE |access-date=2022-05-02}}</ref>
* Cached webpage services (e.g., Google Cache, Wayback Machine)
* Digital archive services
* URL and file scanners (e.g., VirusTotal)
* Browser sandbox applications
* Antivirus software
 
These tools help reduce exposure to potential threats when conducting online investigations, especially when researching adversarial or high-risk subjects.[2]
 
=== 5. Integration with Larger Systems ===
In institutional settings, OSINT is often integrated into broader command and control systems. For example, CPCE (Command Post Communications Environment) by Systematic incorporates open-source feeds such as those provided by Jane’s Information Services , enabling real-time intelligence integration into military and defense operations.


== Risks for practitioners ==
== Risks for practitioners ==
One of the primary challenges in open-source intelligence (OSINT) is the sheer volume of publicly available information, often referred to as the "information explosion." The exponential growth of digital content across news platforms, social media, forums, blogs, and official publications presents significant difficulties for analysts attempting to identify, verify, and contextualize relevant data.
A main hindrance to practical OSINT is the volume of information it has to deal with [[information explosion]]. The amount of data being distributed increases at a rate that it becomes difficult to [[Words of estimative probability|evaluate sources]] in [[intelligence analysis]]. To a small degree the work has sometimes been done by amateur crowd-sourcing.<ref>{{Cite magazine |title=Bellingcat's Eliot Higgins Explains Why Ukraine Is Winning the Information War |url=https://time.com/6155869/bellingcat-eliot-higgins-ukraine-open-source-intelligence/ |access-date=2022-04-13 |magazine=Time |language=en}}</ref>


The rapid pace at which new information is generated often outstrips the capacity of analysts to process and evaluate it effectively. This can lead to difficulties in distinguishing reliable sources from misinformation or disinformation, and in prioritizing intelligence that is both timely and actionable.
Private individuals illegally collecting data for a foreign military or intelligence agency is considered [[espionage]] in most countries. Espionage that is not [[treason]] (e.g. betraying one's country of citizenship) has been a tool of statecraft since ancient times.<ref>[[Sun Tzu]] ([[Warring States period]]), ''[[The Art of War]]'', Chapter 13: "Hostile armies may face each other for years, striving for the victory which is decided in a single day. This being so, to remain in ignorance of the enemy's condition simply because one grudges the outlay of 2 hundred ounces of silver in honors and emoluments, is the height of inhumanity."</ref>


To mitigate these challenges, some organizations have explored the use of automated tools, machine learning algorithms, and crowdsourcing techniques. While large-scale automation remains a developing field, limited efforts involving amateur or citizen analysts have occasionally contributed to the filtering and categorization of open-source data—though such methods are generally considered supplementary rather than definitive.
== Disinformation and misinformation risk ==
The open and accessible nature of public sources makes OSINT particularly vulnerable to contamination. Extremist group regularly use OSINT to spread to misinformation and spread their ideology.<ref>{{Cite web |title=The Dark Side of OSINT: How Extremists Exploit Open-Source Intelligence |url=https://www.counterextremism.com/blog/dark-side-osint-how-extremists-exploit-open-source-intelligence |access-date=2025-12-24 |website=Counter Extremism Project |language=en}}</ref>


While OSINT involves only legally accessible, publicly available information, the distinction between lawful research and illegal activity becomes critical when individuals or entities misuse open-source practices.
Governments and state actors have been documented intentionally disseminating disinformation through public channels to influence perceptions, confuse adversaries, or undermine trust in open-source findings. This can include planting false information in news outlets, social media, official statements, or even manipulated geospatial data to deceive OSINT practitioners who rely on such sources.<ref name="Royal United Services 2022">{{cite web |title=OSINT in an Age of Disinformation Warfare |website=Royal United Services Institute |date=2022-03-14 |url=https://www.rusi.org/explore-our-research/publications/commentary/osint-age-disinformation-warfare |access-date=2025-12-24}}</ref>
 
In most jurisdictions, the unauthorized collection and transmission of sensitive information to a foreign government or intelligence agency—even if obtained from public sources—can constitute espionage , particularly if it involves strategic, military, or national security-related data. Espionage of this nature, distinct from treason (which typically involves betrayal of one’s own state), has historically been employed by states as a tool of diplomacy, warfare, and influence.
 
It is important to note that while OSINT itself is a legitimate and transparent discipline, its misuse—particularly when combined with covert intent or malicious purpose—can cross into legally and ethically prohibited territory. Therefore, responsible OSINT practitioners emphasize adherence to legal standards, ethical guidelines, and operational security best practices.


==Professional associations and certifications==
==Professional associations and certifications==
As open-source intelligence (OSINT) has grown in prominence across government, military, corporate, and journalistic sectors, a number of professional associations and certification programs have emerged to support practitioners, standardize methodologies, and promote ethical conduct.
=== 1. The OSINT Foundation ===
The OSINT Foundation is a U.S.-based professional association dedicated to advancing the practice of open-source intelligence within the U.S. Intelligence Community and beyond. Open exclusively to U.S. citizens, the organization aims to elevate the visibility and professionalism of OSINT as a formal intelligence discipline. It serves as a platform for knowledge sharing, networking, and advocacy among current and aspiring OSINT practitioners.
=== 2. OSMOSIS and the Open-Source Certified (OSC) Designation ===
OSMOSIS , an offshoot of the Hetherington Group—a private investigation and corporate intelligence firm—offers training programs and conferences that lead to the Open-Source Certified (OSC) designation. The OSC program was developed to help formalize and standardize professional OSINT practices.
According to the program’s guidelines, candidates must fulfill specific prerequisites and pass a 100-question examination to demonstrate proficiency in open-source research and analysis. The certification emphasizes legal compliance, ethical behavior, and technical competence in gathering and interpreting publicly available information.
=== 3. IntelTechniques and the OSIP Certification ===
IntelTechniques , a provider of investigative and OSINT training, offers the Open Source Intelligence Professional (OSIP) certification. The program is designed to test participants' ability to produce actionable intelligence using real-world scenarios and standardized evaluation criteria.


In addition to structured courses, IntelTechniques fosters a moderated online community where professionals can exchange insights on best practices, tools, and methodologies. While the OSIP certification is optional, participation in the training itself helps individuals develop and refine their OSINT skills for use in law enforcement, journalism, cybersecurity, and corporate investigations.
{{more citations needed|section|date=December 2025}}


=== 4. Other Training Providers and Communities ===
McAfee Institute offers several government-recognized certification programs in open-source intelligence (OSINT) and related investigative disciplines. The ''Certified in Open Source Intelligence (C|OSINT)'' program provides structured training in the collection, verification, and analysis of publicly available information, aligning with recognized standards for intelligence and law enforcement professionals.{{citation needed|date=December 2025}}
Beyond formal certifications, several organizations offer specialized OSINT training and platforms for professional development:


* Bellingcat, an independent collective known for its open-source investigative journalism, provides public training sessions and resources for journalists, researchers, and activists.
McAfee Institute’s certification programs are approved by the Missouri Department of Higher Education and Workforce Development (MDHEWD),<ref>{{Cite web |title=Home {{!}} dhewd.mo.gov |url=https://dhewd.mo.gov/ |access-date=2025-10-15 |website=dhewd.mo.gov}}</ref>{{failed verification|date=December 2025}} listed in the National Initiative for Cybersecurity Careers and Studies (NICCS) training catalog maintained by the U.S. Department of Homeland Security, and recognized by the U.S. Department of Defense Credentialing Opportunities On-Line (COOL)<ref>{{cite web |title=DOD COOL Portal - Homepage |website=www.cool.osd.mil |url=https://www.cool.osd.mil/index.htm |access-date=2025-12-24}}</ref>{{failed verification|date=December 2025}} program for all military branches.
* Independent educators and trainers also contribute to the field through blogs, podcasts, YouTube channels, and social media communities focused on OSINT tradecraft.


These informal and semi-formal learning environments play a vital role in expanding access to OSINT education and fostering global collaboration among practitioners.
According to the McAfee Institute, the C|OSINT certification validates professional competency in conducting lawful and ethical online investigations, emphasizing intelligence tradecraft, digital profiling, and open-source data analysis. Graduates receive lifetime access to updated course materials and instructor support.{{citation needed|date=December 2025}}


==See also==
The OSINT Foundation is a professional association for OSINT practitioners in the United States Intelligence Community.<ref>{{Citation |title=New OSINT foundation aims to 'professionalize' open source discipline across spy agencies |url=https://federalnewsnetwork.com/inside-ic/2022/07/new-osint-foundation-aims-to-professionalize-open-source-discipline-across-spy-agencies/ |date=2022-07-27 |language=en-US}}</ref> It is open to U.S. Citizens and seeks to raise the prominence of the open-source intelligence discipline.<ref>{{Citation |title=New Group to Promote Open-Source Intelligence, Seen as Vital in Ukraine War | newspaper=Wall Street Journal |url=https://www.wsj.com/articles/new-group-to-promote-open-source-intelligence-seen-as-vital-in-ukraine-war-11658926800?st=q5j3a3ymqekavuj&reflink=desktopwebshare_permalink |date=2022-07-27 |language=en-US | last1=Volz | first1=Dustin }}</ref>
{{div col|colwidth=20em}}
*{{annotated link|Ashley Feinberg}}
*{{annotated link|Bellingcat}}
*{{annotated link|Co-occurrence networks}}
*{{annotated link|Dan Butler (civil servant)}}
*{{annotated link|DARPA TIDES program}}
*{{annotated link|Doxing}}
*{{annotated link|Eliot A. Jardines}}
*{{annotated link|Eliot Higgins}}
*{{annotated link|Fusion center}}
*{{annotated link|ICWatch}}
*{{annotated link|Intellipedia}}
*{{annotated link|Investigative Data Warehouse}}
*{{annotated link|MiTAP}}
*{{annotated link|National Intelligence Open Source Committee}}
*{{annotated link|NATO Open Source Intelligence Handbook}}, [[NATO Open Source Intelligence Reader]]
*{{annotated link|Open data}}
*{{annotated link|Open Source Center}}
*{{annotated link|Oryx (blog)}}
*{{annotated link|Private intelligence agency}}
*{{annotated link|Social cloud computing}}
*{{annotated link|Special Libraries Association}}
*{{annotated link|Strategic intelligence}}
*{{annotated link|Open-source intelligence in the 2022 Russian invasion of Ukraine}}
{{Div col end}}


==References==
==References==
Line 174: Line 91:
*[https://web.archive.org/web/20080310024429/http://findarticles.com/p/articles/mi_m0IBS/is_4_31/ai_n16419797 FindAcricles.com], Military Intelligence Professional Bulletin October–December, 2005 by Barbara G. Fast
*[https://web.archive.org/web/20080310024429/http://findarticles.com/p/articles/mi_m0IBS/is_4_31/ai_n16419797 FindAcricles.com], Military Intelligence Professional Bulletin October–December, 2005 by Barbara G. Fast
*[https://fas.org/irp/congress/2005_hr/062105jardines.pdf FAS.org], Congressional Testimony on OSINT and Homeland Security 21 June 2005
*[https://fas.org/irp/congress/2005_hr/062105jardines.pdf FAS.org], Congressional Testimony on OSINT and Homeland Security 21 June 2005
*[https://www.forbes.com/2008/11/21/maltego-data-mining-identity08-tech-cz-tb_1121maltego.html Forbes.com], When Everyone Can Mine Your Data by Taylor Buley, 11.21.08]
* {{cite web | last=Thompson | first=Clive | title=Open-Source Spying | website=The New York Times | date=2006-12-03 | url=https://www.nytimes.com/2006/12/03/magazine/03intelligence.html | access-date=2018-05-29}}
* {{cite web | last=Thompson | first=Clive | title=Open-Source Spying | website=The New York Times | date=2006-12-03 | url=https://www.nytimes.com/2006/12/03/magazine/03intelligence.html | access-date=2018-05-29}}
* {{cite web | title=Open Source Intelligence (OSINT) | website=RIS Open Source Intelligence | date=2018-05-29 | url=http://arnoreuser.com/ | ref={{sfnref | RIS Open Source Intelligence | 2018}} | access-date=2018-05-29}}
* {{cite web | title=The Intelligence Network : I n t r o d u c t i o n | website=intellnet.org | date=2008-05-09 | url=http://www.intellnet.org/ | archive-url=https://web.archive.org/web/20080509085418/http://www.intellnet.org/ | archive-date=2008-05-09 | url-status=unfit | ref={{sfnref | intellnet.org | 2008}} | access-date=2018-05-29}}
* {{cite web | title=The Intelligence Network : I n t r o d u c t i o n | website=intellnet.org | date=2008-05-09 | url=http://www.intellnet.org/ | archive-url=https://web.archive.org/web/20080509085418/http://www.intellnet.org/ | archive-date=2008-05-09 | url-status=unfit | ref={{sfnref | intellnet.org | 2008}} | access-date=2018-05-29}}
   
   
== Further reading ==
== Further reading ==
*{{cite book |author=United Nations Office of the High Commissioner for Human Rights |author-link=United Nations Office of the High Commissioner for Human Rights |author2=University of California, Berkeley Human Rights Center |author2-link=University Human Rights Centers#Human Rights Center – University of California, Berkeley |title=Berkeley Protocol on Digital Open Source Investigations A Practical Guide on the Effective Use of Digital Open Source Information in Investigating Violations of International Criminal, Human Rights and Humanitarian Law |url=https://www.ohchr.org/sites/default/files/2024-01/OHCHR_BerkeleyProtocol.pdf |publication-place=New York, Geneva |publisher=UN Office of the High Commissioner for Human Rights; Human Rights Center, UC Berkeley School of Law |year=2022 |isbn=978-92-1-154233-2 |oclc=1334608062}}
*{{cite book |author=United Nations Office of the High Commissioner for Human Rights |author-link=United Nations Office of the High Commissioner for Human Rights |author2=UC Berkeley Human Rights Center |author2-link=Berkeley Human Rights Center |title=Berkeley Protocol on Digital Open Source Investigations A Practical Guide on the Effective Use of Digital Open Source Information in Investigating Violations of International Criminal, Human Rights and Humanitarian Law |url=https://www.ohchr.org/sites/default/files/2024-01/OHCHR_BerkeleyProtocol.pdf |publication-place=New York, Geneva |publisher=UN Office of the High Commissioner for Human Rights; Human Rights Center, UC Berkeley School of Law |year=2022 |isbn=978-92-1-154233-2 |oclc=1334608062}}


===Scientific publications===
===Scientific publications===
Line 187: Line 102:
* [http://epublications.bond.edu.au/cgi/viewcontent.cgi?article=1010&context=cewces_papers Cody Burke: 'Freeing knowledge, telling secrets: Open source intelligence and development', Bond University, May 2007] {{Webarchive|url=https://web.archive.org/web/20160817134042/http://epublications.bond.edu.au/cgi/viewcontent.cgi?article=1010&context=cewces_papers |date=2016-08-17 }}
* [http://epublications.bond.edu.au/cgi/viewcontent.cgi?article=1010&context=cewces_papers Cody Burke: 'Freeing knowledge, telling secrets: Open source intelligence and development', Bond University, May 2007] {{Webarchive|url=https://web.archive.org/web/20160817134042/http://epublications.bond.edu.au/cgi/viewcontent.cgi?article=1010&context=cewces_papers |date=2016-08-17 }}
* [http://www.isn.ethz.ch/isn/Digital-Library/Publications/Detail/?id=122008 Florian Schaurer, Jan Störger: 'The Evolution of Open Source Intelligence', OSINT Report 3/2010, ISN, ETH Zürich, October 2010]
* [http://www.isn.ethz.ch/isn/Digital-Library/Publications/Detail/?id=122008 Florian Schaurer, Jan Störger: 'The Evolution of Open Source Intelligence', OSINT Report 3/2010, ISN, ETH Zürich, October 2010]
* {{Cite book|last=Hassan, Nihad A.|url=https://www.worldcat.org/oclc/1043830928|title=Open source intelligence methods and tools : a practical guide to online intelligence|others=Hijazi, Rami|date=30 June 2018|isbn=978-1-4842-3213-2|location=[United States]|oclc=1043830928}}
* {{Cite book|last=Hassan, Nihad A.|title=Open source intelligence methods and tools : a practical guide to online intelligence|others=Hijazi, Rami|date=30 June 2018|isbn=978-1-4842-3213-2|location=[United States]|oclc=1043830928}}


== External links ==
== External links ==


* [http://rr.reuser.biz The Open Source Intelligence Resource Discovery Toolkit]
* [https://rr.reuser.biz The Open Source Intelligence Resource Discovery Toolkit]
*[https://web.archive.org/web/20020307050442/http://www.time.com/time/covers/1101020311/viewpoint.html The New Craft of Intelligence: Making the Most of Open Private Sector Knowledge]
*[https://web.archive.org/web/20020307050442/http://www.time.com/time/covers/1101020311/viewpoint.html The New Craft of Intelligence: Making the Most of Open Private Sector Knowledge]
*[https://web.archive.org/web/20080216224135/http://www.cm2limited.com/casestudies/casestudies.php Actual Intelligence Case Studies Leveraging Open Source Intelligence (OSINT)]
*[https://web.archive.org/web/20080216224135/http://www.cm2limited.com/casestudies/casestudies.php Actual Intelligence Case Studies Leveraging Open Source Intelligence (OSINT)]
Line 210: Line 125:
[[Category:2005 introductions]]
[[Category:2005 introductions]]
[[Category:2005 establishments in the United States]]
[[Category:2005 establishments in the United States]]
[[Category:Management cybernetics]]

Latest revision as of 23:01, 24 December 2025

Template:Short description Script error: No such module "Unsubst". Template:Intelligence

Open source intelligence (OSINT) is the collection and analysis of data gathered from open sources (overt sources and publicly available information) to produce actionable intelligence. OSINT is primarily used in national security, law enforcement, and business intelligence functions and is of value to analysts who use non-sensitive intelligence in answering classified, unclassified, or proprietary intelligence requirements across the previous intelligence disciplines.[1]

Categories

OSINT sources can be divided up into six different categories of information flow:[2]

OSINT is distinguished from research in that it applies the process of intelligence to create tailored knowledge supportive of a specific decision by a specific individual or group.[3]

OSINT collection methodologies

Collecting open-source intelligence is achieved in a variety of different ways,[4] such as:

Definition

OSINT, broadly defined, involves gathering and analyzing publicly accessible information to produce actionable insights.[5]

The U.S. Department of Homeland Security defines OSINT as intelligence derived from publicly available information, collected and disseminated promptly to address specific intelligence needs.[6]

NATO describes OSINT as intelligence obtained from publicly available information and other unclassified data with limited public distribution or access.[7]

The European Union defines OSINT as the collecting and analyzing information from open sources to generate actionable intelligence, supporting areas like national security, law enforcement, and business intelligence.[8]

The United Nations has also recognized OSINT’s potential, noting its value in monitoring member states’ compliance with international regulations across various sectors, including public health and human rights.[9]

In the private sector, companies like IBM define OSINT as the process of gathering and analyzing publicly available information to assess threats, inform decisions, or answer specific questions. Similarly, cybersecurity firms such as CrowdStrike describe OSINT as the act of collecting and analyzing publicly available data for intelligence purposes.[10]

History

File:911 commission seal.svg
Seal of the 9/11 Commission

OSINT practices have been documented as early as the mid-19th century in the United States and early 20th century in the United Kingdom.[11]

OSINT in the United States traces its origins to the 1941 creation of the Foreign Broadcast Monitoring Service (FBMS), an agency responsible for the monitoring of foreign broadcasts. An example of their work was the correlation of changes in the price of oranges in Paris with successful bombings of railway bridges during World War II.[12]

The Aspin-Brown Commission stated in 1996 that US access to open sources was "severely deficient" and that this should be a "top priority" for both funding and DCI attention.[13]

In July 2004, following the September 11 attacks, the 9/11 Commission recommended the creation of an open-source intelligence agency.[14] In March 2005, the Iraq Intelligence Commission recommended[15] the creation of an open-source directorate at the CIA.

Following these recommendations, in November 2005 the Director of National Intelligence announced the creation of the DNI Open Source Center. The Center was established to collect information available from "the Internet, databases, press, radio, television, video, geospatial data, photos and commercial imagery."[16] In addition to collecting openly available information, it would train analysts to make better use of this information. The center absorbed the CIA's previously existing Foreign Broadcast Information Service (FBIS), originally established in 1941, with FBIS head Douglas Naquin named as director of the center.[17] Then, following the events of 9/11 the Intelligence Reform and Terrorism Prevention Act merged FBIS and other research elements into the Office of the Director of National Intelligence creating the Open Source Enterprise.

Furthermore, the private sector has invested in tools which aid in OSINT collection and analysis. Specifically, In-Q-Tel, a Central Intelligence Agency supported venture capital firm in Arlington, VA assisted companies develop web-monitoring and predictive analysis tools.

In December 2005, the Director of National Intelligence appointed Eliot A. Jardines as the Assistant Deputy Director of National Intelligence for Open Source to serve as the Intelligence Community's senior intelligence officer for open source and to provide strategy, guidance and oversight for the National Open Source Enterprise.[18] Mr. Jardines has established the National Open Source Enterprise[19] and authored intelligence community directive 301. In 2008, Mr. Jardines returned to the private sector and was succeeded by Dan Butler who is ADDNI/OS[20] and previously Mr. Jardines' Senior Advisor for Policy.[21]

Tools

A guide by Ryan Fedasiuk, an analyst at the Center for Security and Emerging Technology, lists six tools open-source analysts can use to stay safe and utilize operational security (OPSEC) when conducting online investigations. These include VPNs, cached webpages, digital archive services, URL and file scanners, browser sandbox applications, and antivirus software.[22]

Numerous lists of aggregated OSINT content are available on the web. The OSINT Framework contains over 30 primary categories of tools and is maintained as an open source project on GitHub.[23]

Risks for practitioners

A main hindrance to practical OSINT is the volume of information it has to deal with information explosion. The amount of data being distributed increases at a rate that it becomes difficult to evaluate sources in intelligence analysis. To a small degree the work has sometimes been done by amateur crowd-sourcing.[24]

Private individuals illegally collecting data for a foreign military or intelligence agency is considered espionage in most countries. Espionage that is not treason (e.g. betraying one's country of citizenship) has been a tool of statecraft since ancient times.[25]

Disinformation and misinformation risk

The open and accessible nature of public sources makes OSINT particularly vulnerable to contamination. Extremist group regularly use OSINT to spread to misinformation and spread their ideology.[26]

Governments and state actors have been documented intentionally disseminating disinformation through public channels to influence perceptions, confuse adversaries, or undermine trust in open-source findings. This can include planting false information in news outlets, social media, official statements, or even manipulated geospatial data to deceive OSINT practitioners who rely on such sources.[27]

Professional associations and certifications

Script error: No such module "Unsubst".

McAfee Institute offers several government-recognized certification programs in open-source intelligence (OSINT) and related investigative disciplines. The Certified in Open Source Intelligence (C|OSINT) program provides structured training in the collection, verification, and analysis of publicly available information, aligning with recognized standards for intelligence and law enforcement professionals.Script error: No such module "Unsubst".

McAfee Institute’s certification programs are approved by the Missouri Department of Higher Education and Workforce Development (MDHEWD),[28]Script error: No such module "Unsubst". listed in the National Initiative for Cybersecurity Careers and Studies (NICCS) training catalog maintained by the U.S. Department of Homeland Security, and recognized by the U.S. Department of Defense Credentialing Opportunities On-Line (COOL)[29]Script error: No such module "Unsubst". program for all military branches.

According to the McAfee Institute, the C|OSINT certification validates professional competency in conducting lawful and ethical online investigations, emphasizing intelligence tradecraft, digital profiling, and open-source data analysis. Graduates receive lifetime access to updated course materials and instructor support.Script error: No such module "Unsubst".

The OSINT Foundation is a professional association for OSINT practitioners in the United States Intelligence Community.[30] It is open to U.S. Citizens and seeks to raise the prominence of the open-source intelligence discipline.[31]

References

<templatestyles src="Reflist/styles.css" />

  1. ↑ Script error: No such module "citation/CS1".
  2. ↑ Script error: No such module "citation/CS1".
  3. ↑ Script error: No such module "citation/CS1".
  4. ↑ Script error: No such module "citation/CS1".
  5. ↑ Script error: No such module "citation/CS1".
  6. ↑ Ethical Frameworks in Open Source Intelligence. (Report) (2022). Part of the 2022 Public Private Partnership Analytic Exchange Program. Washington, DC: US Department of Homeland Security.
  7. ↑ Script error: No such module "citation/CS1".
  8. ↑ Script error: No such module "citation/CS1".
  9. ↑ Script error: No such module "citation/CS1".
  10. ↑ Script error: No such module "citation/CS1".
  11. ↑ Script error: No such module "Citation/CS1".
  12. ↑ Script error: No such module "citation/CS1".
  13. ↑ Script error: No such module "citation/CS1".
  14. ↑ See page 413 of the 9-11 Commission Report (pdf) Script error: No such module "webarchive"..
  15. ↑ Script error: No such module "citation/CS1".
  16. ↑ Office of the Director of National Intelligence. "ODNI Announces Establishment of Open Source Center Script error: No such module "webarchive".". Press release, 8 November 2005.
  17. ↑ Ensor, David. "The Situation Report: Open source intelligence center Script error: No such module "webarchive".". CNN, 8 November 2005.
  18. ↑ Office of the Director of National Intelligence "ODNI Senior Leadership Announcement Script error: No such module "webarchive".". Press release, 7 December 2005.
  19. ↑ "National Open Source Entreprise Vision Statement" Script error: No such module "webarchive". May 2006
  20. ↑ DNI Open Source Conference 2008 "Decision Advantage" agenda, Office of the Director of National Intelligence, July 2008. Script error: No such module "webarchive".
  21. ↑ DNI Open Source Conference 2007 "Expanding the Horizons" agenda, Office of the Director of National Intelligence, July 2007. Script error: No such module "webarchive".
  22. ↑ Script error: No such module "citation/CS1".
  23. ↑ Script error: No such module "citation/CS1".
  24. ↑ Script error: No such module "Citation/CS1".
  25. ↑ Sun Tzu (Warring States period), The Art of War, Chapter 13: "Hostile armies may face each other for years, striving for the victory which is decided in a single day. This being so, to remain in ignorance of the enemy's condition simply because one grudges the outlay of 2 hundred ounces of silver in honors and emoluments, is the height of inhumanity."
  26. ↑ Script error: No such module "citation/CS1".
  27. ↑ Script error: No such module "citation/CS1".
  28. ↑ Script error: No such module "citation/CS1".
  29. ↑ Script error: No such module "citation/CS1".
  30. ↑ Script error: No such module "citation/CS1".
  31. ↑ Script error: No such module "citation/CS1".

Script error: No such module "Check for unknown parameters".

  • WashTimes.com, Washington Times – CIA mines 'rich' content from blogs, 19 April 2006
  • GCN.com, Government Computer News – Intelligence units mine the benefits of public sources 20 March 2006
  • FindAcricles.com, Military Intelligence Professional Bulletin October–December, 2005 by Barbara G. Fast
  • FAS.org, Congressional Testimony on OSINT and Homeland Security 21 June 2005
  • Script error: No such module "citation/CS1".
  • Script error: No such module "citation/CS1".

Further reading

  • Script error: No such module "citation/CS1".

Scientific publications

External links

Script error: No such module "Navbox". Script error: No such module "Authority control".