View source for News aggregator

{{short description|Client software that aggregates syndicated web content}}
{{Use dmy dates|date=June 2022}}
{{Multiple issues|
{{Essay-like|date=June 2017}}
{{Update|date=August 2020}}
}}
[[File:Tiny Tiny RSS English Interface.png|thumb|400px|The user interface of the feed reader Tiny Tiny RSS]]

In [[computing]], a '''news aggregator''', also termed a '''feed aggregator''', '''content aggregator''', '''feed reader''', '''news reader''', or simply an '''aggregator''', is client software or a [[web application]] that aggregates digital [[Content (media)|content]] such as [[online newspaper]]s, [[blog]]s, [[podcast]]s, and [[Video logging|video blogs]] (vlogs) in one location for easy viewing. The updates distributed may include journal tables of contents, podcasts, videos, and news items.<ref name="Miles 425–432">{{Cite journal|title = RIP RSS: Reviving Innovative Programs through Really Savvy Services|journal = Journal of Hospital Librarianship|pages = 425–432|volume = 9|issue = 4|doi = 10.1080/15323260903253753|first = Alisha|last =  Miles|year = 2009|s2cid = 71547323}}</ref>

Contemporary news aggregators include [[MSN]], [[Yahoo! News]], [[Feedly]], [[Inoreader]], and [[Mozilla Thunderbird]].

==Function==
[[File:Feed-icon.svg|thumb|150px|The common web feed icon]]

Aggregation technology often consolidates (sometimes [[Web syndication|syndicated]]) web content into one page that can show only the new or updated information from many sites. Aggregators reduce the time and effort needed to regularly check websites for updates, creating a unique information space or ''personal newspaper''. Once subscribed to a feed, an aggregator is able to check for new content at user-determined intervals and retrieve the update. The content is sometimes described as being ''[[pull technology|pulled]]'' to the subscriber, as opposed to ''[[push technology|pushed]]'' with email or IM. Unlike recipients of some push information, the aggregator user can easily unsubscribe from a feed. The feeds are often in the [[RSS]] or [[Atom (Web standard)|Atom]] formats which use Extensible Markup Language ([[XML]]) to structure pieces of information to be aggregated in a feed reader that displays the information in a user-friendly interface.<ref name="Miles 425–432"/> Before subscribing to a feed, users have to install either "feed reader" or "news aggregator" applications in order to read it. The aggregator provides a consolidated view of the content in one browser display or desktop application. "Desktop applications offer the advantages of a potentially richer user interface and of being able to provide some content even when the computer is not connected to the Internet. Web-based feed readers offer the great convenience of allowing users to access up-to-date feeds from any Internet-connected computer."<ref name="Doree 57–58">{{Cite journal|title = RSS: A Brief Introduction|journal = The Journal of Manual & Manipulative Therapy|date = 1 January 2007|issn = 1066-9817|pmc = 2565593|pmid = 19066644|pages = 57–58|volume = 15|issue = 1|first = Jim|last = Doree|doi=10.1179/106698107791090169}}</ref> Although some applications will have an automated process to subscribe to a news feed, the basic way to subscribe is by simply clicking on the web feed icon and/or text link.<ref name="Doree 57–58"/> Aggregation features are frequently built into [[web portal]] sites, in the [[web browser]]s themselves, in [[email]] applications, or in [[application software]] designed specifically for reading feeds. Aggregators with [[podcast]]ing capabilities can automatically download media files, such as [[MP3]] recordings. In some cases, these can be automatically loaded onto [[portable media player]]s (like [[iPod]]s) when they are connected to the end-users computer. By 2011, so-called ''RSS narrators'' appeared, which aggregated text-only news feeds, and converted them into audio recordings for offline listening. The syndicated content an aggregator will retrieve and interpret is usually supplied in the form of [[RSS (file format)|RSS]] or other [[XML]]-formatted data, such as [[Resource Description Framework|RDF]]/XML or [[Atom (standard)|Atom]].

== History ==
RSS began in 1999 when it was first introduced by web browser pioneer [[Netscape]].<ref name="Doree 57–58"/> In the beginning, RSS was not a user-friendly gadget and it took some years to spread. "...RDF-based data model that people inside Netscape felt was too complicated for end users."<ref name=":0">{{Cite book|title = Developing Feeds with RSS and Atom|last = Hammersley|first = Ben|publisher = O'Reilly Media, Inc.|year = 2005|isbn = 978-0-596-00881-9|location = Sebastopol|url-access = registration|url = https://archive.org/details/developingfeedsw0000hamm}}</ref> The rise of RSS began in the early 2000s when the New York Times implemented RSS: "One of the first, most popular sites that offered users the option to subscribe to RSS feeds was the New York Times, and the company's implementation of the format was revered as the 'tipping point' that cemented RSS's position as a de facto standard."<ref>{{Cite web|title = Google Reader is dead but the race to replace the RSS feed is very alive|url = http://www.digitaltrends.com/web/google-reader-is-dead-but-the-race-to-replace-the-rss-feed-is-very-alive/#ixzz3usvMfKvJ|website = Digital Trends|access-date = 21 December 2015|language = en-US|date = July 2013}}</ref> "In 2005, major players in the web browser market started integrating the technology directly into their products, including Microsoft's [[Internet Explorer]], [[Mozilla's Firefox]] and [[Safari (web browser)|Apple's Safari]]." {{As of|2015|post=,}} according to BuiltWith.com, there were 20,516,036 live websites using RSS.<ref>{{Cite web|title = RSS Usage Statistics|url = http://trends.builtwith.com/feeds/RSS|website = trends.builtwith.com|access-date = 21 December 2015}}</ref>

==Types==
Web aggregators gather material from a variety of sources for display in one location. They may additionally process the information after retrieval for individual clients.<ref name="Chowdhury 100–115">{{Cite journal|title = News aggregator services: user expectations and experience|journal = Online Information Review|pages = 100–115|volume = 30|issue = 2|doi = 10.1108/14684520610659157|first1 = Sudatta|last1 = Chowdhury|first2 = Monica|last2 = Landoni|year = 2006}}</ref> For instance, [[Google News]] gathers and publishes material independent of customers' needs while [[Awasu]]<ref>{{cite web|url=http://www.awasu.com/|title=Welcome to Awasu|website=www.Awasu.com|access-date=27 October 2017}}</ref> is created as an individual RSS tool to control and collect information according to clients' criteria. There are a variety of software applications and components available to collect, format, translate, and republish XML feeds, a demonstration of presentation-independent data. {{Citation needed|date=May 2017}}

===News aggregation websites===

A news aggregator provides and updates information from different sources in a systematized way. "Some news aggregator services also provide update services, whereby a user is regularly updated with the latest news on a chosen topic".<ref name="Chowdhury 100–115"/> Websites such as [[Google News]], [[Yahoo News]], [[Bing News]], and [[NewsNow]] where aggregation is entirely automatic, using algorithms which carry out contextual analysis and group similar stories together.<ref name="webs">{{cite web |title=Google News and newspaper publishers: allies or enemies? |url=http://www.editorsweblog.org/analysis/2009/03/google_news_and_newspaper_publishers_all.php |access-date=31 March 2009 |work=Editorsweblog.org |publisher=World Editors Forum}}</ref> Websites such as [[Drudge Report]] and ''[[HuffPost]]'' supplement aggregated news headline RSS feeds from a number of reputable mainstream and alternative news outlets, while including their own articles in a separate section of the website.<ref>{{cite news |last=Luscombe |first=Belinda |date=19 March 2009 |title=Arianna Huffington: The Web's New Oracle |magazine=Time |publisher=Time Inc |url=http://www.time.com/time/business/article/0,8599,1886214,00.html |url-status=dead |url-access=subscription |access-date=30 March 2009 |archive-url=https://web.archive.org/web/20090321174549/http://www.time.com/time/business/article/0,8599,1886214,00.html |archive-date=21 March 2009 |quote=The Huffington Post was to have three basic functions: blog, news aggregator with an attitude and place for premoderated comments.}}</ref>

News aggregation websites began with content selected and entered by humans, while automated selection algorithms were eventually developed to fill the content from a range of either automatically selected or manually added sources. Google News launched in 2002 using automated story selection, but humans could add sources to its search engine, while the older Yahoo News, as of 2005, used a combination of automated news crawlers and human editors.<ref>{{cite news | last=Hansell | first=Saul | date=24 September 2002 | title=All the news Google algorithms say is fit to print | work=The New York Times | url=https://www.nytimes.com/2002/09/24/technology/24GOOG.html | access-date=20 January 2014 }}</ref><ref name="Hill2005">{{cite book|last=Hill|first=Brad|title=Google Search & Rescue For Dummies|url=https://archive.org/details/googlesearchresc00hill_0|url-access=registration|date=24 October 2005|publisher=John Wiley & Sons|isbn=978-0-471-75811-2|page=[https://archive.org/details/googlesearchresc00hill_0/page/85 85]}}</ref><ref name=pamela>{{cite news|last=LiCalzi O'Connell|first=Pamela|title=New Economy; Yahoo Charts the Spread of the News by E-Mail, and What It Finds Out Is Itself Becoming News.|url=https://www.nytimes.com/2001/01/29/business/new-economy-yahoo-charts-spread-e-mail-what-it-finds-itself-becoming.html|newspaper=New York Times|date=29 January 2001}}</ref>

===Web-based feed readers===
Web-based feeds readers allow users to find a web feed on the internet and add it to their feed reader. These are meant for personal use and are hosted on remote servers. Because the application is available via the web, it can be accessed anywhere by a user with an [[internet]] connection. There are even more specified web-based RSS readers.<ref>{{Cite journal|title = Scientists get online news aggregator|journal = Nature News|date = 25 June 2008|pages = 1149|volume = 453|issue = 7199|doi = 10.1038/4531149b|pmid = 18580906|first = Declan|last = Butler|s2cid = 205037759}}</ref>

More advanced methods of aggregating feeds are provided via [[Ajax (programming)|Ajax]] coding techniques and [[XML]] components called [[web widget]]s. Ranging from full-fledged applications to small fragments of [[source code]] that can be integrated into larger programs, they allow users to aggregate [[OPML]] files, email services, documents, or feeds into one interface. Many customizable homepage and portal implementations provide such functionality.

In addition to aggregator services mainly for individual use, there are web applications that can be used to aggregate several blogs into one. One such variety—called ''planet'' sites—are used by online communities to aggregate community blogs in a centralized location. They are named after the [[Planet aggregator]], a server application designed for this purpose.

===Feed reader applications===
{{main|Comparison of feed aggregators}}
Feed aggregation applications are installed on a PC, smartphone or tablet computer and designed to collect news and interest feed subscriptions and group them together using a user-friendly interface. The graphical user interface of such applications often closely resembles that of popular [[e-mail client]]s, using a three-panel composition in which subscriptions are grouped in a frame on the left, and individual entries are browsed, selected, and read in frames on the right.

Software aggregators can also take the form of [[news ticker]]s which scroll feeds like [[ticker tape]], alerters that display updates in windows as they are refreshed, web browser macro tools or as smaller components (sometimes called [[Plug-in (computing)|plugins]] or [[Software extension|extension]]s), which can integrate feeds into the [[operating system]] or software applications such as a web browser.

=== Social news aggregators ===
{{main|Social news website}}
Social news aggregators collect the most popular stories on the Internet, selected, edited, and proposed by a wide range of people. "In these social news aggregators, users submit news items (referred to as "stories"), communicate with peers through direct messages and comments, and collaboratively select and rate submitted stories to get to a real-time compilation of what is currently perceived as "hot" and popular on the Internet."<ref>{{Cite journal|title = Are Friends Overrated? A Study for the Social News Aggregator Digg.com|arxiv = 1304.2974|journal = Computer Communications|issn = 0140-3664|pages = 796–809|volume = 35|issue = 7|doi = 10.1016/j.comcom.2012.02.001|first1 = Christian|last1 = Doerr|first2 = Norbert|last2 = Blenn|first3 = Siyu|last3 = Tang|first4 = Piet|last4 = Van Mieghem|year = 2012|s2cid = 15187700}}</ref> Social news aggregators are based on engagement of community. Their responses, engagement level, and contribution to stories create the content and determine what will be generated as RSS feed.

=== Frame- and media-bias–aware news aggregators ===
[[Media bias]] and [[framing (social sciences)|framing]] are concepts that fundamentally explain deliberate or accidental differences in news coverage. A simple example is comparing media coverage of a topic in two countries, which are in (armed) conflict with another: one can easily imagine that news outlets, particularly if state-controlled, will report differently or even contrarily on the same events (for instance, the [[Russo-Ukrainian War]]). While media bias and framing have been subject to manual research for a couple of decades in the social sciences, only recently have automated methods and systems been proposed to analyze and show such differences. Such systems make use of text-features, e.g., news aggregators that extract key phrases that describe a topic differently, or other features, such as matrix-based news aggregation, which spans a matrix over two dimensions, the first dimension being which country an article was published in, and the second being which country it is reporting on.<ref name="Hamborg2017b">Felix Hamborg, Norman Meuschke, and Bela Gipp, [http://www.gipp.com/wp-content/papercite-data/pdf/hamborg2017b.pdf Matrix-based News Aggregation: Exploring Different News Perspectives] in Proceedings of the ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL), 2017.</ref><ref name="Hamborg2018b">Felix Hamborg, Norman Meuschke and Bela Gipp, [http://www.gipp.com/wp-content/papercite-data/pdf/hamborg2018b.pdf Bias-aware News Analysis using Matrix-based News Aggregation] in the International Journal on Digital Libraries (IJDL), 2018.</ref>

==Media aggregators==
Media aggregators are sometimes referred to as ''podcatchers'' due to the popularity of the term ''[[podcast]]'' used to refer to a web feed containing audio or video. Media aggregators are client software or web-based applications which maintain subscriptions to feeds that contain audio or video [[RSS enclosures|media enclosures]]. They can be used to automatically download media, playback the media within the application interface, or synchronize media content with a portable media player. Multimedia aggregators are the current focus. EU launched the project Reveal This to embedded different media platforms in RSS system. "Integrated infrastructure that will allow the user to capture, store, semantically index, categorize and retrieve multimedia, and multilingual digital content across different sources – TV, radio, music, web, etc. The system will allow the user to personalize the service and will have semantic search, retrieval, summarization."<ref name="Chowdhury 100–115"/>

==Broadcatching==
Broadcatching is a mechanism that automatically downloads BitTorrent files advertised through RSS feeds.<ref>{{Cite book |doi = 10.1109/CCNC.2009.4784862 |isbn = 978-1-4244-2308-8|citeseerx = 10.1.1.433.6539|chapter = Experimental Study of Broadcatching in BitTorrent|title = 2009 6th IEEE Consumer Communications and Networking Conference|pages = 1–5|year = 2009|last1 = Zhang|first1 = Zengbin|last2 = Lin|first2 = Yuan|last3 = Chen|first3 = Yang|last4 = Xiong|first4 = Yongqiang|last5 = Shen|first5 = Jacky|last6 = Liu|first6 = Hongqiang|last7 = Deng|first7 = Beixing|last8 = Li|first8 = Xing|s2cid = 342057}}</ref> Several [[BitTorrent (protocol)|BitTorrent]] [[List of BitTorrent clients|client software applications]] such as Azureus and μTorrent have added the ability to ''[[broadcatching|broadcatch]]'' torrents of distributed multimedia through the aggregation of web feeds.

== Feed filtering ==

One of the problems with news aggregators is that the volume of articles can sometimes be overwhelming, especially when the user has many web feed subscriptions. As a solution, many feed readers allow users to [[tag (metadata)|tag]] each feed with one or more keywords which can be used to sort and filter the available articles into easily navigable categories. Another option is to import the user's [[Attention Profiling Mark-up Language|Attention Profile]] to filter items based on their relevance to the user's interests.

== RSS and marketing ==
Some bloggers predicted the death of RSS when Google Reader was shut down.<ref>{{cite web|url=http://www.gizmag.com/google-reader-shutting-down-date/26641/|title=R.I.P. RSS? Google to shut down Google Reader|website=www.Gizmag.com|access-date=27 October 2017|date=14 March 2013}}</ref><ref>{{cite news|url=https://techcrunch.com/2013/03/13/google-readers-death-is-proof-that-rss-always-suffered-from-lack-of-consumer-appeal/|title=Google Reader's Death Is Proof That RSS Always Suffered From Lack Of Consumer Appeal|first=Drew|last=Olanoff|newspaper=Techcrunch|access-date=27 October 2017}}</ref> Later, however, RSS was considered more of a success as an appealing way to obtain information. "Feedly, likely the most popular RSS reader today, has gone from around 5,000 paid subscribers in 2013 to around 50,000 paid subscribers in early 2015 – that's a 900% increase for Feedly in two years."<ref>{{Cite web|title = Is RSS Dead? A Look At The Numbers|url = http://www.makeuseof.com/tag/rss-dead-look-numbers/|website = MakeUseOf|date = 25 March 2015|access-date = 21 December 2015}}</ref> Customers use RSS to get information more easily while businesses take advantage of being able to spread announcements. "RSS serves as a delivery mechanism for websites to ''push'' online content to potential users and as an information aggregator and filter for users."<ref>{{Cite journal|title = Use of RSS feeds to push online content to users|journal = Decision Support Systems|date = 1 December 2012|pages = 740–749|volume = 54|issue = 1|doi = 10.1016/j.dss.2012.09.002|first = Dan|last = Ma|url = https://ink.library.smu.edu.sg/sis_research/1679}}</ref> However, it has been pointed out that in order to ''push the content'' RSS should be user-friendly to ensure<ref>{{Cite web|title = Google Reader is dead but the race to replace the RSS feed is very alive|url = http://www.digitaltrends.com/web/google-reader-is-dead-but-the-race-to-replace-the-rss-feed-is-very-alive/#ixzz3usxIAOr3|website = Digital Trends|access-date = 21 December 2015|language = en-US|date = July 2013}}</ref> proactive interaction so that the user can remain engaged without feeling "trapped", good design to avoid being overwhelmed by stale data, and optimization for both desktop and mobile use. RSS has a positive impact on marketing since it contributes to better search engine rankings, to building and maintaining brand awareness, and increasing site traffic.<ref>{{Cite book|title = Developing Feeds with RSS and Atom|url = https://archive.org/details/developingfeedsw0000hamm|url-access = registration|last = Hammersley|first = Ben|publisher = O'Reilly Media, Inc.|year = 2005|isbn =9780596519001|location = California|pages = [https://archive.org/details/developingfeedsw0000hamm/page/11 11]}}</ref>

== See also ==
* [[Content moderation]]
* [[Comparison of feed aggregators]]
* [[History of web syndication technology]]
* [[Lifestreaming]]
* [[Metasearch engine]]
* [[Social media]]
* [[Social network aggregation]]
* [[Web feed]]
* [[Web syndication]]

==References==
{{reflist}}

==External links==
{{Commons category|News aggregators}}
{{Wiktionary|aggregator}}

{{Aggregators}}
{{Web syndication}}
{{News agencies}}
{{DEFAULTSORT:News aggregator}}
[[Category:News aggregators| ]]
[[Category:Information Age]]