View source for Video synthesizer

{{Essay|date=October 2009}}
[[File:Grain 0.1-Audiovisual Synthesizer.webm|thumb|right|upright=1.35|start=00:10|thumbtime=04:11|A video synthesizer (bottom) being operated which creates video images (top)]]
[[File:HSS3i at Bleep Labs.webm|thumb|thumbtime=01:11|right|upright=1.35|Video images created by a video synthesizer across multiple television sets.]]
A '''video synthesizer''' is a device that electronically creates a [[video]] signal.  A video synthesizer is able to generate a variety of visual material without camera input through the use of internal video pattern generators.  It can also accept and "clean up and enhance" or "distort" live television camera imagery. The synthesizer creates a wide range of imagery through purely electronic manipulations. This imagery is visible within the output video signal when this signal is displayed. The output video signal can be viewed on a wide range of conventional video equipment, such as TV monitors, theater video projectors, computer displays, etc.

Video pattern generators may produce static or moving or evolving imagery.  Examples include geometric patterns (in 2D or 3D), subtitle text characters in a particular font, or weather maps.

Imagery from TV cameras can be altered in color or geometrically scaled, tilted, wrapped around objects, and otherwise manipulated.

A particular video synthesizer will offer a subset of possible effects.

== Real-time performance instruments ==
[[File:The Electro-Music Chamber Ensemble @ Northeastern electro-music 2018.webm|thumb|right|200px|Video generated by an LZX video synthesizer setup reacting as a live background for a musical band]]
The history of video synthesis is tied to a "real time performance" ethic.  The equipment is usually expected to function on input camera signals the machine has never seen before, delivering a processed signal continuously and with a minimum of delay in response to the ever-changing live video inputs.  Following in the tradition of performance instruments of the audio synthesis world such as the [[Theremin]], video synthesizers were designed with the expectation they would be played in live concert theatrical situations or set up in a studio ready to process a videotape from a playback VCR in real time while recording the results on a second VCR.  Venues of these performances included "Electronic Visualization Events" in Chicago, [http://www.thekitchen.org The Kitchen] in NYC, and museum installations. Video artist/performer Don Slepian designed, built and performed a foot-controlled Visual Instrument at the Centre Pompidou in Paris (1983) and the NY Open Center that combined [[Genlocking|genlocked]] early micro-computers [[Apple II Plus]] with the Chromaton 14 Video Synthesizer.<ref name=CH14>{{cite web |url=https://www.audiovisualizers.com/toolshak/vidsynth/chroma14/chroma14.htm |archive-url=https://web.archive.org/web/20000711043223/https://www.audiovisualizers.com/toolshak/vidsynth/chroma14/chroma14.htm |archive-date=2000-07-11 |url-status=usurped |title=CHromaton 14 |website=audiovisualizers.com}}</ref> and channels of colorized video feedback.

Analog and early real time digital synthesizers existed before modern computer 3D modeling.  Typical [[3D renderer]]s are not real time, as they concentrate on computing each frame from, for example, a recursive [[ray tracing (graphics)|ray tracing]] algorithm, however long it takes.  This distinguishes them from video synthesizers, which must deliver a new output frame by the time the last one has been shown, and repeat this performance continuously (typically delivering a new frame regularly every 1/60 or 1/50 of a second). The real time constraint results in a difference in design philosophy between these two classes of systems.

Video synthesizers overlap with video [[special effect]]s equipment used in real time network television broadcast and post-production situations.  Many innovations in television broadcast equipment as well as computer graphics displays evolved from synthesizers developed in the [[Video art|video artists' community]] and these industries often support "electronic art projects" in this area to show appreciation of this history.

==Confluence of ideas of electronics and arts==
Many principles used in the construction of early video synthesizers reflected a healthy and dynamic interplay between electronic requirements and traditional interpretations of artistic forms.
For example, [[Steve Rutt]], [[Bill Etra]] and [[Daniel J. Sandin|Daniel Sandin]] carried forward as an essential principle ideas of [[Robert Moog]] that standardized signal ranges so that any module's output could be connected to "voltage control" any other module's input.  The consequence of this in a machine like the Rutt-Etra was that position, brightness, and color were completely interchangeable and could be used to modulate each other during the processing that led to the final image.  Videotapes by Louise and Bill Etra and [[Steina and Woody Vasulka]] dramatized this new class of effects. This led to various interpretations of the multi-modal [[synesthesia]] of these aspects of the image in dialogues that extended the McLuhanesque language of film criticism of the time.

=== EMS Spectron ===
[[Image:Spectre image3-1977.jpg|thumb|right |Image produced by Spectre video synthesizer]]
In the UK, Richard Monkhouse, working for [[Electronic Music Studios (London) Ltd|Electronic Music Studios (London) Limited]] (EMS), developed a hybrid video synthesiser – Spectre – later renamed 'Spectron'<ref name=hinton2001>
{{cite web
 | last      = Hinton | first = Graham
 | date      = <!-- last updated: -->2001-06-17
 | title     = Spectron (formerly Spectre) (1974/5)
 | url       = http://www.ems-synthi.demon.co.uk/emsprods.html#spectron | work = A Guide to the EMS Product Range - 1969 to 1979
 | publisher = Electronic Music Studios | location = Cornwall
 | archive-url= https://web.archive.org/web/20131031040324/http://www.ems-synthi.demon.co.uk/emsprods.html#spectron
 | archive-date = 2013-10-31
 | quote     = Designer: Richard Monkhouse. Innovative Video Synthesiser using analogue and digital techniques. ... The prototype was used to provide a projected lightshow for an early Tangerine Dream concert at the London Rainbow. 15 Built.
}}
</ref><ref>
{{cite web
 | title     = SPECTRE Color Video Synthesizer
 | url       = http://www.audiovisualizers.com/toolshak/vidsynth/spectre/spectre.htm
 | website   = AudioVisualizers.com
 | quote     = This page is based upon an article by David Kirk, for FOCUS magazine ... .
 | url-status=usurped |archive-url=https://web.archive.org/web/20130523162253/http://www.audiovisualizers.com/toolshak/vidsynth/spectre/spectre.htm |archive-date=2013-05-23}}
</ref><ref>{{cite web |url=http://www.audiovisualizers.com/toolshak/vsynths.htm |title=Video Synthesizers |website=AudioVisualizers.com |url-status=usurped |archive-url=https://web.archive.org/web/20130521045538/http://www.audiovisualizers.com/toolshak/vsynths.htm |archive-date=2013-05-21}}<br/>–{{cite web |url=http://www.audiovisualizers.com/toolshak/toolshak.html |title=Tool Shack |website=AudioVisualizers.com |url-status=usurped |archive-url=https://web.archive.org/web/20131019201148/http://www.audiovisualizers.com/toolshak/toolshak.html |archive-date=2013-10-19}}<br/>–{{cite web
 | title     = EMS SPECTRE - User Manual
 | website   = AudioVisualizers.com
 | url       = http://www.audiovisualizers.com/toolshak/vidsynth/spectre/manual/spec_man.htm
 |url-status=usurped |archive-url=https://web.archive.org/web/20140410065409/http://www.audiovisualizers.com/toolshak/vidsynth/spectre/manual/spec_man.htm |archive-date=2014-04-10
}}
</ref>
which used the EMS patchboard system to allow completely flexible connections between module inputs and outputs. The video signals were digital, but they were controlled by analog voltages. There was a digital patchboard for image composition and an analog patchboard for motion control.

==Evolution into frame buffers==
Video synthesizers moved from analog to the precision control of digital.  The first digital effects as exemplified by [[Stephen Beck]]'s Video Weavings used digital oscillators optionally linked to horizontal, vertical, or frame resets to generate timing ramps.  These ramps could be gated to create the video image itself and were responsible for its underlying geometric texture.  Schier and Vasulka advanced the state of the art from address counters to programmable (microcodable) [[Am2900|AMD Am2901]] bit slice based address generators.  On the data path, they used 74S181 arithmetic and logic units, previously thought of as a component for doing arithmetic instructions in minicomputers, to process real time video signals, creating new signals representing the sum, difference, AND, XOR, and so on, of two input signals.  These two elements, the address generator, and the video data pipeline, recur as core features of digital video architecture.

The address generator supplied read and write addresses to a real time video memory, which can be thought of as evolution into the most flexible form of gating the address bits together to produce the video.  While the video frame buffer is now present in every computer's graphics card, it has not carried forward a number of features of the early video synths.  The address generator counts in a fixed rectangular pattern from the upper left hand corner of the screen, across each line, to the bottom.  This discarded a whole technology of modifying the image by variations in the read and write addressing sequence provided by the hardware address generators as the image passed through the memory.  Today, address based distortions are more often accomplished by [[blitter]] operations moving data in the memory, rather than changes in video hardware addressing patterns.

== History ==

=== 1960s ===
* 1962, [[Lee Harrison III]]'s ANIMAC: (Hybrid graphic animation computer) – predecessor to the [[Scanimate]]
* 1966, Dan Slater's custom vsynths: Dan Slater has built a number of custom homebrew vsynths over the years and worked with [[Douglas Trumbull]] on various films.
* 1968, Eric Siegel's PCS (Processing Chrominance Synthesizer)
* 1968, Computer Image Corporation [[Scanimate]]:<ref>{{cite web|url=https://www.youtube.com/watch?v=SGF0Okaee1o|title=Scanimate News Report|last=Anthony Singleton|date=12 October 2009|via=YouTube}}</ref> 
** Video of a [https://www.youtube.com/watch?v=SGF0Okaee1o News Report on Scanimate], including interview with inventor Lee Harrison III
* 1969, [[Nam June Paik|Paik]]/Abe synthesizer
** Built at WGBH Boston [[Experimental Television Center|Experimental TV Center]] envisioned by [[Nam June Paik]], designed by artist/engineer Shuya Abe.<ref>{{cite thesis|last1=Kearns|first1=Mary Ann |title=The Role of Technology in the Art of Nam June Paik: Paik's Videotapes |date=1988 |publisher=Unpublished manuscript for MA degree at School of the Arts of Virginia Commonwealth University |url=https://www.experimentaltvcenter.org/role-technology-art-nam-june-paik-paiks-videotapes |access-date=15 May 2023}}</ref>
** Several built at [[CalArts]], and [[Experimental Television Center|Experimental TV Center]] [[Binghamton University]], WNET NYC; [[Jim Wiseman]] has one still operational{{As of?|date=November 2021}}
* 1969, Bill Hearn's VIDIUM: (Analog XYZ driver/sequencer)
* 1969, Glen Southworth's CVI Quantizer and CVI Data Camera

===1970–1974===
* 1970, Eric Siegel's EVS Electronic Video Synthesizer and Dual Colorizer (Analog)
* 1970, groove & VAmpire
** (generated real-time output operations on voltage-controlled equipment)
** (video and music program for interactive realtime exploration/experimentation).
* 1970, Lear Siegler's vsynth: unique high-resolution video processor used in the film ''[[The Andromeda Strain (film)|The Andromeda Strain]]'' and by Douglas Trumbull and Dan Slater
* [[Stephen Beck]]'s Direct Video Synth and Beck Video Weaver
** Stephen Beck created some early 1970s synths that had no video inputs. They made video purely from oscillations.
** He also modified a few Paik/Abe units.
* Walter Wright: one of the first video animators, in the early 1970s, he worked at Dolphin Productions a Division of Computer Image Corporation, where he operated a Scanimate. While at Dolphin, he worked with Ed Emshwiller on ''Thermogenisis'' and ''Scapemates''. He also made several tapes on his own.  In 1973–1976, as artist-in-residence at the [[Experimental Television Center]], New York, he pioneered video performance touring public access centers, colleges and galleries with the Paik/Abe video synthesizer.<ref>More artworks created by this technology can be found in the [http://hdl.handle.net/1813.001/8946249 Experimental Television Center] {{Webarchive|url=https://web.archive.org/web/20200517094322/http://goldsen.library.cornell.edu/etc/ |date=2020-05-17 }} in the [[Cornell University Library|Rose Goldsen Archive of New Media Art, Cornell University Library]].</ref>  He also worked with the David Jones colorizer and Rich Brewster's sequencing modules. These various modules were based on David's design for voltage-controlled video amps and became the basis for the ETC studio. He was there when Don McArthur built the SAID. Woody Vasulka and Jeff Schier were close at hand building computer-based modules in Buffalo including a frame buffer with ALUs built in, mixers, keyers and colorizers. Wright also worked with [[Gary Hill]] at Woodstock Community Video, where they had a weekly cable show of live video/audio synthesis. Wright has developed his own performance video system, the Video Shredder, and uses it in performances with a mission to create a new music of sound and image. He has performed throughout the east coast of the US and Canada at art galleries and museums, schools and colleges, media centers, conferences and festivals.
[[File:Sandin_Image_Processor.jpg|thumb|right|200px|The 1971 [[Sandin Image Processor]]]]
* 1971, [[Sandin Image Processor]]: very early video synth, DIY modular, built by Dan Sandin of Chicago.
* 1972, Rutt/Etra Video Synthesizer: co-invented by Steve Rutt and Bill Etra; this is an analog computer for video raster manipulation.
* 1973, [[Phil Morton]] publishes "Notes on the Aesthetics of Copying an Image Processor".  He "proudly referred to himself as the ‘first copier’ of Sandin's Image Processor. The Sandin Image Processor offered artists unprecedented abilities to create, process and affect realtime video and audio, enabling performances that literally set the stage for current real-time audio-video New Media Art."<ref>{{cite web|url=http://www.fondation-langlois.org/html/e/doc.php?NumEnregDoc=d00012734|title=The Daniel Langlois Foundation - CR+D/Document|website=www.fondation-langlois.org}}</ref>
* 1974, Videosynths' by David Jones: many creations, the most famous being the Jones Colorizer, a four channel voltage controllable colorizer with gray level keyers.
* 1974, [[Electronic Music Studios (London) Ltd|EMS]] Spectre: Innovative video synthesiser using analogue and digital techniques, developed by Richard Monkhouse at EMS. Later renamed to 'Spectron'.

===1975–1979===
[[File:Atari Video Music.webm|thumb|right|250px|Output from an Atari Video Music, with music from 2018]]
* 1975, Dave Jones Video Digitizer: an early digital video processor used for video art. It did real-time digitizing (no sample clock) and used a 4-bit ALU to create color effects
* 1975, Don McArthur's SAID: Don McArthur developed the SAID (Spatial and Intensity Digitizer), an outgrowth of research on a black and white time base corrector with Dave Jones
* 1976, Denise Gallant's vsynth: created a very advanced analogue video synthesizer in the late 1970s.
* 1976, Chromaton 14
** A fairly small analog video synthesizer with color quantizers and which can generate complex color images without any external inputs.
** Built by BJA Systems<ref name=CH14/>
* [[Atari Video Music]]
* 1977, Jones Frame Buffer: low-resolution digital frame storage of video signals (higher resolution versions, and multi-frame versions were made in 1979 and the early 1980s)
* 1979, Chromachron: one of the first DIGITAL VSynths – designed by Ed Tannenbaum.
* 1979, Chromascope Video Synthesizer, PAL and NTSC versions. Created by Robin Palmer. Manufactured by Chromatronics, Essex, UK. Distribution by CEL Electronics. Model P135 (2,000 units built) and Model C.101 (100 units built).<ref>"[http://www.eyetrap.net/Chromascope_Video_Synthesizer.html Chromasope Video Synthesizer]". Eyetrap.net.</ref>

===1980s===
* 1984, [[Fairlight CVI]] Computer Video Instrument: The Fairlight CVI was produced in the early 1980s, and is a hybrid analog-digital video processor.{{citation needed|date=June 2012}}

=== 2000s–2020s ===
{{multiple image |align=right |direction=horizontal |total_width=300|perrow=2
 | image1   = LZX Visionary video synthesizer - ＃basic ＃nye patch, little key little color, modulate & feedback... ＃codame booth ready to ＃cyber ghost yah (2013-12-31 20.25.52 by j bizzie).jpg
 | caption1 = LZX modular video synthesizer in work.
 | image2   = Modular analog video synth ＃portrait @chibibby ＃codame ＃rackgeek ^ ^ (photo by j bizzie) 2013-11-14 11.55.34.jpg
 | caption2 =  A sample of processed video image.
 | image3   = Vidiot.jpg
 | caption3 = An LZX 'Vidiot'
 | image4   = 1985 Called by Victor Grigas .webm
 | caption4 = Video synth footage
 | image5   = LZX Castles ADC DAC FlipFlops Counter ShiftRegister Castellano.webm
 | caption5 =  An LZX video synth video
}}
* 2008, Lars Larsen and Ed Leckie founded [https://web.archive.org/web/20171207213321/https://www.lzxindustries.net/ LZX Industries] and began developing new analog video synthesizer modules (Visionary, Cadet, and Expedition Series).<ref>{{cite web|url=https://www.vice.com/en/article/modular-synths-lzx-interview/|title=Thump|website=Vice}}</ref>
* 2010, [[M-Labs#Milkymist_One_and_Flickernoise|Milkymist One]]
* 2011, [[Critter & Guitari]] Video Scope: preset video synthesizer.<ref>{{cite web|title=Video Scope |url=http://www.critterandguitari.com/content/video-scope |publisher=Critter & Guitari|date=25 September 2011|archive-url=https://web.archive.org/web/20110925151751/http://www.critterandguitari.com/content/video-scope|archive-date=2011-09-25}}</ref>
* 2013, [[Critter & Guitari]] Rhythm Scope: preset video synthesizer.<ref name="auto">{{cite web|title=Blog |url=https://www.critterandguitari.com/blog|publisher=Critter & Guitari}}</ref>{{verification failed|date=April 2021|reason=Blog is dynamic}}
* 2014, [[Critter & Guitari]] Black & White Video Scope: preset video synthesizer.<ref name="auto"/>{{verification failed|date=April 2021|reason=Blog is dynamic}}
* 2014, [[Ming Mecca]]: modular pixel-art-oriented analog video synth<ref>Elliot, Patrick. "[https://killscreen.com/previously/articles/ming-mecca-jazz-instrument-videogame-improvisation/ Ming Mecca, The Jazz Instrument for Videogame Improvisation]". ''[[Kill Screen]]''. 30 March 2015.</ref>
*2015, CFOGE Video Equations: procedurally generated digital video synth.<ref>{{Cite web|last=Yocheeaka 7dex |first=V. J.|date=2018-05-27|title=Cat Full Of Ghosts – Video Equations|url=http://visual-society.com/2018/cat-full-of-ghosts-video-equations/|access-date=2021-01-23|website=Visual Society |language=de-DE}}</ref>
* 2016, Paracosm [http://lumen-app.com Lumen]: semi-modular software video synth for [[MacOS]].<ref>{{cite web |url=https://www.theverge.com/2016/4/27/11513014/lumen-video-synthesizer-app-paracosm|title=The Lumen app emulates an analog video synth|first=Ashley|last=Carman|date=27 April 2016|website=The Verge}}</ref>
* 2016, [https://kevinkripper.com/vsynth Vsynth]: a modular video synthesizer package for [http://www.cycling74.com Max/Jitter] by Kevin Kripper.
* 2016, [[Ming Micro]]: pixel-art-oriented digital video synth<ref>Pangburn, DJ. "[https://www.vice.com/en/article/portable-8-bit-video-synth-instrument/ Meet Ming Micro, the Portable 8-Bit Video and Audio Synthesizer]". ''[[Vice (magazine)|Vice]]''. 9 February 2016. {{ISSN|1077-6788}}</ref>
* 2017, [[Critter & Guitari]] ETC: video synthesizer that supports 720p output.<ref>{{cite web |url=https://www.critterandguitari.com/etc|title=ETC Video Synthesizer|publisher=Critter & Guitari}}</ref>
* 2021, [[Critter & Guitari]] EYESY: video synthesizer that supports 1080p output, MIDI input and programming.<ref>{{cite web |url=https://www.critterandguitari.com/eyesy|title=EYESY Video Synthesizer|publisher=Critter & Guitari}}</ref>
* 2022, Blittertech Waveblitter: audio-reactive video synthesizer, b/w composite video output in PAL or NTSC. <ref name=":0">{{cite web |title=Waveblitter Video Synthesizer |url=https://www.blittertech.com |publisher=Blittertech}}</ref>
* 2023, Blittertech Waveblitter Color: audio-reactive video synthesizer with inbuilt video player, composite video output in PAL or NTSC. <ref name=":0" />

==Other video synthesizers==
[[File:Workshop on video synthesis - Stephane Lefrancois and the LZX Industries Visual Cortex.webm |thumb|right|Workshop on video synthesis - Stephane Lefrancois and the LZX Industries Visual Cortex]]
* Electro-Harmonix' [[Hot Tubes|Light Tube]]
* Image Articulator (Vasulka, Schier, Dosch) real-time digital data ops by S181 addressing by [[AMD Am2900|Am2901]]
* [[Neon (light synthesizer)|Neon]]
* [[Video Toaster]] for [[Amiga]] computer
* [[Virtual Light Machine]]

==See also==
* [[VJ (video performance artist)]]
* [[Audiovisual art]]
* [[Music visualization]]
* [[Video art]]
* [[Raster scan]]
{{-}}

==References==
{{Reflist}}

===Bibliography===
;Books
*Computer Lib by [[Ted Nelson]]

;Web
* [http://iasl.uni-muenchen.de/links/GCA-IV.1e.html#Video Tools Thomas Dreher: History of Computer Art] Chap. IV.1.2 Video Synthesizers.
*Nam June Paik  (http://pastexhibitions.guggenheim.org/paik/index.html){{dead link|date=July 2016 |bot=InternetArchiveBot |fix-attempted=yes }}
*Nam June Paik (http://www.paikstudios.com/){{dead link|date=July 2016 |bot=InternetArchiveBot |fix-attempted=yes }}
*Rutt-Etra ( http://www.audiovisualizers.com/toolshak/vidsynth/ruttetra/ruttetra.htm )
*Walter Wright (https://nohtv.wordpress.com/ )
*Sandin Image Processor ( http://www.audiovisualizers.com/toolshak/vidsynth/sandin/sandin.htm )
*Sandin Image Processor, references to videotapes from, with stillframes ( [https://web.archive.org/web/20020602101242/http://mitpress2.mit.edu/e-journals/LEA/PIONEERS/sandin.html] )
* Phillip Morton Archive ( http://copyitright.wordpress.com/ )
*[[Stephen Beck]] (Analog and Digital video synths) ( https://web.archive.org/web/20060211003115/http://people.wcsu.edu/mccarneyh/fva/B/BeckDirectVideo.html )
*Keeling Video Machine design blog ( https://web.archive.org/web/20060515063107/http://www.lundberg.info/vidsynth/ )
*Fluidigeo synth, designed late 1970s built in early 1980s, patent has good diagrams and text describing archetypical video synthesizer of that era ( https://web.archive.org/web/20060211005327/http://www.fluidigeo.com/patents/US4791489.pdf )
*Tannenbaum's "Recollections" at [[Exploratorium]] ( https://web.archive.org/web/20051023192358/http://www.kidsart.com/IS/418.html )
*Video Synthesizer List ( http://www.audiovisualizers.com/toolshak/vsynths.htm )
*[[Peter Donebauer#Videokalos colour synthesizer|Videokalos Colour Synthesiser]] ( https://web.archive.org/web/20041119134620/http://www.donebauer.net/manifestations/videokalos/features/features.htm )
*The Bob System (http://iknewthem.tripod.com/gear/bob.htm){{dead link|date=July 2016 |bot=InternetArchiveBot |fix-attempted=yes }}
*Don Slepian music videos: (http://DonSlepian.com)
*# "Beginnings", 1983 – Chromascope Analog Video Synthesizer (http://www.veoh.com/videos/e68305kXXwNmEs)
*# "Next Time", 1983 – Chromascope with Luma-Keying and Image Processing (http://www.veoh.com/videos/e68279sepxtkB3)
*# "Rising Crimson Tide", 1982 – Chromaton 14 Analog Video Synthesizer with colorized video feedback techniques, animations from the Apple II+ micocomputer with genlock board. (http://www.veoh.com/videos/e6820952kjjPX4)

==Further reading==
* {{cite journal|last1=Collopy|first1=Peter Sachs|title=Video Synthesizers: From Analog Computing to Digital Art|journal=IEEE Annals of the History of Computing|date=October 2014|volume=36|issue=4|pages=74–86|doi=10.1109/MAHC.2014.62|s2cid=9590379}}

==External links==
{{usurped|1=[https://web.archive.org/web/20180817195635/https://www.audiovisualizers.com/toolshak/vsynths.htm AudioVisualizers.com historical archive of Video Synthesizer hardware. Now defunct, copy at archive,org]}}

{{Commons category-inline|Video synthesizers}}

[[Category:Video art]]
[[Category:Film and video technology]]