imported>Remsense: Reverted 3 edits by 2403:6200:8850:1301:79CE:8D7B:806E:9668 (talk) to last revision by GreenC bot

2025-01-28T18:03:27Z

Reverted 3 edits by 2403:6200:8850:1301:79CE:8D7B:806E:9668 (talk) to last revision by GreenC bot

New page

{{Short description|Extension to 3D film television standards}}
{{Multiple issues|
{{More citations needed|date=July 2011}}
{{Tone|talk=Discussion of tone issues|date=January 2015}}
}}
{{Use dmy dates|date=July 2015}}

'''Multi View Video Coding''' ('''MVC''', also known as '''MVC 3D''') is a [[stereoscopic video coding]] standard for [[Video coding format|video compression]] that allows for encoding video sequences captured simultaneously from multiple camera angles in a single video stream.<ref>https://research.nokia.com/page/4988 {{Webarchive|url=https://web.archive.org/web/20150716013225/https://research.nokia.com/page/4988 |date=16 July 2015 }} Mobile 3D Video</ref> It uses the [[2D plus Delta]] method and it is an amendment to the [[H.264/MPEG-4 AVC|H.264 (MPEG-4 AVC)]] video compression standard, developed jointly by [[Moving Picture Experts Group|MPEG]] and [[Video Coding Experts Group|VCEG]],<ref>{{cite web |url=http://enpub.fulton.asu.edu/resp/vpqm/vpqm10/Proceedings_VPQM2010/vpqm_p33.pdf |title=Archived copy |access-date=2011-01-13 |url-status=dead |archive-url=https://web.archive.org/web/20110719142054/http://enpub.fulton.asu.edu/resp/vpqm/vpqm10/Proceedings_VPQM2010/vpqm_p33.pdf |archive-date=19 July 2011 |df=dmy-all }} 3DTV AT HOME: STATUS, CHALLENGES AND SOLUTIONS FOR DELIVERING A HIGH QUALITY EXPERIENCE</ref> with the contributions from a number of companies, such as [[Panasonic]] and [[LG Electronics]].<ref name="mpegla"/>

MVC formatting is intended for encoding [[stereoscopy|stereoscopic]] (two-view) [[3D video]], as well as [[free viewpoint television]] and multi-view [[3D television]]. The Stereo High profile has been standardized in June 2009; the profile is based on the MVC tool set and is used in stereoscopic [[Blu-ray Disc#Blu-ray 3D|Blu-ray 3D]] releases.<ref>{{Cite web |title=mpeg4-mvc - 3D Vision Blog |url=https://3dvision-blog.com/tag/mpeg4-mvc/ |access-date=2023-03-08}}</ref>

==Technical overview==
MVC is based on the idea that video recordings of the same scene from multiple angles share many common elements. It is possible to encode all simultaneous frames captured in the same [[elementary stream]] and to share as much information as possible across the different layers. This can reduce the size of the encoded video.<ref>https://wiki.libav.org/Blueprint/MultiAVFrame Libav MultiAVFrame Blueprint</ref><ref>{{cite book | last1=Ijsselsteijn | first1=Wijnand A. | last2=Seuntiëns | first2=Pieter J.H. | last3=Meesters | first3=Lydia M.J. | title=3D Videocommunication | chapter=Human Factors of 3D Displays | publisher=John Wiley & Sons, Ltd | location=Chichester, UK | date=2006-01-03 | isbn=978-0-470-02273-3 | doi=10.1002/0470022736.ch12 | pages=217–233}}</ref>

Multiview video contains a large amount of inter-view statistical dependencies, since all cameras capture the same scene from different viewpoints. Therefore, combined temporal and inter-view prediction is important for efficient MVC encoding. A frame from a certain camera can be predicted not only from temporally related frames from the same camera, but also from the frames of neighboring cameras. These interdependencies can be used for efficient prediction.<ref>[http://www.chiariglione.org/mpeg/technologies/mpeg-4/mp04-mvc/index.htm MPEG – Technologies – Introduction to Multiview Video Coding]</ref><ref>http://vision.princeton.edu/projects/2008/ECCV_stereo/paper_low-res.pdf Learning Two-View Stereo Matching</ref><ref>http://cs.nyu.edu/~fergus/teaching/vision_2012/6_Multiview_SfM.pdf Lecture 6: Multi-view Stereo & Structure from Motion</ref>

The method for this is used in Multiview Video Coding for Blu-ray 3D movies is known as the 2D plus Delta algorithm, and the MVC specification itself is part of the H.264 standard as an amendment in H.264 “Annex H” of the specification.<ref>http://www.itu.int/rec/T-REC-H.264 H.264 : Advanced video coding for generic audiovisual services</ref>

==Open source support mostly missing==
{{Importance section|date=December 2020}} 
As of April 2015, there is no [[free and open-source software]] that supports software decoding of the MVC video compression standard.<ref name=":0">{{Cite book|url=https://www.researchgate.net/publication/4290624|year=2007 |language=en|doi=10.1109/IWSSIP.2007.4381085|last1=Ho |first1=Yo-Sung |last2=Oh |first2=Kwan-Jung |title=2007 14th International Workshop on Systems, Signals and Image Processing and 6th EURASIP Conference focused on Speech and Image Processing, Multimedia Communications and Services |chapter=Overview of Multi-view Video Coding |pages=5–12 |isbn=978-961-248-036-3 |s2cid=453153 }}</ref> Popular open source H.264 and [[High Efficiency Video Coding|HEVC (H.265)]] decoders, such as those used in the [[FFmpeg]] and [[Libav]] libraries, simply ignore the second view and thus do not show the second view for stereoscopic views. In most cases, the reason for this support not being added is that MVC was not considered when the initial core H.264 and HEVC decoders code was written. Later amendment would as such often mean a lot of prerequisite [[code refactoring]] work and large changes its current architecture, with major work in untangling and reordering some code, and splitting different functions in existing decoder code into smaller chunks for simpler handling to in turn then make amendments such as MVC easier to add.<ref>blogs.gentoo.org/lu_zero/2014/04/04/the-road-to-mvc/ The road to MVC</ref>

Some [[proof-of-concept]] work has however been done downstream in the past, but never made it upstream into official releases of [[FFmpeg]] or [[Libav]].<ref>http://www.nt.uni-saarland.de/fileadmin/file_uploads/theses/master/Optimized_implementation_of_a_MVC_decoder.pdf {{Webarchive|url=https://web.archive.org/web/20160304070303/http://www.nt.uni-saarland.de/fileadmin/file_uploads/theses/master/Optimized_implementation_of_a_MVC_decoder.pdf |date=4 March 2016 }} Jochen Britz – Optimized implementation of an MVC decoder – Master’s Thesis in Computer and Communication Technology</ref><ref>https://github.com/Britz/FFmpeg Britz – In terms of my master thesis, I work on a H.264 MVC implementation in libvacodec based on H.264 Annex H.</ref>

On March 8, 2016, the situation improved. Version 0.68 of the DirectShow Media Splitter and Decoders Collection [[LAV Filters]]<ref>https://github.com/Nevcairiel/LAVFilters GitHub repository of LAV Filters project Retrieved 2016-03-30</ref> was released by developer "Nevcairiel" (who also works for [[Media Player Classic]] — Home Cinema ([[MPC-HC]])) with support of H.264 MVC 3D demuxing and decoding. With the aid of this release and FRIM <ref>http://www.videohelp.com/software/FRIM Videohelp download page Retrieved 2016-03-30</ref> written by a programmer named “videohelp3d” <ref>http://forum.doom9.org/showthread.php?t=169651 developers page of "videohelp3d" Retrieved 2016-03-30</ref> it is possible to write an [[AviSynth]] script to pre process a H.264 MVC 3D video clip which can then be opened by free 3D video player [[Bino (software)|Bino]]<ref>http://bino3d.org/index.html Home page of Bino - a free 3D video player Retrieved 2016-03-30</ref> and then shown as red — cyan anaglyph video for example.<ref name=":0" />

The usage of the FRIM AviSynth plugin (FRIMSource) is described on “videohelp3d” home page. LAV Filters can be used to get audio from H.264 MVC 3D video clip. The developer <ref>http://forum.doom9.org/showthread.php?t=156191&page=1029 developers page of "Nevcairiel" (at bottom of page) Retrieved 2016-03-30</ref> posted that in a future release of, it might be possible that LAV Video renders the video as Side-by-Side directly.<ref>{{Citation|last=CrendKing|title=AviSynth Filter and VapourSynth Filter|date=2022-02-10|url=https://github.com/CrendKing/avisynth_filter|access-date=2022-02-10}}</ref>

== Patent holders ==
The following organizations hold [[patent]]s that contributed to the development of MVC technology, listed in a [[patent pool]] by [[MPEG LA]].<ref>{{Cite web|title=Media: Licensing Programs|url=https://www.mpegla.com/media/|access-date=2022-02-10|website=MPEG LA|language=en-US}}</ref>

{| class="wikitable sortable"
!Organization<ref>{{cite web |title=Licensors Included in the MVC Patent Portfolio License |url=https://www.mpegla.com/programs/mvc/licensors/ |website=MPEG LA |access-date=11 July 2019}}</ref>
!Active patents
!Expired patents
!Total patents<ref name="mpegla">{{cite web |title=MVC Patent List |url=https://www.mpegla.com/wp-content/uploads/MVC-att1.pdf |website=[[MPEG LA]] |access-date=11 July 2019}}</ref>
|-
|[[Panasonic]]
|607
|41
|648
|-
|[[LG Electronics]]
|85
|2
|87
|-
|[[Dolby Laboratories]]
|77
|3
|80
|-
|[[Fraunhofer Society|Fraunhofer]]
|65
|0
|65
|-
|[[Fujitsu]]
|59
|3
|62
|-
|[[Mitsubishi Electric]]
|28
|21
|49
|-
|[[General Electric|GE]]
|31
|0
|31
|-
|[[Tagivan II LLC]]
|27
|0
|27
|-
|[[Siemens]]
|14
|9
|23
|-
|[[Columbia University]]
|0
|17
|17
|-
|[[Maxell]]
|14
|0
|14
|-
|[[Thomson Multimedia|Thomson]] Licensing
|0
|14
|14
|-
|[[KPN|Koninklijke KPN N.V.1]]
|0
|13
|13
|-
|[[Nippon Telegraph and Telephone]]
|8
|0
|8
|-
|[[NTT Docomo]]
|6
|0
|6
|-
|[[Sony]]
|5
|0
|5
|-
|[[Electronics and Telecommunications Research Institute]]
|2
|1
|3
|-
|[[HP Inc.]]
|0
|1
|1
|}

==See also==
* [[2D plus Delta]]
* [[2D-plus-depth]]
* [[Stereoscopic video coding]]
* [[Digital 3D]]
* [[Stereoscopic]]
* [[TDVision]]
* [[3D television]]
* [[3D display]]
* [[3-D film]]
* [[Crosstalk]]
* [[Stereoscopy]]
* [[Blu-ray#Blu-ray 3D|3D Blu-ray Disc]]
* [[List of 3D films]]

==References==
{{Reflist}}

==External links==
* [https://web.archive.org/web/20160303192643/http://www.merl.com/projects/multiview-coding/ Mitsubishi Electric Research Laboratories – Multiview Video Coding project]
* [http://mpeg.chiariglione.org/standards/mpeg-4/advanced-video-coding MPEG – Technologies – Introduction to Multiview Video Coding]
* [http://www.chiariglione.org/mpeg/technologies/general/mp-3dv/index.htm MPEG – Technologies – Introduction to 3D Video] {{Webarchive|url=https://web.archive.org/web/20100113063138/http://www.chiariglione.org/mpeg/technologies/general/mp-3dv/index.htm |date=13 January 2010 }}
* [http://www.chiariglione.org/mpeg/visions/3dv/index.htm MPEG – Visions – 3D Video Vision] {{Webarchive|url=https://web.archive.org/web/20100116095609/http://www.chiariglione.org/mpeg/visions/3dv/index.htm |date=16 January 2010 }}
* [https://web.archive.org/web/20090530083406/http://research.nokia.com/research/mobile3D Nokia Research Center – Mobile 3D Video project and MVC source code]
* [http://www.netblender.com/main/products/dostudio-mvc-3d-encoder/quicklook/ NetBlender – MVC encoding solution for 3D Blu-ray authoring]
*TDVision Systems, Inc – Stereoscopic decoding patents:
** [https://archive.today/20120805234156/http://www.wipo.int/pctdb/en/wo.jsp?WO=2005083636 TDVision Systems, Inc – Stereoscopic encoding patent]
** [https://archive.today/20121212005425/http://www.wipo.int/pctdb/en/wo.jsp?wo=2005083637 TDVision Systems, Inc – Stereoscopic decoding patent]

{{Stereoscopy}}
{{Compression formats}}
{{MPEG}}
{{High-definition}}

[[Category:3D imaging]]
[[Category:IEC standards]]
[[Category:ISO standards]]
[[Category:MPEG-4]]
[[Category:Open standards covered by patents]]
[[Category:Video codecs]]
[[Category:Video compression]]

Multiview Video Coding - Revision history

imported>Remsense: Reverted 3 edits by 2403:6200:8850:1301:79CE:8D7B:806E:9668 (talk) to last revision by GreenC bot