Abstract: 3D viewing on True Colour LED Video Displays is realised through live video capture with two video cameras specially assembled to resemble the two eyes of a human being and processing and merging the images in real-time for generating 3D content for the LED display device; and viewing the content through a specially designed eye-wear. Using the state-of-the-art 2 Mega pixel portable webcams fitted to a fixed stand with rigid optical alignment resembling human eye-balls, the live video is captured simultaneously from both Left and Right eye cameras. The frames so captured are processed by applying proprietary 'Adaptive Color Coding Techniques' on each of the frames. The resultant frames are displayed on the target LED screen either of Standard aspect ratio of 4:3 or of Wide Screen aspect ratio of 16:9. Viewers wearing "Special Adaptive Color Coding Spectacles" can view the content on the LED screen in 3D mode. Proprietary indigenous solutions are employed to meet (Capturing, Processing and Displaying) resolutions of QVGA, VGA, SVGA and HD modes, both in standard / widescreen formats, with 25 frames per second (fps). The principle can be extended to higher Frame rates and to other resolution modes; to develop 3D LED Display viewable with naked eyes (without spectacles); and also to deploy dynamic stereoscopic techniques to display 2D content in 3D. When proprietary 4-in-l RGBY chip LEDs are used in the display (in place of 3-in-l RGB chip LEDs), the picture quality improves drastically (manifold). Several embodiments of 3D viewing techniques on the conventional 2D True Colour LED Video Displays were discussed in the prior art - in which schemes of content processing, Display device enhancements and viewing methodologies have been adopted in order that a viewer can experience the joy of seeing a 3D video content. Virtual 3D effects have been simulated and demonstrated on multiple segments of 2D display screens arranged in succession with the depth dimension in between. Manifestation of 3D in the True Colour LED Video Displays has also been achieved by means of deploying a proprietary 4-in-l RGBY chip LED in the display screens which encompasses the depth dimension of the image in addition to the colour, thereby augmenting the display with 3D capabilitiesPresent invention is based on the deployment of proprietary colour coding processes to develop the 3D content from 2 live camera inputs positioned precisely with a distance between them equal to the distance between the two eyes of a typical human being and feed to the True Colour LED Video Display screen or an LED TV; and use colour polarised eye-glasses for viewing 3D videos on the screens. In this method, two distinct frames produced from the two cameras, are processed and merged simultaneously to produce the effect of 3D and are presented to the two eyes by means of a pair of colour polarised filters. The viewer wears glasses of two different colour polarisations; the glasses pass two different images to the two eyes at any moment, together producing a 3D effect.
ANNEXUREI
COMPLETE SPECIFICATION
TITLE:
3D viewing on True Colour LED Video Display Screens through Real Time Live Video Capture & Processing
1) PRODUCT NAME:
3D viewing on True Colour LED Video Display Screens through Real Time Live Video Capture & Processing
2) OWNER OF PRODUCT AND ADDRESS:
Owner:
MIC Electronics Limited A Public Limited Company
Address:
A - 4/II, Electronic Complex, • Kushaiguda,
Hyderabad-500 062 INDIA.
Email: info@mic.co.in
Tel:+91 40 27122222 Fax:+91 40 27133333
Field of research:
3D Content Processing, Display and Viewing methodologies for True colour LED displays
3) OBJECTS OF THE INVENTION:
The proposed invention is a realisation of 3D technology in the True Colour LED Video Displays through content processing, display and viewing techniques. The invention is aimed at enhancing the functioning of the true colour LED displays (including LED TV) with 3D features for use in both indoor and OOH applications like movie theatres and function halls and in outdoor applications like drive-in theatres and large public gatherings.
4) BACKGROUND ART or PRIOR ART:
True colour LED displays, built around RGB pixels are essentially 2D devices. The following co-pending patent applications by the inventor describe in detail two commercial applications of the true colour LED Displays viz. LED DigiPoster and LED TV :
Intelligent LED 'Poster' System - LED DigiPoster 262l/CHE/2008
Dt:28.10.2008
LED TV 2141/CHE/2009
Dt:04.09.2009
A method of visualising 3D effect in the otherwise 2D true colour LED displays, has been devised by introducing the depth dimension externally, through an arrangement of portions of the screen (like arches of increasing / decreasing sizes) with separation in between in the third dimension. The holistic images depicted on the screen will have physical separation between different screen segments, which is not noticeable by the viewer, but is perceived as depth within the image, giving rise to 3D viewing experience. The following co-pending patent application by the inventor describes the processes in detail for this typical application:
A 3D display / video backdrop comprising of
LED display for theatre stage or TV/FILM
Production studio 2523/CHE/2010A
Dt:30.08.2010
The 3D viewing effect on the True colour LED video displays is also achieved by suitably modifying the content, the display hardware / software and the add-ons / auxiliaries like viewing glasses and the special purpose optical film / sheet that provides the polarisation or auto-stereoscopic effect. These methodologies for 3D viewing on True colour LED Displays have been covered in the following co-pending patents by the inventor:
3D Viewing experience through true colour LED displays 3782/CHE/2010
Dt:10.12.2010
using passive polarised glasses
3D Viewing experience through true colour LED displays 3783/CHE/2010
Dt:10.12.2010
using active shutter glasses
3D Viewing experience through autostereoscopic 42/CHE/2011 Dt:15.02.2011
true colour LED display without using glasses
Development of True Colour 3D LED Video Display using a specially designed proprietary 4-in-l chip LED with 4 LEDs - RGB for colour plus another LED Y to represent the depth data - (in place of the basic 3-in-l RGB chip LED) with a built in feature of simultaneous 3D / 2D viewing option, enabling viewers to see 3D images with eye glasses; and 2D images without glasses, has been discussed in the following co-pending patent by the inventor:
3D Viewing experience through true colour LED displays 2914/CHE/2011 Dt:25.08.2011
with simultaneous 3D / 2D viewing option
LCD and Plasma display devices are also being equipped with 3D technology in a limited way, up to screen sizes of 51 inches for home entertainment with narrow view angles and shorter viewing distances.
The present invention facilitates 3D viewing on larger LED display screens, and in particular LED TVs, with associated advantages of the LED technology viz. high brightness, intensity, colour, contrast, sharpness of image, daylight visibility, wider view angles and viewability from a distance.
5) SUMMARY OF THE INVENTION:
The 3D viewing experience in respect of the true colour LED displays is achieved by processing and merging the two distinct frames grabbed simultaneously from two live video cameras and feeding the resulting frame to the video display and deploying colour filters at the eye glasses for viewing. Present invention deploys two video cameras placed in a rigid frame resembling the two eyeballs, to simultaneously capture a set of two frames of the image which are processed and merged to produce the 3D content. A proprietary scheme of colour coding technique is used both for processing the inputs as well as for designing the colour filters (Red for left and Blue for right) for the eye-wear.
6) DESCRIPTION:
True Colour LED Video Display is a matrix form of arrangement of LED pixels made up of either 3-in-l RGB chip LED or a cluster of 3 or 4 RGB LEDs. The Display facilitates text, animated graphics and videos to be displayed and viewed in 2D. The display screens are used for both indoor and Out Of Home applications as well as outdoors. In order to view 3D videos, it is necessary that the content is processed for 3D, the display device is augmented with 3D capabilities and suitable eye-wear is adopted at the viewer's eyes.
In the present invention, 3D viewing on True Colour LED Video Display is realised by producing 3D content in real-time by live video capturing; feeding to the display device; and viewing by means of specially designedeye-wear. Using the state-of-the-art 2 mega pixel portable webcams fitted to a fixed stand with rigid optical alignment resembling human eye-balls, the live video is captured simultaneously from both Left and Right eye cameras. The frames so captured are processed by applying a set of proprietary 'Adaptive Color Coding Techniques' on each of the frames. The resultant frames are displayed on the target LED screen either of Standard aspect ratio of 4:3 or of Wide Screen aspect ratio of 16:9. Viewers wearing "Special Adaptive Color Coding Spectacles" can view the content on the LED screen in 3D mode. Proprietary indigenous solutions are employed to meet Capturing, Processing and Displaying resolutions of QVGA, VGA, SVGA and HD modes, both in standard / widescreen formats, with 25 frames per second (fps). When proprietary 4-in-l chip LEDs (RGBY LEDs) are used in the display, the picture quality improves drastically (manifold).
The principle can be extended to higher Frame rates and to other resolution modes; to develop 3D LED Displays viewable with naked eyes (without any eye-wear); and also to deploy dynamic stereoscopic techniques to display 2D content in 3D.
The True Colour LED Video Displays in this 3D configuration can be used in both indoor / OOH applications and outdoor fixed or mobile-video (LED screens mounted on mobile vehicles) applications.
The arrangement is shown in the Photographs / Pictures in the following section.
7) 3D CONTENT PROCESSING:
Each frame is of same size A x B; [ A - number of PIXELs in a ROW & B - number of PIXELs in a COLUMN ]. Each PIXEL contains Red, Green & Blue sub-pixels. For the resultant frame, for each color sub-pixels, the value is derived from the combination of the weight factors multiplying the Left & Right color sub-pixel values. For some of the sub-pixel values, the weight factors may be ZERO. Depending on the combination of the sub-pixel values considered and the corresponding weight factors, the COLOR polarization values to be considered for LEFT & RIGHT EYE spectacles are going to be changed. The combination of "weight factor values" & "consideration of sub-pixels" are given as USER configurable for meeting different possibilities of using various kinds of "color polarization viewing glasses".
TF.Red = (m_fAl*LF.Red + m_fA2*LF.Green + m_fA3*LF.Blue) + (m_ffll*RF.Red + m_fB2*RF.Green + m_fB3*RF.Blue)
TF.Blue = (m_fCl*LF.Red + m_fC2*LF.Green + m_fC3*LF.Blue) + (m_fDl*RF.Red + m_fl)2*RF.Green + m_fD3*RF.Blue)
TF.Green = (m_fEl*LF.Red + m_fE2*LF.Green + m_fE3*LF.Blue) + (m_fFl*RF.Red + m_fF2*RF.Green + m_fF3*RF.Blue)
[TF -> TARGET FRAME; LF -> LEFT FRAME; RF -> RIGHT FRAME]
Video processing
The video signal captured by different input interfaces is processed for de-interlacing; scaling, including sharpness improvement; and the frame rate conversion. This is followed by the display-signal-processing technologies, such as contrast, brightness and saturation. Finally display-specific signal processing functions are carried out.
8) TARGETED SPECIFICATIONS:
1. Indoors & Out Of Home (OOH)
Sizes Modular
Typical LED TV 102" (90" Width & 48" Height)
Pixel 3-in-1 RGB chip LED; 4-in-1 RGB Y chip LED (future)
Pitch 4mm (9mm, 6mm and 3mm are also available)
Resolution 480 X 256
No. of LEDs 122,880
2. Outdoors
Sizes Modular - any size - virtually unlimited
Pixel 3 or 4 RGB LED cluster; 4-in-1 RGBY chip LED (future)
Pitch 9mm, 12mm, 14mm, 21mm, 25mm and 40mm
3. Inputs 2 Live Cameras optically alligned and separated by a distance equal to the separation between the two eyes of a human-being, capturing and presenting two video frames simultaneously
4. Content Processing Proprietary technology - 'Adaptive Colour Coding Techniques'
For processing and merging the two camera frames into one
5. Aspect Ratios Standard Definition - 4:3 and High Definition (HD) -16:9
6. Format Conventional (QVGA, SVGA, VGA) or HD Ready
7. Audio Supports Commercial Dolby Sound Systems
8. IP IP65 (Outdoors)
9. Installation
Indoors Uni-Pole or Bi-Pole or Tri-Pole mounted
Outdoors - Fixed Uni-Pole or Bi-Pole or Tri-Pole or Structure mounted
Mobile Truck or Trolley mounted
10. Power Operates on 230V AC or Generator
6) CLAIMS:
We Claim:
1. A method of viewing 3D videos on the True Colour LED Video Displays through Live Video Capture and Content Processing in Real Time employing a proprietary content processing technique and viewing the 3D content on the screen through colour polarised eye-wear.
2. The method of claim 1, wherein two video cameras, rigidly positioned with an optical alignment of distance of separation equal to the distance between the two eyes of a human being, simultaneously capture the image as two distinct frames and offer for processing.
3. The method of claim 1, wherein the two frames grabbed by the two video cameras are processed and merged into one by proprietary 'Adaptive Colour Coding Techniques' and is fed to the True Colour LED Video Display at the input.
4. The method of claim 1, wherein, with the inputs as above, the True Colour LED Video Display, presents a 3D image to the viewer.
5. The method of claim 1, wherein a pair of colour polarised eye-glasses are deployed for viewing the content in 3D.
6. The method of claim 1, wherein the True Colour LED Video Displays in this configuration can be used in both indoor / OOH applications and outdoor fixed or mobile-video (LED screens mounted on mobile vehicles) applications.
7. The method of claim 1, wherein the True Colour LED Video Displays are IP65 rated for outdoor use.
8. The method of claim 1, wherein the True Colour LED Video Displays support commercial audio and video modes like QVGA, SVGA, VGA and HD with standard 4:3 and wide screen 16:9 formats.
9. The method of claim 1, wherein the True Colour LED Video Displays, when proprietary 4-in-l RGBY chip LEDs are used, will have greatly enhanced image quality and contrast.
| # | Name | Date |
|---|---|---|
| 1 | 4192-CHE-2011 DESCRIPTION(COMPLETE) 02-12-2011.pdf | 2011-12-02 |
| 1 | 4192-CHE-2011-AbandonedLetter.pdf | 2020-01-31 |
| 2 | 4192-CHE-2011-FER.pdf | 2019-07-26 |
| 2 | 4192-CHE-2011 CORRESPONDENCE OTHERS 02-12-2011.pdf | 2011-12-02 |
| 3 | 4192-CHE-2011 CLAIMS 02-12-2011.pdf | 2011-12-02 |
| 3 | 4192-CHE-2011-Correspondence-PA-161215.pdf | 2016-06-10 |
| 4 | 4192-CHE-2011-Power of Attorney-161215.pdf | 2016-06-10 |
| 4 | 4192-CHE-2011 FORM-5 02-12-2011.pdf | 2011-12-02 |
| 5 | Description(Complete) [01-12-2015(online)].pdf | 2015-12-01 |
| 5 | 4192-CHE-2011 FORM-2 02-12-2011.pdf | 2011-12-02 |
| 6 | 4192-CHE-2011 FORM-1 02-12-2011.pdf | 2011-12-02 |
| 7 | 4192-CHE-2011 DRAWINGS 02-12-2011.pdf | 2011-12-02 |
| 8 | 4192-CHE-2011 ABSTRACT 02-12-2011..pdf | 2011-12-02 |
| 9 | 4192-CHE-2011 POWER OF ATTORNEY 02-12-2011.pdf | 2011-12-02 |
| 10 | Other Document [01-12-2015(online)].pdf | 2015-12-01 |
| 11 | Marked Copy [01-12-2015(online)].pdf | 2015-12-01 |
| 12 | Form 13 [01-12-2015(online)].pdf | 2015-12-01 |
| 13 | Description(Complete) [01-12-2015(online)].pdf | 2015-12-01 |
| 14 | 4192-CHE-2011-Power of Attorney-161215.pdf | 2016-06-10 |
| 15 | 4192-CHE-2011-Correspondence-PA-161215.pdf | 2016-06-10 |
| 16 | 4192-CHE-2011-FER.pdf | 2019-07-26 |
| 17 | 4192-CHE-2011-AbandonedLetter.pdf | 2020-01-31 |
| 1 | 4192_CHE_2011_Search_Strategy_25-07-2019.pdf |