Sign In to Follow Application
View All Documents & Correspondence

Method And Device For Generating Real Time Interpretation Of A Video

Abstract: A method generating real-time interpretation of a video is disclosed. The method includes capturing, by a media capturing device, a region of attention of a user accessing the video from a screen associated with the media capturing device to determine an object of interest. The method also includes generating a text script from an audio associated with the video. The method further includes determining one or more subtitles from the text script based on the region of attention of the user. The method further includes generating a summarized content of the one or more subtitles based on a time lag between the video and the one or more subtitles. Moreover, the method includes rendering the summarized content in one or more formats to the user over the screen of the media capturing device. Fig. 1

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
30 June 2018
Publication Number
01/2020
Publication Type
INA
Invention Field
COMMUNICATION
Status
Email
bangalore@knspartners.com
Parent Application

Applicants

WIPRO LIMITED
Doddakannelli, Sarjapur Road, Bangalore

Inventors

1. VINUTHA BANGALORE NARAYANAMURTHY
No.12, MEI Colony, Laggere, Bangalore -560058
2. MANJUNATH RAMACHANDRA IYER
80, Sadhana, 2nd main, BSK 3rd stage, Katriguppe east, Bangalore-560085

Specification

Claims:WE CLAIMS:

1. A method of generating real-time interpretation of a video, the method comprising:
capturing, by a media capturing device, a region of attention of a user accessing the video from a screen of the media capturing device to determine an object of interest;
generating, by the media capturing device, a text script from an audio associated with the video;
determining, by the media capturing device, one or more subtitles from the text script based on the region of attention of the user;
generating, by the media capturing device, a summarized content of the one or more subtitles based on a time lag between the video and the one or more subtitles; and
rendering, by the media capturing device, the summarized content in one or more formats to the user over the screen of the media capturing device.

2. The method of claim 1, wherein the region of attention of the user is captured on user invocation of the media capturing device.

3. The method of claim 1, wherein capturing the region of attention of the user comprises:
measuring, by the media capturing device, at least one eye position of the user accessing the video.

4. The method of claim 3, wherein the at least one eye position of the user accessing the video is captured with an internal camera on the media capturing device that provides associated coordinates of the screen.

5. The method of claim 1, wherein determining the one or more subtitles from the text script comprises:
mapping, by the media capturing device, dialogues of the text script to characters in the video;
determining, by the media capturing device, one or more characters in the region of attention of the user; and
rendering, by the media capturing device, one or more dialogues of the one or more characters in the region of attention to the user as the one or more subtitles.

6. The method of claim 1, wherein the one or more formats of the summarized content of the one or more subtitles comprises at least one of a text format, and a sign language format.

7. The method of claim 1 and further comprising:
classifying, by the media capturing device, the user into one or more user types to address requirements of the user.

8. A media capturing device for generating real-time interpretation of a video, the media capturing device comprising:
a processor; and
a memory communicatively coupled to the processor, wherein the memory stores processor instructions, which, on execution, causes the processor to:
capture a region of attention of a user accessing the video from a screen of the media capturing device to determine an object of interest;
generate a text script from an audio associated with the video;
determine one or more subtitles from the text script based on the region of attention of the user;
generate a summarized content of the one or more subtitles based on a time lag between the video and the one or more subtitles; and
render the summarized content in one or more formats to the user over the screen of the media capturing device.

9. The media capturing device of claim 8, wherein the region of attention of the user is captured on user invocation of the media capturing device.

10. The media capturing device of claim 8, wherein capturing the region of attention of the user comprises:
measuring at least one eye position of the user accessing the video.
11. The media capturing device of claim 10, wherein the at least one eye position of the user accessing the video is captured with an internal camera on the media capturing device that provides associated coordinates of the screen.

12. The media capturing device of claim 8, wherein determining the one or more subtitles from the text script comprises:
mapping dialogues of the text script to characters in the video;
determining one or more characters in the region of attention of the user; and
rendering one or more dialogues of the one or more characters in the region of attention to the user as the one or more subtitles.

13. The media capturing device of claim 8, wherein the one or more formats of the summarized content of the one or more subtitles comprises at least one of a text format, and a sign language format.

14. The media capturing device of claim 8, wherein the processor instructions further cause the processor to
classify the user into one or more user types to address requirements of the user.

Dated this 30th day of June, 2018

R Ramya Rao
Of K&S Partners
Agent for the Applicant
IN/PA-1607
, Description:TECHNICAL FIELD
This disclosure relates generally to processing of videos, and more particularly to a method and device for generating real-time interpretation of a video.

Documents