Sign In to Follow Application
View All Documents & Correspondence

A Method And A System For Multimodal Search Key Based Multimedia Content Extraction

Abstract: A method and a system are described for multimodal search key based multimedia content extraction. The method includes receiving a multimedia content search request for a multimedia content, where the search request includes multimodal inputs in one or more fragments. The one or more fragments are interleaved to a composite fragment by removing overlapping content from the one or more fragments. The composite fragment is tagged to one or more attributes associated with the multimedia content based on a deep-learning of a context associated with the composite fragment. The method further includes identifying from a multimedia content database a correlation between the composite fragment and the multimedia content based on the context, where the multimedia content is stored in the multimedia content database. The method includes extracting the multimedia content identified from the multimedia content database. FIG. 2

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
28 March 2019
Publication Number
40/2020
Publication Type
INA
Invention Field
COMMUNICATION
Status
Email
bangalore@knspartners.com
Parent Application

Applicants

WIPRO LIMITED
Doddakannelli, Sarjapur Road, Bangalore 560035, Karnataka, India.

Inventors

1. MANJUNATH RAMACHANDRA IYER
80, Sadhana, 2nd Main, BSK 3rd Stage, Katriguppe East, Bangalore 560085, Karnataka, India.

Specification

Claims:WE CLAIM:

1. A method of multi-modal search key based multimedia content extraction, the method comprising:
receiving, by a search key generator device, a multimedia content search request for a multimedia content, wherein the multimedia content search request comprises multimodal inputs in one or more fragments and wherein the one or more fragments comprises at least one of a text fragment, an image fragment, an audio fragment and a video fragment;
interleaving, by the search key generator device, the one or more fragments to a composite fragment by removing overlapping content from the one or more fragments;
tagging, by the search key generator device, the composite fragment to one or more attributes associated with the multimedia content based on a deep-learning of a context associated with the composite fragment;
identifying, by the search key generator device, from a multimedia content database a correlation between the composite fragment and the multimedia content based on the context, wherein the multimedia content is stored in the multimedia content database, and wherein searching for the correlation comprises comparing the context of the composite fragment to a context of the multimedia content; and
extracting, by the search key generator device, the multimedia content identified from the multimedia content database based on comparing the context of the composite fragment to the context of the multimedia content.
2. The method of claim 1, wherein one of the multimodal inputs further acts as a modifier to the multimedia content search request.
3. The method of claim 1, wherein the one or more attributes associated with the multimedia content comprises at least one of a name, a name of a place, a color, a verb, and an adjective.
4. The method of claim 1, wherein the deep learning further comprises:
determining the one or more attributes associated with the multimedia content;
populating the multimedia content database based on the one or more attributes;
assigning a common label to the composite fragment based on the common context;
denominating weightages to the one or more fragments in the composite fragment based on the multimedia content search request, the attributes and the context; and
altering the weightages based on receiving the one of the multimodal inputs multimodal inputs as modifier.
5. The method of claim 1, wherein extraction comprises formatting the multimedia content extracted, wherein formatting further comprises at least synchronizing the audio fragment with the video fragment, and associating the text format and the image format to the synchronized audio format and video format.
6. A search key generator device for recommending products to a user comprising:
a processor; and
a memory communicatively coupled to the processor, wherein the memory stores processor executable instructions, which on execution causes the processor to:
receive a multimedia content search request for a multimedia content, wherein the multimedia content search request comprises multimodal inputs in one or more fragments and wherein the one or more fragments comprises at least one of a text fragment, an image fragment, an audio fragment and a video fragment;
interleave the one or more fragments to a composite fragment by removing overlapping content from the one or more fragments;
tag the composite fragment to one or more attributes associated with the multimedia content based on a deep-learning of a context associated with the composite fragment;
identify from a multimedia content database a correlation between the composite fragment and the multimedia content based on the context, wherein the multimedia content is stored in the multimedia content database, and wherein searching for the correlation comprises comparing the context of the composite fragment to a context of the multimedia content; and
extract the multimedia content identified from the multimedia content database based on comparing the context of the composite fragment to the context of the multimedia content.
7. The search key generator device of claim 6, wherein one of the multimodal inputs further acts as a modifier to the multimedia content search request.

8. The search key generator device of claim 6, wherein the one or more attributes associated with the multimedia content comprises at least one of a name, a name of a place, a color, a verb, and an adjective.
9. The search key generator device of claim 6, wherein the deep learning further comprises:
determining the one or more attributes associated with the multimedia content;
populating the multimedia content database based on the one or more attributes;
assigning a common label to the composite fragment based on the common context;
denominating weightages to the one or more fragments in the composite fragment based on the multimedia content search request, the attributes and the context; and
altering the weightages based on receiving the one of the multimodal inputs multimodal inputs as modifier.

10. The search key generator device of claim 6, wherein extraction comprises formatting the multimedia content extracted, wherein formatting further comprises at least synchronizing the audio fragment with the video fragment, and associating the text format and the image format to the synchronized audio format and video format.

Dated this 28th day of March, 2019

Madhusudan S.T
Of K&S Partners
Agent for the Applicant
IN/PA-1297
, Description:TECHNICAL FIELD
[0001] The present subject matter is related, in general, to information retrieval, but not exclusively, to a method and a system for multimodal search key based multimedia content extraction.

Documents

Application Documents

# Name Date
1 201941012249-Request Letter-Correspondence [04-02-2019(online)].pdf 2019-02-04
2 201941012249-Power of Attorney [04-02-2019(online)].pdf 2019-02-04
3 201941012249-Form 1 (Submitted on date of filing) [04-02-2019(online)].pdf 2019-02-04
4 201941012249-STATEMENT OF UNDERTAKING (FORM 3) [28-03-2019(online)].pdf 2019-03-28
5 201941012249-REQUEST FOR EXAMINATION (FORM-18) [28-03-2019(online)].pdf 2019-03-28
6 201941012249-POWER OF AUTHORITY [28-03-2019(online)].pdf 2019-03-28
7 201941012249-FORM 18 [28-03-2019(online)].pdf 2019-03-28
8 201941012249-FORM 1 [28-03-2019(online)].pdf 2019-03-28
9 201941012249-DRAWINGS [28-03-2019(online)].pdf 2019-03-28
10 201941012249-DECLARATION OF INVENTORSHIP (FORM 5) [28-03-2019(online)].pdf 2019-03-28
11 201941012249-COMPLETE SPECIFICATION [28-03-2019(online)].pdf 2019-03-28
12 201941012249-Proof of Right (MANDATORY) [20-09-2019(online)].pdf 2019-09-20
13 Correspondence by Agent_Form 1_27-09-2019.pdf 2019-09-27
14 201941012249-FER.pdf 2021-10-17

Search Strategy

1 2021-03-1611-13-45E_16-03-2021.pdf