Method And System For Generating A Contextual Audio Related To An Image

Wipro Limited
Granted App No 201741023038 Patent 430123 Computer Science

Patent information

IP India · live record
Application number
201741023038
Filing date
30 June 2017
Status
Granted
Legal status
Inforce
Publication number
01/2019
Publication type
INA
Invention field
Computer Science
Patent number
430123
Grant date
26 April 2023
Next renewal due
30 June 2026Overdue

Abstract

Disclosed subject matter relates to digital media including a method and system for generating a contextual audio related to an image. An audio generating system may determine scene-theme and viewer theme of scene in the image. Further, audio files matching scene-objects and the contextual data may be retrieved in real-time and relevant audio files from audio files may be identified based on relationship between scene-theme, scene-objects, viewer theme, contextual data and metadata of audio files. A contribution weightage may be assigned to the relevant and substitute audio files based on contextual data and may be correlated based on contribution weightage, thereby generating the contextual audio related to the image. The present disclosure provides a feature wherein the contextual audio generated for an image may provide a holistic audio effect in accordance with context of the image, thus recreating the audio that might have been present when the image was captured. FIG.2

Applicants

1
India
WIPRO LIMITED Doddakannelli, Sarjapur Road, Bangalore 560035, Karnataka, India.

Inventors

4
India
ADRITA BARARIBlock B-16/249, Kendriya Vihar, VIP Road, Haldirams bus stop, Koikhali, Kolkata -700052, West Bengal, India.
India
MANJUNATH RAMACHANDRA80, Sadhana, 2nd main, BSK 3rd stage, Katriguppe East, Bangalore-560085, Karnataka, India.
India
GHULAM MOHIUDDIN KHANF-901, Concorde Manhattans, Electronic City Phase 1, Bangalore -560100, Karnataka, India.
India
SETHURAMAN ULAGANATHAN#76/3, South Vaikolkara Street, Woraiyur (PO), Ramalinga Nagar, Tiruchirapalli (DT), Tamil Nadu 620003, India.

Claims

16
1 A method of generating a contextual audio related to an image, the method comprising: determining, by an audio generating system (107), scene-theme of a scene in the image by analysing the image received from an image repository (103), wherein the scene-theme is determined based on key image features in the image and one or more scene-objects, corresponding to the key image features, in the image; determining, by the audio generating system (107), a viewer theme of the image based on contextual data (213) associated with the image; retrieving, by the audio generating system (107), one or more audio files matching the one or more scene-objects and the contextual data (213) in real-time by performing a real-time search using textual descriptions of the one or more scene-objects and the contextual data (213); identifying, by the audio generating system (107), one or more relevant audio files from the one or more audio files based on relationship between the scene-theme, the one or more scene-objects, the viewer theme, the contextual data (213) and metadata of the one or more audio files; assigning, by the audio generating system (107), a contribution weightage to each of the one or more relevant audio files and one or more substitute audio files based on the contextual data (213); and correlating, by the audio generating system (107), the one or more relevant audio files and the one or more substitute audio files based on the contribution weightage, thereby generating the contextual audio related to the image.
2 The method as claimed in claim 1, wherein the one or more scene-objects comprises information related to at least one of objects present in the scene, actions of the objects present in the scene and background of the objects present in the scene.
3 The method as claimed in claim 1, wherein the contextual data (213) comprises at least one of location, date, time and weather condition when the image is viewed, user profile data from social networking websites, user preferences and user inputs.
4 The method as claimed in claim 1, wherein the one or more substitute audio files are generated by the audio generating system (107) in real-time for the one or more relevant audio files when the metadata of the one or more audio files matches with metadata of the one or more relevant audio files.
5 The method as claimed in claim 1, wherein the one or more substitute audio files are generated to provide additional sound effects related to one or more unseen objects in the scene, wherein the one or more unseen objects are related to the scene.
6 The method as claimed in claim 1, wherein the contribution weightage is assigned based on level of contribution of each of the one or more relevant audio files and the one or more substitute audio files required for generating the contextual audio.
7 The method as claimed in claim 1 further comprises playing, by the audio generating system (107), the corresponding contextual audio when the image is viewed.
8 The method as claimed in claim 1 further comprises logging, by the audio generating system (107), the one or more relevant audio files and the one or more substitute audio files for self-learning of the audio generating system (107).
9 An audio generating system (107) for generating a contextual audio related to an image, the audio generating system (107) comprising: a processor (109); and a memory (113) communicatively coupled to the processor (109), wherein the memory (113) stores the processor-executable instructions, which, on execution, causes the processor (109) to: determine scene-theme of a scene in the image by analysing the image received from an image repository (103), wherein the scene-theme is determined based on key image features in the image and one or more scene-objects, corresponding to the key image features in the image; determine a viewer theme of the image based on contextual data (213) associated with the image; retrieve one or more audio files matching the one or more scene-objects and the contextual data (213) in real-time by performing a real-time search using textual descriptions of the one or more scene-objects and the contextual data (213); identify one or more relevant audio files from the one or more audio files based on relationship between the scene-theme, the one or more scene-objects, the viewer theme, the contextual data (213) and metadata of the one or more audio files; assign a contribution weightage to each of the one or more relevant audio files and one or more substitute audio files based on the contextual data (213); and correlate the one or more relevant audio files and the one or more substitute audio files based on the contribution weightage, thereby generating the contextual audio related to the image.
10 The audio generating system (107) as claimed in claim 9, wherein the one or more scene-objects comprises information related to at least one of objects present in the scene, actions of the objects present in the scene and background of the objects present in the scene.
11 The audio generating system (107) as claimed in claim 9, wherein the contextual data (213) comprises at least one of location, date, time and weather condition when the image is viewed, user profile data from social networking websites, user preferences and user inputs.
12 The audio generating system (107) as claimed in claim 9, wherein the processor (109) generates the one or more substitute audio files in real-time for the one or more relevant audio files when the metadata of the one or more audio files matches with metadata of the one or more relevant audio files.
13 The audio generating system (107) as claimed in claim 9, wherein the processor (109) generates the one or more substitute audio files to provide additional sound effects related to one or more unseen objects in the scene, wherein the one or more unseen objects are related to the scene.
14 The audio generating system (107) as claimed in claim 9, wherein the processor (109) assigns the contribution weightage based on level of contribution of each of the one or more relevant audio files and the one or more substitute audio files required for generating the contextual audio.
15 The audio generating system (107) as claimed in claim 9, wherein the processor (109) is further configured to play the corresponding contextual audio when the image is viewed.
16 The audio generating system (107) as claimed in claim 9 self-learns by logging the one or more relevant audio files and the one or more substitute audio files. Dated this 30th day of June 2017 SWETHA S N OF K & S PARTNERS AGENT FOR THE APPLICANT , Description:TECHNICAL FIELD The present subject matter relates generally to digital media, and more particularly, but not exclusively to a method and a system for generating a contextual audio related to an image.

Specification

Show full textCollapse

Claims:We claim: 1. A method of generating a contextual audio related to an image, the method comprising: determining, by an audio generating system (107), scene-theme of a scene in the image by analysing the image received from an image repository (103), wherein the scene-theme is determined based on key image features in the image and one or more scene-objects, corresponding to the key image features, in the image; determining, by the audio generating system (107), a viewer theme of the image based on contextual data (213) associated with the image; retrieving, by the audio generating system (107), one or more audio files matching the one or more scene-objects and the contextual data (213) in real-time by performing a real-time search using textual descriptions of the one or more scene-objects and the contextual data (213); identifying, by the audio generating system (107), one or more relevant audio files from the one or more audio files based on relationship between the scene-theme, the one or more scene-objects, the viewer theme, the contextual data (213) and metadata of the one or more audio files; assigning, by the audio generating system (107), a contribution weightage to each of the one or more relevant audio files and one or more substitute audio files based on the contextual data (213); and correlating, by the audio generating system (107), the one or more relevant audio files and the one or more substitute audio files based on the contribution weightage, thereby generating the contextual audio related to the image. 2. The method as claimed in claim 1, wherein the one or more scene-objects comprises information related to at least one of objects present in the scene, actions of the objects present in the scene and background of the objects present in the scene.

3. The method as claimed in claim 1, wherein the contextual data (213) comprises at least one of location, date, time and weather condition when the image is viewed, user profile data from social networking websites, user preferences and user inputs. 4. The method as claimed in claim 1, wherein the one or more substitute audio files are generated by the audio generating system (107) in real-time for the one or more relevant audio files when the metadata of the one or more audio files matches with metadata of the one or more relevant audio files.

5. The method as claimed in claim 1, wherein the one or more substitute audio files are generated to provide additional sound effects related to one or more unseen objects in the scene, wherein the one or more unseen objects are related to the scene.

6. The method as claimed in claim 1, wherein the contribution weightage is assigned based on level of contribution of each of the one or more relevant audio files and the one or more substitute audio files required for generating the contextual audio.

7. The method as claimed in claim 1 further comprises playing, by the audio generating system (107), the corresponding contextual audio when the image is viewed.

8. The method as claimed in claim 1 further comprises logging, by the audio generating system (107), the one or more relevant audio files and the one or more substitute audio files for self-learning of the audio generating system (107).

9. An audio generating system (107) for generating a contextual audio related to an image, the audio generating system (107) comprising:

a processor (109); and a memory (113) communicatively coupled to the processor (109), wherein the memory (113) stores the processor-executable instructions, which, on execution, causes the processor (109) to: determine scene-theme of a scene in the image by analysing the image received from an image repository (103), wherein the scene-theme is determined based on key image features in the image and one or more scene-objects, corresponding to the key image features in the image; determine a viewer theme of the image based on contextual data (213) associated with the image; retrieve one or more audio files matching the one or more scene-objects and the contextual data (213) in real-time by performing a real-time search using textual descriptions of the one or more scene-objects and the contextual data (213); identify one or more relevant audio files from the one or more audio files based on relationship between the scene-theme, the one or more scene-objects, the viewer theme, the contextual data (213) and metadata of the one or more audio files; assign a contribution weightage to each of the one or more relevant audio files and one or more substitute audio files based on the contextual data (213); and correlate the one or more relevant audio files and the one or more substitute audio files based on the contribution weightage, thereby generating the contextual audio related to the image. 10. The audio generating system (107) as claimed in claim 9, wherein the one or more scene-objects comprises information related to at least one of objects present in the scene, actions of the objects present in the scene and background of the objects present in the scene.

11. The audio generating system (107) as claimed in claim 9, wherein the contextual data (213) comprises at least one of location, date, time and weather condition when the image is viewed, user profile data from social networking websites, user preferences and user inputs.

12. The audio generating system (107) as claimed in claim 9, wherein the processor (109) generates the one or more substitute audio files in real-time for the one or more relevant audio files when the metadata of the one or more audio files matches with metadata of the one or more relevant audio files.

13. The audio generating system (107) as claimed in claim 9, wherein the processor (109) generates the one or more substitute audio files to provide additional sound effects related to one or more unseen objects in the scene, wherein the one or more unseen objects are related to the scene. 14. The audio generating system (107) as claimed in claim 9, wherein the processor (109) assigns the contribution weightage based on level of contribution of each of the one or more relevant audio files and the one or more substitute audio files required for generating the contextual audio.

15. The audio generating system (107) as claimed in claim 9, wherein the processor (109) is further configured to play the corresponding contextual audio when the image is viewed.

16. The audio generating system (107) as claimed in claim 9 self-learns by logging the one or more relevant audio files and the one or more substitute audio files.

Dated this 30th day of June 2017

SWETHA S N OF K & S PARTNERS AGENT FOR THE APPLICANT , Description:TECHNICAL FIELD The present subject matter relates generally to digital media, and more particularly, but not exclusively to a method and a system for generating a contextual audio related to an image.

Documents

Sign in to open
Application documents
1 Power of Attorney [30-06-2017(online)].pdf 30 Jun 2017
2 Form 5 [30-06-2017(online)].pdf 30 Jun 2017
3 Form 3 [30-06-2017(online)].pdf 30 Jun 2017
4 Form 18 [30-06-2017(online)].pdf_103.pdf 30 Jun 2017
5 Form 18 [30-06-2017(online)].pdf 30 Jun 2017
6 Form 1 [30-06-2017(online)].pdf 30 Jun 2017
7 Drawing [30-06-2017(online)].pdf 30 Jun 2017
8 Description(Complete) [30-06-2017(online)].pdf_104.pdf 30 Jun 2017
9 Description(Complete) [30-06-2017(online)].pdf 30 Jun 2017
10 REQUEST FOR CERTIFIED COPY [03-07-2017(online)].pdf 03 Jul 2017
11 201741023038-Proof of Right (MANDATORY) [01-09-2017(online)].pdf 01 Sep 2017
12 Correspondence by Agent_Form1_05-09-2017.pdf 05 Sep 2017
13 201741023038-FORM 3 [07-04-2021(online)].pdf 07 Apr 2021
14 201741023038-PETITION UNDER RULE 137 [12-04-2021(online)].pdf 12 Apr 2021
15 201741023038-FER_SER_REPLY [12-04-2021(online)].pdf 12 Apr 2021
16 201741023038-FER.pdf 17 Oct 2021
17 201741023038-US(14)-HearingNotice-(HearingDate-30-03-2023).pdf 07 Mar 2023
18 201741023038-POA [16-03-2023(online)].pdf 16 Mar 2023
19 201741023038-FORM 13 [16-03-2023(online)].pdf 16 Mar 2023
20 201741023038-Correspondence to notify the Controller [16-03-2023(online)].pdf 16 Mar 2023
21 201741023038-AMENDED DOCUMENTS [16-03-2023(online)].pdf 16 Mar 2023
22 201741023038-Written submissions and relevant documents [12-04-2023(online)].pdf 12 Apr 2023
23 201741023038-PatentCertificate26-04-2023.pdf 26 Apr 2023
24 201741023038-IntimationOfGrant26-04-2023.pdf 26 Apr 2023
Search strategy
12020-02-2618-25-09_26-02-2020.pdf

ERegister / renewals

Inforce
3rd Renewed 26 Oct 2023 Period 30 Jun 2019 – 30 Jun 2020 · CBR 49051 · Certificate 94018 ₹4,000
4th Renewed 26 Oct 2023 Period 30 Jun 2020 – 30 Jun 2021 · CBR 49051 · Certificate 94019 ₹4,000
5th Renewed 26 Oct 2023 Period 30 Jun 2021 – 30 Jun 2022 · CBR 49051 · Certificate 94020 ₹4,000
6th Renewed 26 Oct 2023 Period 30 Jun 2022 – 30 Jun 2023 · CBR 49051 · Certificate 94021 ₹4,000
7th Renewed 26 Oct 2023 Period 30 Jun 2023 – 30 Jun 2024 · CBR 49051 · Certificate 94022 ₹12,000
8th Renewed 25 Jun 2024 Period 30 Jun 2024 – 30 Jun 2025 · CBR 41324 · Certificate 120585 ₹12,000
9th Renewed 25 Jun 2025 Period 30 Jun 2025 – 30 Jun 2026 · CBR 37613 · Certificate 47823 ₹12,000