Abstract: The present invention discloses a method and a content rendering system for rendering Augmented Reality (AR) content for textureless objects. The content rendering system captures one or more image frames associated with objects and transmits to a cloud server to detect one or more textureless objects along with one or more associated buffer Regions of Interest (ROI) based on a pre-trained object detection model. A grid index associated with each buffer ROI defines a position of the one or more textureless objects in each buffer ROI. The content rendering system obtains AR script from the cloud server based on the detected one or more textureless objects. Thereafter, based on the AR script, AR content associated with the one or more textureless objects is rendered in real time at the position of the one or more textureless objects. Fig.1
Claims:We claim:
1. A method of rendering Augmented Reality (AR) content for textureless objects, the method comprising:
capturing, by a content rendering system (101), one or more image frames associated with objects;
transmitting, by the content rendering system (101), the one or more image frames to a cloud server (103) to detect one or more textureless objects and one or more associated buffer Regions of Interest (ROI) from the one or more image frames based on a pre-trained object detection model, wherein a grid index associated with each buffer ROI defines a position of the one or more textureless objects in each buffer ROI;
obtaining, by the content rendering system (101), an AR script from the cloud server (103) based on the detected one or more textureless objects; and
rendering, by the content rendering system (101), AR content associated with the one or more textureless objects in real time at the position of the one or more textureless objects based on the AR script.
2. The method as claimed in claim 1, further comprising tracking the one or more textureless objects in real time.
3. The method as claimed in claim 1, wherein the object detection model is trained using a plurality of training images and corresponding textureless objects, wherein the plurality of training images are annotated with object class labels and the one or more associated buffer ROI.
4. The method as claimed in claim 1, wherein the grid index is based on a size of the buffer ROI.
5. The method as claimed in claim 1, wherein the AR script comprises type of AR content to be rendered for each of the one or more textureless objects.
6. The method as claimed in claim 5, wherein the AR content comprises animations, images, graphics, 3D content, audio and video.
7. The method as claimed in claim 1, wherein rendering the AR content comprises detecting a state of the one or more textureless objects and tracking the position of one or more textureless objects for subsequent actions based on the AR script.
8. A content rendering system (101) for rendering Augmented Reality (AR) content for textureless objects, comprising:
a processor (111); and
a memory (109) communicatively coupled to the processor (111), wherein the memory (109) stores processor instructions, which, on execution, causes the processor (111) to:
capture one or more image frames associated with objects;
transmit the one or more image frames to a cloud server (103) to detect one or more textureless objects and one or more associated buffer Regions of Interest (ROI) from the one or more image frames based on a pre-trained object detection model, wherein a grid index associated with each buffer ROI defines a position of the one or more textureless objects in each buffer ROI;
obtain an AR script from the cloud server based on the detected one or more textureless objects; and
render AR content associated with the one or more textureless objects at the position of the one or more textureless objects based on the AR script.
9. The content rendering system (101) as claimed in claim 8, wherein the processor (111) tracks the one or more textureless objects in real time.
10. The content rendering system (101) as claimed in claim 8, wherein the object detection model is trained using a plurality of training images and corresponding textureless objects, wherein the plurality of training images are annotated with object class labels and the one or more associated buffer ROI.
11. The content rendering system (101) as claimed in claim 8, wherein the grid index is based on a size of the buffer ROI.
12. The content rendering system (101) as claimed in claim 8, wherein the AR script comprises type of AR content to be rendered for each of the one or more textureless objects.
13. The content rendering system (101) as claimed in claim 12, wherein the AR content comprises animations, images, graphics, 3D content, audio and video.
14. The content rendering system (101) as claimed in claim 8, wherein the processor (111) detects a state of the one or more textureless objects and tracks the position of one or more textureless objects to render AR content for subsequent actions based on the AR script.
Dated this 29th day of March, 2019
Madhusudan S.T
Of K&S Partners
Agent for the Applicant
IN/PA-1297
, Description:TECHNICAL FIELD
The present subject matter is related in general to content rendering and augmented reality- based assistance, more particularly, but not exclusively to a method and system for rendering Augmented Reality (AR) content for textureless objects.
| # | Name | Date |
|---|---|---|
| 1 | 201941012689-Request Letter-Correspondence [04-02-2019(online)].pdf | 2019-02-04 |
| 2 | 201941012689-Power of Attorney [04-02-2019(online)].pdf | 2019-02-04 |
| 3 | 201941012689-Form 1 (Submitted on date of filing) [04-02-2019(online)].pdf | 2019-02-04 |
| 4 | 201941012689-STATEMENT OF UNDERTAKING (FORM 3) [29-03-2019(online)].pdf | 2019-03-29 |
| 5 | 201941012689-REQUEST FOR EXAMINATION (FORM-18) [29-03-2019(online)].pdf | 2019-03-29 |
| 6 | 201941012689-POWER OF AUTHORITY [29-03-2019(online)].pdf | 2019-03-29 |
| 7 | 201941012689-FORM 18 [29-03-2019(online)].pdf | 2019-03-29 |
| 8 | 201941012689-FORM 1 [29-03-2019(online)].pdf | 2019-03-29 |
| 9 | 201941012689-DRAWINGS [29-03-2019(online)].pdf | 2019-03-29 |
| 10 | 201941012689-DECLARATION OF INVENTORSHIP (FORM 5) [29-03-2019(online)].pdf | 2019-03-29 |
| 11 | 201941012689-COMPLETE SPECIFICATION [29-03-2019(online)].pdf | 2019-03-29 |
| 12 | 201941012689-Proof of Right (MANDATORY) [26-09-2019(online)].pdf | 2019-09-26 |
| 13 | 201941012689-RELEVANT DOCUMENTS [29-09-2021(online)].pdf | 2021-09-29 |
| 14 | 201941012689-PETITION UNDER RULE 137 [29-09-2021(online)].pdf | 2021-09-29 |
| 15 | 201941012689-OTHERS [29-09-2021(online)].pdf | 2021-09-29 |
| 16 | 201941012689-Information under section 8(2) [29-09-2021(online)].pdf | 2021-09-29 |
| 17 | 201941012689-FORM 3 [29-09-2021(online)].pdf | 2021-09-29 |
| 18 | 201941012689-FER_SER_REPLY [29-09-2021(online)].pdf | 2021-09-29 |
| 19 | 201941012689-DRAWING [29-09-2021(online)].pdf | 2021-09-29 |
| 20 | 201941012689-CORRESPONDENCE [29-09-2021(online)].pdf | 2021-09-29 |
| 21 | 201941012689-COMPLETE SPECIFICATION [29-09-2021(online)].pdf | 2021-09-29 |
| 22 | 201941012689-CLAIMS [29-09-2021(online)].pdf | 2021-09-29 |
| 23 | 201941012689-FER.pdf | 2021-10-17 |
| 24 | 201941012689-US(14)-HearingNotice-(HearingDate-12-06-2024).pdf | 2024-05-09 |
| 25 | 201941012689-POA [22-05-2024(online)].pdf | 2024-05-22 |
| 26 | 201941012689-FORM 13 [22-05-2024(online)].pdf | 2024-05-22 |
| 27 | 201941012689-Correspondence to notify the Controller [22-05-2024(online)].pdf | 2024-05-22 |
| 28 | 201941012689-AMENDED DOCUMENTS [22-05-2024(online)].pdf | 2024-05-22 |
| 29 | 201941012689-Written submissions and relevant documents [26-06-2024(online)].pdf | 2024-06-26 |
| 30 | 201941012689-PatentCertificate11-07-2024.pdf | 2024-07-11 |
| 31 | 201941012689-IntimationOfGrant11-07-2024.pdf | 2024-07-11 |
| 1 | 201941012689E_16-03-2021.pdf |