Sign In to Follow Application
View All Documents & Correspondence

Methods For Assessing Image Change And Devices Thereof

Abstract: A method, non-transitory computer readable medium, and an image analysis computing device that retrieves, based on a captured version of an object in a received image, training images which display related versions of the object and items of data related to the related versions of the object of the training images. Keypoints which are invariant to changes in scale and rotation in the captured version of the object in the received image and in the related versions of the object in the training images are determined. Changes to the object in the received image based on any of the determined keypoints in the related version of the object which do not match the determined keypoints in the captured version of the object are identified. The identified changes in the captured version of the object in the received image are provided. FIG. 1

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
21 February 2014
Publication Number
10/2014
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
ipo@knspartners.com
Parent Application
Patent Number
Legal Status
Grant Date
2021-11-11
Renewal Date

Applicants

WIPRO LIMITED
Doddakannelli, Sarjapur Road, Bangalore 560035, Karnataka, India.

Inventors

1. ANIL KUMAR LENKA
#88, Bharat Housing Cooperative Society Layout, Virat Nagar, Bommanahalli, Bangalore 560068, Karnataka, India.
2. RAGHAVENDRA HOSABETTU
#546, Gurukrupa, 17th Main, SBM Colony, Near VSS School, Bangalore 560050, Karnataka, India
3. ABHIJITH VIJAYAKUMAR RUGMINIBAI
G3, Sri Sai Enclave, No.14, 9th Main, N. S. Palaya, BTM 2nd Stage, Bangalore 560076, Karnataka, India.

Specification

CLIAMS:We claim:
1. A method for assessing image change, the method comprising:
retrieving, by an image analysis computing device, based on a captured version of an object in a received image, one or more training images which display one or more related versions of the object and one or more items of data related to the one or more related versions of the object of the one or more training images;
determining, by the image analysis computing device, one or more keypoints which are invariant to changes in scale and rotation in the captured version of the object in the received image and in the related versions of the object in the one or more training images;
identifying, by the image analysis computing device, one or more changes to the object in the received image based on any of the determined one or more keypoints in the related version of the object which do not match the determined one or more keypoints in the captured version of the object; and
providing, by the image analysis computing device, the identified one or more changes in the captured version of the object in the received image.

2. The method as set forth in claim 1 further comprising:
adjusting, by the image analysis computing device, the captured version of the object of the received image based on the related versions of the object of the one or more identified training images prior to the determining the one or more keypoints, wherein the adjusting comprises one or more of resizing and reorienting the captured version of the object of the received image based on the related version of the object of the one or more training images, adjusting image contrast, normalizing brightness, removing background, removing noise, or segmenting the received image.

3. The method as set forth in claim 1 further comprising:
determining, by the image analysis computing device, one or more contours in the related versions of the object in the one or more training images by thresholding the one or more training images;
applying, by the image analysis computing device, a weightage to the one or more determined contours;
identifying, by the image analysis computing device, one or more parts of the object in the related versions of the object based on the determined one or more contours; and
storing, by the image analysis computing device, the one or more identified parts of the related versions of the object, the applied weightage, and one or more items of data related to the one or more identified parts.

4. The method as set forth in claim 3 wherein the one or more items of data related to the one or more identified parts comprises a material the one or more identified parts are made from.

5. The method as set forth in claim 3 wherein the identifying the one or more changes further comprises:
classifying, by the image analysis computing device, each of the determined one or more keypoints in the captured version of the object which do not match the determined one or more keypoints in the related versions of the object as one or more parts of the captured version of the object in the received image;
comparing, by the image analysis computing device, the classified one or more parts of the captured version of the object in the received image with the stored one or more parts in the related versions of the object in the one or more training images; and
identifying, by the image analysis computing device, the one or more changes based on the comparison of the classified one or more parts and the stored one or more parts.

6. The method as set forth in claim 5 wherein the classifying each of the determined one or more keypoints in the captured version of the object comprises:
determining, by the image analysis computing device, a cluster associated with each of the of the determined one or more keypoints in the captured version of the object in the received image which do not match the determined one or more keypoints in the related versions of the object in the one or more training images, wherein each cluster comprises a set of descriptors related to the determined one or more keypoints; and
identifying, by the image analysis computing device, the one or more parts of the captured version of the object in the received image associated with the determined unmatched keypoints based on the identified cluster.

7. The method as set forth in claim 5 further comprising:
determining, by the image analysis processing device, one or more segments on the classified one or more parts of the captured version of the object in the received image;
determining, by the image analysis processing device, a type of change in the identified one or more changes in the captured version of the object in the received image by comparing the one or more determined segments in the captured version and one or more segments in the stored one or more identified parts of the related versions of the object in the one or more training images along with one or more items of data related to the one or more identified parts to identify a type of change.

8. The method as set forth in claim 1 further comprising:
identifying, by the image analysis computing device, a descriptor for the one or more keypoints in the captured version of the object in the received image and in the related versions of the object in the one or more training images; and
determining, by the image analysis computing device, when one or more identified descriptors in the captured version of the object match one or more identified descriptors in the related versions of the object.

9. The method as set forth in claim 8 wherein the determining when one or more identified descriptors in the captured version of the object match one or more identified descriptors in the related versions of the object further comprises:
determining, by the image analysis computing device, a value for a match between the one or more identified descriptors in the captured version of the object match one or more identified descriptors in the related versions of the object;
determining, by the image analysis computing device, when the determined value for the match between the one or more identified descriptors in the captured version of the object match one or more identified descriptors in the related versions of the object satisfies a threshold value; and
determining, by the image analysis computing device, based on the determined value satisfying the threshold value, that the captured version of the object in the received image matches the related versions of the object in the one or more training images.

10. An image analysis computing device, comprising:
a processor coupled to a memory and configured to execute programmed instructions stored in the memory, comprising:
retrieving, based on a captured version of an object in a received image, one or more training images which display one or more related versions of the object and one or more items of data related to the one or more related versions of the object of the one or more training images;
determining one or more keypoints which are invariant to changes in scale and rotation in the captured version of the object in the received image and in the related versions of the object in the one or more training images;
identifying one or more changes to the object in the received image based on any of the determined one or more keypoints in the related version of the object which do not match the determined one or more keypoints in the captured version of the object; and
providing the identified one or more changes in the captured version of the object in the received image.

11. The device as set forth in claim 10 wherein the processor is further configured to execute programmed instructions stored in the memory further comprising:
adjusting the captured version of the object of the received image based on the related versions of the object of the one or more identified training images prior to the determining the one or more keypoints, wherein the adjusting comprises one or more of resizing and reorienting the captured version of the object of the received image based on the related version of the object of the one or more training images, adjusting image contrast, normalizing brightness, removing background, removing noise, or segmenting the received image.

12. The device as set forth in claim 10 wherein the processor is further configured to execute programmed instructions stored in the memory further comprising:
determining one or more contours in the related versions of the object in the one or more training images by thresholding the one or more training images;
applying a weightage to the one or more determined contours;
identifying one or more parts of the object in the related versions of the object based on the determined one or more contours; and
storing the one or more identified parts of the related versions of the object, the applied weightage, and one or more items of data related to the one or more identified parts.

13. The device as set forth in claim 12 wherein the one or more items of data related to the one or more identified parts comprises a material the one or more identified parts are made from.

13. The device as set forth in claim 12 wherein the identifying the one or more changes further comprises:
classifying each of the determined one or more keypoints in the captured version of the object which do not match the determined one or more keypoints in the related versions of the object as one or more parts of the captured version of the object in the received image;
comparing the classified one or more parts of the captured version of the object in the received image with the stored one or more parts in the related versions of the object in the one or more training images; and
identifying the one or more changes based on the comparison of the classified one or more parts and the stored one or more parts.

14. The device as set forth in claim 14 wherein the classifying each of the determined one or more keypoints in the captured version of the object comprises:
determining, by the image analysis computing device, a cluster associated with each of the of the determined one or more keypoints in the captured version of the object in the received image which do not match the determined one or more keypoints in the related versions of the object in the one or more training images, wherein each cluster comprises a set of descriptors related to the determined one or more keypoints; and
identifying, by the image analysis computing device, the one or more parts of the captured version of the object in the received image associated with the determined unmatched keypoints based on the identified cluster.

15. The device as set forth in claim 14 wherein the processor is further configured to execute programmed instructions stored in the memory further comprising:
determining one or more segments on the classified one or more parts of the captured version of the object in the received image;
determining a type of change in the identified one or more changes in the captured version of the object in the received image by comparing the one or more determined segments in the captured version and one or more segments in the stored one or more identified parts of the related versions of the object in the one or more training images along with one or more items of data related to the one or more identified parts to identify a type of change.

16. The device as set forth in claim 10 wherein the processor is further configured to execute programmed instructions stored in the memory further comprising:
identifying a descriptor for the one or more keypoints in the captured version of the object in the received image and in the related versions of the object in the one or more training images; and
determining when one or more identified descriptors in the captured version of the object match one or more identified descriptors in the related versions of the object.

17. The device as set forth in claim 17 wherein the determining when one or more identified descriptors in the captured version of the object match one or more identified descriptors in the related versions of the object further comprises:
determining a value for a match between the one or more identified descriptors in the captured version of the object match one or more identified descriptors in the related versions of the object;
determining when the determined value for the match between the one or more identified descriptors in the captured version of the object match one or more identified descriptors in the related versions of the object satisfies a threshold value; and
determining based on the determined value satisfying the threshold value, that the captured version of the object in the received image matches the related versions of the object in the one or more training images.

18. A non-transitory computer readable medium having stored thereon instructions for assessing image change comprising machine executable code which when executed by a processor, causes the processor to perform steps comprising:
retrieving, based on a captured version of an object in a received image, one or more training images which display one or more related versions of the object and one or more items of data related to the one or more related versions of the object of the one or more training images;
determining one or more keypoints which are invariant to changes in scale and rotation in the captured version of the object in the received image and in the related versions of the object in the one or more training images;
identifying one or more changes to the object in the received image based on any of the determined one or more keypoints in the related version of the object which do not match the determined one or more keypoints in the captured version of the object; and
providing the identified one or more changes in the captured version of the object in the received image.
19. The medium as set forth in claim 19 wherein the medium further comprises machine executable code which, when executed by the processor, causes the processor to perform steps further comprising:
adjusting the captured version of the object of the received image based on the related versions of the object of the one or more identified training images prior to the determining the one or more keypoints, wherein the adjusting comprises one or more of resizing and reorienting the captured version of the object of the received image based on the related version of the object of the one or more training images, adjusting image contrast, normalizing brightness, removing background, removing noise, or segmenting the received image.

20. The medium as set forth in claim 19 wherein the medium further comprises machine executable code which, when executed by the processor, causes the processor to perform steps further comprising:
determining one or more contours in the related versions of the object in the one or more training images by thresholding the one or more training images;
applying a weightage to the one or more determined contours;
identifying one or more parts of the object in the related versions of the object based on the determined one or more contours; and
storing the one or more identified parts of the related versions of the object, the applied weightage, and one or more items of data related to the one or more identified parts.

22. The medium as set forth in claim 21 wherein the one or more items of data related to the one or more identified parts comprises a material the one or more identified parts are made from.

23. The medium as set forth in claim 21 wherein the identifying the one or more changes further comprises:
classifying each of the determined one or more keypoints in the captured version of the object which do not match the determined one or more keypoints in the related versions of the object as one or more parts of the captured version of the object in the received image;
comparing the classified one or more parts of the captured version of the object in the received image with the stored one or more parts in the related versions of the object in the one or more training images; and
identifying the one or more changes based on the comparison of the classified one or more parts and the stored one or more parts.

24. The medium as set forth in claim 23 wherein the classifying each of the determined one or more keypoints in the captured version of the object comprises:
determining, by the image analysis computing device, a cluster associated with each of the of the determined one or more keypoints in the captured version of the object in the received image which do not match the determined one or more keypoints in the related versions of the object in the one or more training images, wherein each cluster comprises a set of descriptors related to the determined one or more keypoints; and
identifying, by the image analysis computing device, the one or more parts of the captured version of the object in the received image associated with the determined unmatched keypoints based on the identified cluster.
adjusting the captured version of the object of the received image based on the related version of the object of the one or more identified training images prior to determining the one or more keypoints, wherein the adjusting comprises one or more of resizing and reorienting the captured version of the object of the received image based on the related version of the object of the one or more training images, adjusting image contrast, normalizing brightness, removing background, removing noise, or segmenting the received image.

25. The medium as set forth in claim 23 wherein the medium further comprises machine executable code which, when executed by the processor, causes the processor to perform steps further comprising:
determining one or more segments on the classified one or more parts of the captured version of the object in the received image;
determining a type of change in the identified one or more changes in the captured version of the object in the received image by comparing the one or more determined segments in the captured version and one or more segments in the stored one or more identified parts of the related versions of the object in the one or more training images along with one or more items of data related to the one or more identified parts to identify a type of change.

26. The medium as set forth in claim 19 wherein the medium further comprises machine executable code which, when executed by the processor, causes the processor to perform steps further comprising:
identifying a descriptor for the one or more keypoints in the captured version of the object in the received image and in the related versions of the object in the one or more training images; and
determining when one or more identified descriptors in the captured version of the object match one or more identified descriptors in the related versions of the object.

27. The medium as set forth in claim 26 wherein the determining when one or more identified descriptors in the captured version of the object match one or more identified descriptors in the related versions of the object further comprises:
determining a value for a match between the one or more identified descriptors in the captured version of the object match one or more identified descriptors in the related versions of the object;
determining when the determined value for the match between the one or more identified descriptors in the captured version of the object match one or more identified descriptors in the related versions of the object satisfies a threshold value; and
determining based on the determined value satisfying the threshold value, that the captured version of the object in the received image matches the related versions of the object in the one or more training images.

Dated this 21st day of February, 2014

SRAVAN KUMAR GAMPA
OF K & S PARTNERS
ATTORNEY FOR THE APPLICANTS
,TagSPECI:FIELD OF THE INVENTION
This technology generally relates to methods and devices for image analysis and, more particularly, methods for automatically assessing image change and devices thereof.

Documents

Application Documents

# Name Date
1 850-CHE-2014 FORM-9 21-02-2014.pdf 2014-02-21
2 850-CHE-2014 FORM-18 21-02-2014.pdf 2014-02-21
3 IP26407-Spec.pdf 2014-02-25
4 IP26407-draw.pdf 2014-02-25
5 FORM 5.pdf 2014-02-25
6 FORM 3.pdf 2014-02-25
7 850-CHE-2014 FORM-1 25-02-2014.pdf 2014-02-25
8 abstract850-CHE-2014.jpg 2014-02-28
9 850-CHE-2014 FORM-3 08-05-2014.pdf 2014-05-08
10 850-CHE-2014-Request For Certified Copy-Online(16-02-2015).pdf 2015-02-16
11 850CHE2014_Certifiedcoyrequest.pdf ONLINE 2015-02-18
12 850CHE2014_Certifiedcoyrequest.pdf 2015-03-13
13 POWER OF ATTORNEY.pdf 2015-05-27
14 850-CHE-2014-FER.pdf 2019-07-22
15 850-CHE-2014-OTHERS [21-01-2020(online)].pdf 2020-01-21
16 850-CHE-2014-FORM 3 [21-01-2020(online)].pdf 2020-01-21
17 850-CHE-2014-FER_SER_REPLY [21-01-2020(online)].pdf 2020-01-21
18 850-CHE-2014-DRAWING [21-01-2020(online)].pdf 2020-01-21
19 850-CHE-2014-CORRESPONDENCE [21-01-2020(online)].pdf 2020-01-21
20 850-CHE-2014-CLAIMS [21-01-2020(online)].pdf 2020-01-21
21 850-CHE-2014-ABSTRACT [21-01-2020(online)].pdf 2020-01-21
22 850-CHE-2014-US(14)-HearingNotice-(HearingDate-22-10-2021).pdf 2021-10-17
23 850-CHE-2014-Correspondence to notify the Controller [22-10-2021(online)].pdf 2021-10-22
24 850-CHE-2014-Annexure [22-10-2021(online)].pdf 2021-10-22
25 850-CHE-2014-Written submissions and relevant documents [06-11-2021(online)].pdf 2021-11-06
26 850-CHE-2014-PatentCertificate11-11-2021.pdf 2021-11-11
27 850-CHE-2014-IntimationOfGrant11-11-2021.pdf 2021-11-11
28 850-CHE-2014-PROOF OF ALTERATION [07-02-2022(online)].pdf 2022-02-07
29 850-CHE-2014-RELEVANT DOCUMENTS [20-09-2023(online)].pdf 2023-09-20

Search Strategy

1 850_che_2014AE_23-08-2021.pdf
2 2019-07-1814-39-21_18-07-2019.pdf

ERegister / Renewals

3rd: 07 Feb 2022

From 21/02/2016 - To 21/02/2017

4th: 07 Feb 2022

From 21/02/2017 - To 21/02/2018

5th: 07 Feb 2022

From 21/02/2018 - To 21/02/2019

6th: 07 Feb 2022

From 21/02/2019 - To 21/02/2020

7th: 07 Feb 2022

From 21/02/2020 - To 21/02/2021

8th: 07 Feb 2022

From 21/02/2021 - To 21/02/2022

9th: 07 Feb 2022

From 21/02/2022 - To 21/02/2023

10th: 10 Feb 2023

From 21/02/2023 - To 21/02/2024

11th: 19 Feb 2024

From 21/02/2024 - To 21/02/2025

12th: 15 Feb 2025

From 21/02/2025 - To 21/02/2026