DESC:FORM 2
THE PATENT ACT, 1970
(39 of 1970)
&
The Patent Rules, 2003
COMPLETE SPECIFICATION
(See section 10 and rule 13)

1. TITLE OF THE INVENTION:
Object recognition interactive e-commerce system
2. APPLICANT:
Name: Auraaz Technologies Private Limited
Nationality: India
3. Address: 1-93-11, LIG-72, Sector – 5, MVP Colony – 530017, Visakhapatnam, Andhra Pradesh, India

The following specification particularly describes the invention and the manner in which it is to be performed:

4. Description:
Field of Invention:

[0001] The present invention relates to image recognition for information retrieval and more particularly information retrieval from movie posters and the like promotional materials.

Background of the invention:
[0002] Electronic commerce or (e-commerce or ecommerce) refers to the buying and selling of products or services over electronic systems such as the Internet and other networks. Prior integration of e-commerce in commercials, promotional videos includes provision of additional product purchase related details upon selection by the user.

[0003] E-commerce and its unique charm that has appeared gradually, virtual enterprise, virtual bank, network marketing, online shopping, payment and advertising, has become as familiar to people. This reflects that the e-commerce has huge impact on the economy and society from the other side.

[0004] On the other hand Augmented Reality (AR), which is a technology enriching the real world with digital information and media, such as 3D models and videos, overlaying in real-time the camera view of your smartphone, tablet, PC or connected glasses is a new way of marketing the products.

[0005] There is always an attraction towards media, particularly video media, such as movies, television shows, and music videos, attract large audiences to the products, services, events, and/or locations that appear in them where the audiences have a great tendency to become potential buyers of these products and services that appear in media. Often customers are left with no means to retrieve further information about the products they see a movie poster, promotional video and the like.

[0006] Prior attempts of promoting movies or promotional videos include, providing a user with movie trailer, associated images upon just capturing of the movie or image poster. However there are no means of finding product information displayed in such promotional videos or retrieved images. In view of the above disadvantage there is a need to provide product purchase information in the displayed promotional images or media files through an augmented reality means.

Objectives of the invention:

[0007] The objective of the invention is to capture still image of a movie poster, magazine, ad and the like promotional material and thereby retrieve the related information.

[0008] Another objective of the invention is to capture still image of a movie poster, magazine, ad and the like through a handheld device, mobile and the like.

[0009] Another objective of the invention is to identify the captured images and provide a series of images related to the captured image, url links and thereof.

[0010] Another objective of the invention is to identify the captured images and start playing of media clip, trailer, and videos and thereof upon recognising the image.

[0011] Also another objective of the invention is to play media files with markers that enable user to click and find the product information of the objects in the files.

[0012] Also another objective of the invention is to allow a tag the image poster, ad, and the like with a tag to be recognised by the handheld device.

[0013] Also another objective of the invention is to promote augmented reality based commerce in the field of movies, films and the like.

Summary

[0014] The following is a summary of the invention in order to provide a basic understanding of some aspects of the invention. This summary is not intended to identify key or critical elements of the invention or to delineate the scope of the invention. The sole purpose of this section is to present some concepts of the invention in a simplified form as a prelude to the more detailed description that is presented later.

[0015] The present invention relates to an object recognition interactive augmented reality based commerce system comprising of a device, an image recognition module, a data retriever and a product module configured to enable selection of any objects in the image or motion media for triggering of plurality of actions in which one of the actions may be opening of a new module with the respective object purchase information via wireless means through a digital communication network.

[0016] A method of operation of interactive augmented reality based commerce system comprising of capturing an image of object of interest to the user through a device, which may be a camera featured mobile and the like. The captured image is received by the image recognizing module to identify the captured and retrieve a series of images and or motion media associated with the recognized image by the data retriever. The user is provided with a feature to select any item in retrieved data, which are not limited to background objects, products, artefacts and the like which upon click by the use an action is triggered such as providing user product purchase information, purchase link and the thereof of the associated object.

Description of Drawings:

[0017] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate an embodiment of the invention, and, together with the description, serve to explain the principles of the invention.

[0018] FIG. 1 illustrates a block diagram of object recognition interactive augmented reality based commerce system, in accordance with an embodiment of the invention.

[0019] FIG. 2 illustrates a detailed block diagram view of object recognition interactive augmented reality based commerce system, in accordance with an embodiment of the invention.

[0020] Fig. 3 illustrates flow-chart of object recognition interactive augmented reality based commerce system, in accordance with an embodiment of the invention.

Detailed description of Drawings:

[0021] An exemplary embodiment of the present invention will be described in reference to the accompanying drawings. Wherever possible, same or similar reference numerals are used in the drawings and the description to refer to the same or like parts or steps.

[0022] FIG. 1 illustrates a block diagram of object recognition interactive augmented reality based commerce system 100, in accordance with an embodiment of the invention. The system 100 comprises of a device 101, image recognition module 102, a data retriever 103 and a product module 104.

[0023] Referring initially to FIG. 1 and FIG. 2, the device 101 is shown in accordance with the present invention. In the exemplary embodiment described herein, the portable communication device is a mobile phone 101. The device 101 includes a display which shows information to a user, such as recorded digital media, e.g., recorded photos and videos, operating state, time, phone numbers, contact information and various navigational menus, which enable the user to utilize the various features of the mobile phone 10. In addition, the display may be configured to function as a viewfinder when the mobile phone's camera function is in use.

[0024] As shown in FIG. 2, the mobile phone 201 is equipped with a camera assembly 202 for taking digital still pictures and/or digital video clips. It is emphasized that the electronic devices 201 need not be a mobile telephone, but could be a dedicated camera or some other portable communication device.

[0025] In an embodiment, the image recognition module 102 is configured to identify the digital image of the captured object of interest to the user through a device 101. The image may be an ad, poster, media display item, product, and/or product packaging and thereof. The recognition of image according to an exemplary embodiment of the invention, may include scanning captured image, identification of markers, tagging and thereof. Also in another exemplary means, the recognition of image or product and the like may be performed by comparing the captured image to a database of images by communication through a digital communication network.

[0026] In an embodiment, the data retriever 103, receives the object recognition module information and retrieves a series of images, movie trailer, video clips and the like. In an example embodiment, the data retriever 103 may be enabled to communicate with a service platform to provide, request and/or receive information. The video media may include streaming video, MP4, or any other video content associated with any known video format. The images may include a series of images related to the scanned image, which may a movie poster. In that case, the data retriever retrieves all the related images of the movie and thereof.

[0027] In an embodiment, the product module 104 displays selected object information by the user over the device user interface. The information may include details regarding a description of the object (e.g., size or size options, style or style options, brand name, model name, price, availability, reviews, etc.). In some cases, the information may also include a link to facilitate purchasing the object.

[0028] With reference to Fig. 2, the block diagram illustration of the object recognition augmented reality based commerce system according to an aspect of the invention, the device 201, is provide with a camera 202 to capture the image 203 of interest by the user. In an exemplary aspect, the image may be a movie poster 203. The captured image is received by the image recognition module 204. The module 204 identifies the captures image and sends the information a data retriever 205. The data retriever displays a series of images 206 and or video files 207 associated with the image over a display screen 208 of the device 201. In accordance with an embodiment of the invention, the user is provided an option to select and click on any of the object displayed in the images, such as clothing, furniture, antiques and the like. The actions trigger the product module 209 to display product information 201 on the display screen 208 of the device 201.

[0029] Turning now to FIG. 3, methods of operating an object recognition interactive augmented reality based commerce system 300, where the mobile phone captures an image of an object at block 301. In one exemplary embodiment, capturing an image of an object involves using the mobile phone's camera function to snap a photo of an object, for example, a mobile phone ad, a mobile phone poster, a product or product packaging. It will be appreciated that while aspects of the invention are being described with respect to mobile phone products, mobile phone packaging and/or mobile phone ads or posters, the invention also is applicable to the capture of images relating to any kind of ad, poster, media display item, product, and/or product packaging.

[0030] Once the image of a product, product packaging and/or advertising material has been captured, at functional block 301, the image recognition module may operate to determine or otherwise detect the captured image at block 302. In an exemplary embodiment, the image recognition may include scanning an image looking for one or more predetermined visual or invisible cues (text, code, images or the like), markers, tagging and thereof within the image captured by the mobile phone.

[0031] At functional block 303, upon recognition of image, the data retriever is configured to retrieve a set of media files. It will be appreciated that a set of media files may be initiated without departing from the scope of the present invention. For example, the set of media files may include launching a media application. For example, the media files may view a series of images, view a short video clip, allow the user to play a game (e.g., play a game using the captured image as a backdrop), view a short animation or the like.

[0032] At functional block 304, the user may click on any object in the displayed media files such as a shoes, handbags and clothing items of the individuals, a background objects in the image or video and the like. In response to selection of one (or more) of the object, the corresponding selectable video or image object product module may trigger an action. The action causes the system to retrieve the additional information (e.g., on the information panel) associated with the corresponding selected mapped object such as object purchase location, purchase price, object brand, and thereof as shown at block 205. The information may be displayed over the display screen of the device.

[0033] The invention is advantageous in enabling a user to purchase the objects that viewer comes across seeing a movie poster and the like. The invention is not limited to but to be including in the scope all the advertising, promotional posters, movie posters, game CD/ DVD and the like. The invention provides new ways for users to use their mobile phones to interact and build affinity for a particular brand or products, product packaging and/or promotional materials.

[0034] It will readily be apparent that numerous modifications and alterations can be made to the processes described in the foregoing examples without departing from the principles underlying the invention, and all such modifications and alterations are intended to be embraced by this application.
,CLAIMS:We Claim
1. An object recognition interactive augmented reality based commerce system comprising:
A device with a camera that generates an image of the object of interest captured by the user;
An image recognition module in the device configured to the receive image from the camera and recognize the captured image;
A data retriever for retrieving a set of images and or motion media associated with the recognized captured image; and
A product module configured to enable selection of any objects in the image or motion media for triggering of plurality of actions wherein, one of the actions may be opening of a new module with the respective object purchase information via wireless means through a digital communication network.

2. The object recognition interactive augmented reality based commerce system according to claim 1, wherein said image recognition module is configured to recognize at least one object from the digital representation/ captured image as a target object for retrieving information relative to the target object.

3. The object recognition interactive augmented reality based commerce system according to claim 1, wherein said data retriever receives the recognized image data and retrieves series of images, media files, web links associated with the image, where the media files may include movie trailers, short films, game demo and the like.

4. The object recognition interactive augmented reality based commerce system according to claim 1, wherein said retriever may include a means to select and click on any object in the displayed image and or motion file, to obtain the object information such as product purchase information, purchase links, purchase options and thereof enabling a user to buy an item of interest in the displayed data.

5. The object recognition interactive augmented reality based commerce system according to claim 1, wherein said captured image of the object of interest to the user may be a movie poster, advertisement, game CD/DVD, product and thereof.

6. The object recognition interactive augmented reality based commerce system according to claim 1, wherein said product modules triggers display of product information of the object selected by the user from the data retrieved by the said data retriever, wherein the product information may be, product size, style, color, price, purchase option and thereof.

7. The object recognition interactive augmented reality based commerce system according to claim1, wherein the device may be a phone, a PDA, a computing device and thereof.

8. A method of operation of interactive augmented reality based commerce system comprising:
Capturing an image of object of interest to the user through a device;
Receiving captured image by the image recognizing module to identify the captured image;
Retrieving a series of images and or motion media associated with the recognized image by the data retriever;
Triggering an action upon selecting and clicking over an object in the displayed series of images or motion media, such as providing user product purchase information, purchase link and the thereof of the associated object.

9. The method of operation of interactive augmented reality based commerce system according to claim 7, wherein said trigger actions include obtaining the selected object information, such as object purchase link, price, availability, purchase options and thereof.