Abstract: Present invention provides a SmartMirror (powered by electric sources like Solar Cells or conventional batteries or electricity distribution) with built in image capture (2d and 3d cameras and microphones), image stream recognition, voice recognition, gesture and emotion recognition, ability to link up retailer or shop keeper inventory, provide suggestive video conference call with subject experts or share content between mirror and personal smartphone. The SmartMirror coupled with 3d camera sensors and dynamic LED lighting for simulating day/night appearances can be used in apparel stores /garments , fashion hi street malls and shops , jewellery shops and other places. The SmartMirror with its powerful analytic software can disburse dynamic and intelligent content either on its own or from third parties tie ups, accept payments and also keep track of customers and their buying patterns.
Field of Invention:
Present invention provides a traditional 2 way Mirror /glass combination fitted on a
frame and with attached devices including computing device with storage and
wireless and Bluetooth capabilities, LCD/LED/TFT/Projector with Smart Film based
monitors display, camera , 3d motion image sensor camera , microphone , speakers
, LED background lighting , other sensors like proximity, locational and movement
sensor and power sources. The software running on this computing device will have
facial recognition algorithms, voice and speech recognition algorithms, emotion
recognition algorithms, colour and background detection algorithms and other
computational logic to determine and provide inputs about a person standing in front
of the mirror and provide customized content based on his live streaming or captured
image using 2d camera or 3d camera. This also allows integrating with third party
content system to throw intelligent suggestions based on emotions,gender, cloth
colour or design detected of the person standing in front of the mirror. The mirror
being two way can also have smart film to dynamically alter tint or mirror design
including zooming to have multiple use cases. The 3d camera will be able to capture
inputs from the user in front of the mirror using gestures or emotions or movements.
Background of Invention:
US 7843404 B2 describes invention provides a smart refractive mirror apparatus
using an LCD panel to be used in a vehicle for protecting the driver by varying
intensity in day and night.
US 6560027 B2relatesmirror provides both an image and information to a user. The
inventive mirror allows a user to review electronic information, while performing
personal hygiene procedures and send emails or view text or image content like
news.
Our concept is unique in three counts firstly it uses image processing patterns to use
the image stream coming from the camera to understand user emotions , gender ,
age and cloth and colour preferences thereby getting unstated inputs to suggest
alternatives of products and services such as clothing , hairstyle or even jewellery,
Secondly it allowsgesture processing using a 3d camera so the mirror becomes a
touch screen and the software can recognize the inputs such as a thumbs up or
down and use this for further content display.
Brief description of drawings:
Figure 1 discloses a flow chart showing the process steps of the system.
Summary of Invention:
According to an aspect of the invention, there is provided atwo way mirror with a
LCD/TFT or LED monitor display, built in camera and microphone, extended 3d
camera, fully automatic open mirrorkiosk with voice input microphone:
Yet according to another aspect of the invention, there is provided Software which
allows parsing image feed from the camera or gesture and movement feed from 3d
cameras, this software recognizes emotions , gender, age group and also the colour
of clothes , hairstyle etc. which is used for further processing. The software also
recognizes and matches facial appearance and voice matching options to
automatically detect a pre-registered person. The software also allows a person to
stand in front of the mirror and speak his name to register himself. On subsequent
visits he can be recognized as per above mentioned aspects.
Yet according to another aspect of the invention.there is provided a data network
using Wi-Fi or 3g/4d data card to transfer data and integrate with other back office or
central servers. There is also provided Bluetooth connectivity for users to click their
photograph using the built in camera and further download the photo to their mobile
phone or tablets.
Yet according to another aspect of the invention, there is providedsoftwareto display
advertisements from a central server on the mirror which is timed and dynamically
changing.This software also allows retailers to register different matching products
based on size, colour,age, price, design and gender which will be shown up as
suggestions when a person comes in front of the SrhartMirror. Thesuggestions can
be spoken out using speakers or simulated using image manipulation and
superimposition which can be displayed on the output devices.
Yet according to another aspect of the invention,proximity sensors detect when a
person comes irTfront of the"mirror and will welcome the person with his namebased
on face recognition.
Yet according to another aspect of the invention, is provided integrated video
conferencing software for conferencing using the kiosk data connectivity which will
enable fashion experts or counsellors to come online based on voice commands or
gestures to help with cloth selection.
Yet according to another aspect of the invention , is provided a content engine which
can integrate different systems to show content and general information such as
news from the related industry , developments , traffic or general information and
ability to transact using online payment mechanisms to check out and pay for
merchandise using the SmartMirror and its controls.
Yet according to another aspect of the invention the system can be tailor made to
recognize the facial expressions and calculate probability of buying thereby
generating discounts or additional offers on the fly using the mirror and its animated
presenter who will play the role of a virtual sales man including addressing name of
the person, encouraging him to buy after sensing their gestures or facial expressions
or recognizing their voice patterns and deriving meaning using different language
speech translations.
Detailed description of drawings:
The above-mentioned features and other advantages of this present disclosure, and
the manner of attaining them, will become more apparent and the present disclosure
will be better understood by reference to the following description of embodiments of
the present disclosure taken in conjunction with the accompanying drawings,
wherein:
Figure 1 discloses a flow chart showing the process steps of the system.
Detailed description of Invention:
Reference will now be made in detail to the exemplary embodiment of the present
disclosure. Before describing the detailed embodiments that are in accordance with
the present disclosure, it should be observed that the embodiment resides primarily
in combinations arrangement of the composition according to an embodiment herein
and as exemplified in FIG. 1.
Any embodiment described herein is not necessarily to be construed as preferred or
advantageous over other embodiment. All of the embodiment described in this
detailed description are illustrative, and provided to enable persons skilled in the art
to make or use the disclosure and not to limit the scope of the disclosure, which is
defined by the claims.
In the following description, for the purpose of explanation, numerous specific details
are set forth in order to provide a thorough understanding of the arrangement of the
system according to an embodiment herein. It will be apparent, however, to one
skilled in the art, that the present embodiment can be practiced without these
specific details. In other instances, structures are shown in block diagram form only
in order to avoid obscuring the present invention.
In.ideal case the SmartMirror is installed in a high street mall or shop and displays
content in the form of text and graphical ads which can be metered or unmetered
and chargeable or free. The content may also encourage through voice or text or
images users to approach it for offers. The SmartMirror user interaction process
starts when a customer comes in proximity of the SmartMirror from the front and the
sensors detect him and does a facial recognition and voicerecognition. In case of
match it proceeds with him as an existing subscriber or else asks him for his name to
register him as a new subscriber with the best of three photo snaps using the built in
camera. Using a complex network of emotion ,gender and cloth colour detection the
Kiosks starts promoting products using images and content matching and also
suggesting what others in same profile (age/gender) etc. are buying. The user may
also be displayed matching content, general news or may be given an option to have
an anonymous call with an expert to help with choice selection.
The data transmission and integration, with the store'sinventory, voice detection,and
speech synthesis allows presenting users with matching options and they can
simulate-gaTm~^W trials^aRd ~tTansferr"tlie~i?Tiages_of ~ themselves "witlT
different clothes on to their Smartphones using Bluetooth to further share or keep for
reference.
the SmartMirror will also detect the user gestures; mood changes as long as the
person stays in front of the mirror to come up with more persuasive content such as
discounts or colours to conclude a sale successfully. The SmartMirror may allow
using existing channels like online payments or payment card kiosk machinery to
pay and get a receipt with attached micro printer.
It will be apparent to those skilled in the art that various modifications and variations
can be made to the present embodiment without departing from the spirit and scope
of the invention. Thus, it is intended that the present embodiment and disclosure
cover the modifications and variations of this invention provided they come within the
scope of the appended claims and their equivalents. "A
if
Claims
We claim:
1. SmartMirror a 2 way glass mirror with fitted accessories like low form factor
computing power. 2d and 3d cameras, Wi-Fi, Bluetooth, Data Access 3g/4g
allowing global connection across retailers in different cities and parts of the
world, microphones, speakers, LCD/LED/Projector displays, SmartFilms to
adjust dynamically tints or simulate day night affect, sensors to detect inputs
such as touch screen, figure-print reader, credit card scanner,retina display,
proximity sensor, voice based response and other equipment's related to data
capture and display such as beacon, RFID tag readers, printer and scanner.
2. Acustom built in software for voice recognition , emotion detection , facial
recognition , gender recognition, age detection , formal or casual ware
detection.', background and foreground colour and pattern detection of clothes
or hair styles. This can further integrate with third party services or proprietary
services for accuracy and be able to recognize person or group of persons in
front of the mirror with high security and integrity of data using encryption. The
software can also recognize facial changes , mood changes , voice utterances
as suggestions as shown to factor the response and acceptance of the choice
without explicitly asking user for it and also show case what others of similar
profile have opted for.
3. Software wherein said system comprises of theability for retailers to upload
matching inventory to help suggest matches to a person based on current
clothing style and colour, price range or gender and age group. This also
allows vendors to upload Ad content which when the SmartMirror is idle can
be used a display or signage board.
4. Computer power and Software to enable billing and payment mechanisms
from the SmartMirror
5. The system as claimed in claim 2, 3 or 4, wherein the electronic device is a
mobile phone, tablet or handheld devices with blue tooth connect capabilities,
internet data connecting capabilities using wireless or wired medium and
ability to run mobile app on current of futuristic platforms, current know
platforms are iOS (Apple), Android (Google), Windows (Microsoft), Symbian,
BlackBerry, Firefox OS, Raspberry, IpT technology, Linux.
6. Software and system to display generic content like fashion news , climate ,
traffic or tailor made news as per interest group of the customer Software to
upload a garment image and find matches in the existing store
7. Software to allow video calling and speaking with a remote subject matter
expert for getting reviews about cloth selection or jewellery selection or
accessories selection
8. Software to help do an image translation and transposition thereby serving as
a virtual trial room with ability to simulate day / night environment and lighting.
The software also extends capability to transfer the images or content of the
SmartMirror to a securely paired phone which can be done by the user
himself on an individual case basis.
9. Software to detect voice response or gesture response using the placed 2d
and 3d cameras to detect emotions and changing emotion pattern, detect
comments and observations to come up with on the spot discounts for
concluding a sale successfully.
10. Software to allow payments on the SmartMirror using screen tap NFC or
Bluetooth or QR code scanning and integration securely with existing
payment gateways and generate receipts.
| # | Name | Date |
|---|---|---|
| 1 | 201611031797-Other Patent Document-190916.pdf | 2016-09-22 |
| 2 | 201611031797-FORM28-190916.pdf | 2016-09-22 |
| 3 | 201611031797-Form 5-190916.pdf | 2016-09-22 |
| 4 | 201611031797-Form 3-190916.pdf | 2016-09-22 |
| 5 | 201611031797-Form 2(Title Page)-190916.pdf | 2016-09-22 |
| 6 | 201611031797-Form 1-190916.pdf | 2016-09-22 |
| 7 | 201611031797-Form-9-230916.pdf | 2016-09-28 |