Virtual Makeover Applications for mobiles using Image processing
Technology

FIELD OF THE INVENTION

This invention relates to a virtual makeover application in the mobile platform services. More particularly, this invention enables users to pick and use any color shade from nature or from any image for image makeovers and save the new makeover image to enable these different shades to be used on various other photos later. It also facilitates e-commerce integration.

BACKGROUND OF THE INVENTION

With the aid of advanced technology, nowadays people can access their portable communication device with application program that can electronically change a virtual image of a person. The image can be modified using the program that places a virtual item, such as, a wig or makeup over the appropriate area of the person's face.

Through the use of the Internet, many companies have begun to use virtual visualization applications in attempt to personalize the on-line shopping experience that is as close to reality as possible. Beauty product vendors have also begun to use such virtual shopping techniques as well. Users can create a virtual figure to try on beauty products by uploading their personal photographic image (i.e., a "headshot").

U.S Patent No. 6,801,216 depicts a makeover system and method for providing a user with an image of how a person would look with different hair, glasses, makeup, etc. The system displays a list of overlay items such as wigs, glasses, eye shadow, eye liner, blush, lip color and lip liner. Here, the system superimposes the selected overlay item over the uploaded image regardless of the size of the image of the person and resizes the item to fit into the size of the uploaded image. The system also provides a composite image of the superimposed overlay item and the uploaded image of the person. Further, the composite image is saved in the user's hard-drive or digital storage medium for future use by the makeover system and it cannot be saved online.

U.S Patent Application No. 2009/0234716 deals with a computer program that describes methods for monetizing online personalized beauty product selections utilizing a technology for content-targeted internet advertising on a virtual makeover website. The computer program provides an advertising auction system related to particular facial features of the user and also offers them the opportunity to translate the look they have created in the makeover editor into different lighting conditions. Further, it is utilized for a gifting system to allow sale in which products used and makeover image may be given as gift package.

U.S Patent No. 7,079,158 describes about a virtual makeover system which allows user to apply beauty products to personal photographic image thereby creating a digitally enhanced image. The makeover process is achieved using some of the databases like image database, palette database and product database. Here, users can upload digital photographs of themselves or others, or can retrieve an image from the image database; the palette database utilized for makeovers can be pre-configured palettes created by vendors/service providers and / or user- created palettes. The product database facilitates e-commerce integration to user for online shopping of beauty care products. This virtual makeover system may be accessed by a user either through communications network or stored on the hard drive of a user's computer.
The above prior art were describing various virtual makeover system for trial makeovers with predefined colors and shades of cosmetic palettes and personalized online shopping of beauty care products.

Clearly, there is a need for application program providing both virtual makeover that enables users to extend their choices regarding colors and shades of the cosmetic products e.g.. Lip Stick, Lip Gloss, Lip Liner, Blush, Foundation etc from uploaded image, irrespective of time, place etc and e-commerce integration for purchasing beauty-care products as per their virtual utilization and selection.

SUMMARY OF THE INVENTION

The present invention relates to a virtual makeover application, l000lookz which enables users to experience image makeover and allows them to pick any colors and shades from nature and apply them manually & automatically and save the makeup combination as looks that can be used on different photos. The system also facilitates e-commerce integration.

The virtual makeover application, l000lookz offers a virtual trial "mobile makeover application" resulting in functional utility and fun / entertainment application for all users. This application is available with customizable tools with user friendly "icon click options" and finger movement recognition interface that differentiates it from other VMO application services currently available.

In one embodiment of the present invention, the virtual makeover application, l000lookz offers virtual trials for makeover using foundation, blush, lipstick, lip gloss, lip liner, eye liner and eyeshadow in mobile platform. This application enables users to upload their image or model image from the gallery and after uploading the image various co-ordinates of facial features like face outline, eyes, eye brows, nose, lips, cheeks, jaws etc are detected automatically as well as manually for fine tuning.
In another embodiment of the present invention, user can apply cosmetics over their face using the cosmetic palette of colors and shades for each facial feature like face, cheeks, lips and eyes as like in a real environment and also even pick colors from nature and select that particular shade to be used on the desired facial feature while doing various makeovers by applying different makeup combinations and also changing the intensity of the same.

In another embodiment of the present invention, user can apply an already made-up look on their uploaded image. The virtual makeover application stores the virtual madeover images as well as the makeup combination as template in the database of the web server for later use. So, the user can apply the stored makeup combination for their different photos / images later. In addition to that, madeover images and makeup combinations can be shared among social networking sites

In another embodiment of the present invention, user can apply cosmetics over their face using the cosmetic palette of colors and shades listed in the application or from nature to each facial feature like face, cheeks, lips and eyes as like in a real environment. For applying nature colors and shades, the user can upload any picture / image from nature and pick the colors from that image for virtual makeover. User can also adjust the intensity of the selected color / shades.

In one of the embodiments of the present invention, the virtual makeover application, l000lookz provides "before & after feature" options for comparing post makeover look of the user, and also offers provision for saving post makeover photos to gallery and further sharing them with social networking sites.

In the other embodiment of the present invention, the virtual makeover application, l000lookz facilitates the users for e-commerce integration thereby providing opportunity to purchase cosmetic products as per their virtual utilization and selection.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be more fully understood from the following detailed description taken in conjunction with the accompanying drawings, in which:

FIG. 1 is a flowchart describing the process flow of virtual makeover system of the present invention

FIG. 2A and 2B illustrating detection process of face and various facial coordinates

FIG. 3A depicting the process of choosing colors and shades for virtual makeover from different palettes

FIG. 38 demonstrating application process of cosmetics over each facial feature

FIG. 3C schematically explaining detailed application process of cosmetic products like foundation. Lip Stick, Lip Gloss and Lip Liner / Eye Shades and Eye Liners over each facial feature

FIG. 4 exemplifying the process of facilitating e-commerce integration

FIG. 5 is a technical drawing describing the process flow of virtual makeover system using SOA architecture

DETAILED DESCRIPTION OF THE INVENTION

The present invention relates to an application program that allows user for virtual makeover to choose 'nature color' or 'preferred color' from uploaded photos or images thereby creating a digitally enhanced image by using image processing technology. This application program can also be run in the mobile platform services. The application program also allows user to purchase cosmetic products with particular color which is selected from uploaded photos or images (i.e. 'nature colour'), through online. It allows the user to compare the enhanced images with original using "before & after feature" options and also facilitate to share or upload the enhanced images with social networking websites. This application has been developed using XML & X-Code.
FIG. 1 is a flowchart describing the process flow of virtual makeover system of the present invention. The virtual makeover process is achieved using makeover application program l000lookz in the mobile platform. This application program enables user to upload their photos or model pictures from the gallery or a new picture. Once uploading is done, the coordinates of various facial features like face, cheeks, lips and eyes are detected using algorithm and face tracking software. Users can apply cosmetics over each facial feature by selecting colors and shades from the cosmetics palette listed in the application. After completing the virtual makeover, users can compare their post makeover look using before & after feature options in the makeover application program and save the completed makeover image to gallery.

The finished makeover image can also share with social networking sites. This application is available with customizable tools with user friendly "icon click options" and finger movement recognition interface that differentiates it from other VMO application services currently available.

FIG. 2A and 2B illustrating detection process of face and various facial coordinates. The photo of the users has been uploaded hence the face in the uploaded image / photo will be detected using an algorithm. Once the face in the photo has been detected, various facial co-ordinates / points like face outline eyes, eye brows, nose, lips, cheeks, jaw etc. will be identified using the "face tracking software". The detected facial co-ordinates are given as (x, y) points from the picture. Hence the co-ordinates of various facial features are detected automatically by face tracking software and also fine tuned by users for better makeover results. Users can also upload multiple pictures and get facial coordinates / points for all the faces simultaneously.

FIG. 3 A depicts the process of choosing colors and shades for virtual makeover from different palettes. Once the facial coordinates are identified, virtual makeover process is commenced by applying cosmetics over each facial feature like face, cheeks, lips and eyes etc. The colors and shades of the cosmetic products like foundation, blush, lip stick, lip gloss, eye-shadow, eye liners etc are chosen from pre-configured cosmetic palette and also from nature (user can take any picture from nature, upload it and pick any of the colors from that image). Users can also create their own color palette as their wish.

FIG. 3B demonstrates application process of cosmetics over each facial feature. Here the application of cosmetic products like foundation, blush, lip liner, lip stick, lip gloss, eye liner, eye brows, eye lashes, shadow highlight, shadow crease, shadow eyelid etc over each facial feature like face, eyes, eye brows, lips, cheeks etc and also hair styling are achieved through an algorithm which allows users to choose any color and shade for virtual makeover. The selection of colors and shades for the cosmetic products should be exercised through cosmetic palettes listed in the application and also photographic image downloaded from the gallery or internet. Further, the user can apply any combination of shades and colors and also change the intensity of the selected shades and colors.

Users can also save the combination of the cosmetic products that actually gave them the madeover look. This combination is saved as a look which can be used later on other photos. Instead of saving just the made up face, we are trying to save the combination that gave the face the look.

FIG. 3C schematically explaining the detailed application process of cosmetic products like foundation. Lip Stick, Lip Gloss and Lip Liner / Eye Shades and Eye Liners over each facial features. Here algorithm is used for drawing the curve with multiple control points over the face and then eliminating those control points corresponding to eyes and lips region. After removing / eliminating the eyes, brows and lips region the colour is applied to all the other layers in the face for a near perfect foundation finish. User can get the perfect curve to address the corresponding facial co-ordinates / points by using an algorithm. The control points are created for smooth transition of the curve along the lips surface instead of line or a very narrow curve. Finally, by detecting those control points, coloring of lips / eyes can be achieved through lip liner, lip stick, lip gloss, eye brows, eye liner, eye lashes etc in order to provide a perfect virtual makeover image.

FIG. 4 exemplifying process of facilitating e-commerce integration comprising the following steps: application program facilities to display completed makeover images with the help of "before & after look feature". The application program also facilitates user to purchase selected products through online by automatically displaying list of vendors and offering them corresponding products for their makeover. User can select from either list of vendors which is automatically exhibited by software or from advertisements displayed on the corresponding webpage. Further, the selected products are added to shopping cart for future use. Also, user can upload or share their finished makeover images to social networking websites.

Fig. 5 illustrates the fly virtual makeover system using SOA architecture. User can connect iphone with 'image processing web-server' by means of unique user profile. For utilizing the virtual image makeover, user should upload their image(s) from iphone to web server and get various facial co-ordinates of the uploaded image from the 'image processing web-server'. After madeover, user will be able to store the enhanced images in the database of the web server and retrieve those images for later use.

Here, the online program not only stores the virtual madeover images but also the makeup combination as template in the database of the web server for later use. So, the user can apply the same makeup combination for their different photos / images. In addition to that madeover images / makeup combinations can be shared among social networking sites. The SOA architecture allows user / customer to send the analytical data to the clients. Based on the customer's analytical data, clients can update their product information in the web-server and send notifications to all customers.

While the foregoing written description of the invention enables one of ordinary skill to make and use what is considered presently to be the best mode thereof those of ordinary skill will understand and appreciate the existence of variations, combinations, and equivalents of the specific embodiment, method, and examples herein. The invention should therefore not be limited by the above described embodiment, method, and examples, but by all embodiments and methods within the scope and spirit of the invention as claimed.

WE CLAIM:
1. An online application program includes plurality of algorithm for virtual makeover: said program allowing user to choose and apply 'preferred color / shade' that may be 'nature color / shade' from their uploaded images that can be own photographic images or can be downloaded from internet and / or predefined color palette and / or create user defined color palette; said program allowing user to online purchase the selected cosmetic products with said color / shade from group of vendors and / or automatically display list of vendors selling particular user preferred cosmetic products with said color / shade; said program allowing modified / enhanced images compare with original images and stored and / or shared in the social networking websites.

2. A 'nature color / shade' means, color / shade said in claim 1 which is selected from uploaded photographs, images, maps, picture, scanned images.

3. A 'preferred color / shade' means, color / shade said in claim 1 which is selected from uploaded photographs, images, maps, picture, scanned images or predefined color / shade palette.

4. A 'own photographic images' said in claim 1 means, images captured by user of virtual makeover or download from internet or from image gallery.

5. A 'user defined color / shade palette' said in claim 1 means, palette which is created by user.

6. An 'online purchase' said in claim 1 means, user can purchase preferred cosmetic products with said color / shade from list of vendors in which they are selling cosmetic products through online or particular webpage, or from advertisement of related vendor which they are selling user preferred cosmetic products with said color / shade

7. An 'application program' said in claim 1 wherein that can be used in mobile phone, PDA, Laptop, computer

8. An 'application program' said in claim 1 wherein written in xml, xcode or any suitable program codes.

9. An application program includes plurality of algorithm for virtual makeover said program comprising the steps of:
said algorithm detects the face of the uploaded images; detects facial co-ordinates automatically on the uploaded images using 'face tracking software' and / or manually fine- tune the facial co-ordinates/ points;
said algorithm allowing user to choose and apply 'preferred color / shade' or 'nature color / shade' from their uploaded images that can be own photographic images or can be download from internet and/ or predefined color / shade palette and/ or create user defined color / shade palette from nature; adjust the intensity of applied color / shade;
said algorithm draws the curve with multiple control points other than eyes and lips region while applying foundation;
further said algorithm identifies the perfect curve to address lips and eyes region and create control points for applying lip stick, lip gloss, eye liner, eye brows etc;
said program allowing user to online purchase the selected cosmetic products with said color / shade from group of vendors and / or automatically display list of vendors selling particular user preferred cosmetic products with said color / shade; said program allowing modified / enhanced images compare with original images and stored and / or shared in the social networking websites.

10. A 'nature color / shade' said in claim 9 means, color / shade which is selected from uploaded photographs, images, maps, picture, scanned images.

11. A 'preferred color / shade' said in claim 9 means, color / shade which is selected from uploaded photographs, images, maps, picture, scanned images or predefined color / shade palette.

12. An 'own photographic images' said in claim 9 means, images captured by user of virtual makeover or download from internet or from image gallery.

13. A 'User defined color / shade palette' said in claim 9 means, palette which is created by user.

14. An 'online purchase' said in claim 9 means, user can purchase preferred cosmetic products with said color / shade from list of vendors in which they are selling products through online or particular webpage, or from advertisement of related vendor which they are selling user preferred cosmetic products with said color / shade.

15. An 'application program / algorithm' said in claim 9 wherein that can be used in mobile phone, PDA, Laptop, computer.

16. An 'application program' said in claim 9 wherein written in xml, xcode or any suitable program codes.

17. A 'facial co-ordinates' said in claim 9 means, face outline, eyes, eye brows, nose, lips, cheeks, jaws.

18. An application program includes plurality of algorithm for virtual makeover said program comprising the steps of:
said application program having different login profile for users / customers and clients / vendors in database of the web server; herein program allowing user to edit their profile and clients / vendors to update their products in the webserver;
said program allowing user to directly send the analytical data to clients / vendors via web server; further clients / vendors view the analytical data and update their product information in the web server based on user sent analytical data;
said program allowing user to manually or automatically store the made over cosmetic / shade(s) combinations as template in database of the web server for later use; wherein applying for same or different images / photos; madeover images / cosmetic / shade(s) combinations are shared to members of social group and / or sharing it social networking access / sites wherein access based on user account information.

19. An 'application program' said in claim 18 wherein executed in both online and offline or combination thereof .