Sign In to Follow Application
View All Documents & Correspondence

Gesture Based Virtual Mouse

Abstract: The present invention seeks to replace the conventional input device "mouse" and in fact requires only gestures by user. There are two major parts of the invention. The first one is "Gesture based finger mouse" in which the mouse operations are replaced by gestures made by the hand in the air given that the camera is used as an interface. The camera is programmed in such a way that it detects the fingertips and successive algorithm is written to track the index finger motion which eventually moves the mouse pointer. The algorithm is also written such that it performs clicking operations as done by conventional mouse by using just the clicking gesture made by the index finger. Another part of the invention is "Virtual Mouse". This has obviated the use of conventional mouse or any other pointing device. This uses a normal camera (>1.0 megapixel) which is a focused on the hand that is kept on the table. The algorithm is written such that it detects the hand movement which eventually moves the mouse pointer and performs clicking by tapping the index finger on the table(which we eventually do while clicking the mouse).

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
29 June 2011
Publication Number
46/2011
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
Parent Application

Applicants

1. ASHUTOSH RAMLAL SINGANDHUPE
ANJALI APPARTMENT, PLOT-180, FLAT-F2, NEAR MAHARANA PRATAP POLICE STATION, TRIMURTHY NAGAR-440 022,NAGPUR,MAHARASHTRA,INDIA

Inventors

1. ASHUTOSH RAMLAL SINGANDHUPE
ANJALI APPARTMENT, PLOT-180, FLAT-F2, NEAR MAHARANA PRATAP POLICE STATION, TRIMURTHY NAGAR-440 022,NAGPUR,MAHARASHTRA,INDIA

Specification

FORM 2
THE PATENT ACT 1970
(39 of 1970)
The Patents Rules, 2003 COMPLETE
SPECIFICATION
(See section 10 and Rule 13)
1. TITLE OF THE INVENTION
GESTURE BASED VIRTUAL MOUSE
2. APPLICANT (S)
(a) NAME: ASHUTOSH RAMLAL SINGANDHUPE
(b) NATIONALITY: INDIAN
(c) ADDRESS: ANJALI APPARTMENT,PLOT-180,FLAT-F2,.NEAR MAHARANA PRATAP POLICE STATIONJRIMURTHY NAGAR-440022,NAGPUR,MAHARASHTRA, INDIA

BACKGROUND OF THE INVENTION:
There are lots of developments made in the gesture based computing in the recent years. Computers being a part of our daily life has to be remodeled into something unique apart from the present day technologies for the ease of the consumers.
This invention generally deals with the mouse of the computer. Mouse which performs most of the computer operations like copy and paste is remodelled in this invention into a complete invisible gesture based mouse.
The second part of the invention replaces the existing IR Lasers and IR cameras based invisible mouse. Instead it employs a normal camera.
SUMMARY
This invention has more of an algorithm or a software approach rather than adding new hardware devices to the system. This algorithm has been written in such a way that it detects the fingertips and tracks its motion in the environment. The motion of the fingertips is eventually programmed to move the mouse pointer. There is introduction of two major concepts called "stability window" and "tracking window" (term coined by the inventor himself),based on which the whole system is stabilized from the natural distortions and eventually tracks the fingertips. The different gestures are translated as commands like right click, left click etc.
DESCRIPTION OF THE INVENTION:
The figures in the above pages describe basic methodology to perform the operation of mouse. The first five figures describe the operation of 'gesture based finger mouse' which performs the moving of cursor by tracking the index finger. A successful algorithm is written in order to detect the fingertips. It performs the functions of mouse by sitting in the chair and making gestures in the air. Figure 1 describes the initial step of performing the gesture based communication. It clearly shows the thumb, the index finger and the middle finger. The user is required to keep fingers in this position for one second. Within one second interval, algorithm determines the offset of the thumb from the index finger and from the middle finger. Once this is done, the user can move the cursor to the required position by moving the index finger and closing the thumb and the middle finger as shown in figure 2.

Two major concepts governs the tracking of the finger efficiently. One is the imaginary rectangular box called stability window that holds a particular pixel location and the other is tracking window which follows motion of an index finger. After the motion is tracked the user can choose to click on a particular window by releasing the thumb as shown in the figure 3 and performing the clicking gesture in air as shown in the figure 4.Right clicking operations can be performed by simply releasing the middle finger.
The second part of the invention is the development of virtual mouse for users who are habituated with conventional mouse (hardware). The gestures in air mouse described as a first invention earlier facilitated input in reclining posture, the second invention allows traditional mouse use sans the hardware part. So another technique was rebuilt in order to make a gesture based mouse. It is called as 'invisible mouse'. This term was originally coined by John Cauchi and he has efficiently made this application using an IR camera and IR laser, both equipments required specially and specifically. However this invention does not require such specific and relatively expensive equipment. The application is built on the main motive of using only a simple camera (>1.0 megapixel is advisable). A rotatable camera is placed on one side of the laptop as shown in the figure 6.The camera is focused on the hand which is kept on the table for user convenience. The algorithm for the camera is written in such a way that it detects the hand kept on the table and accordingly tracks it's motion which eventually moves the mouse cursor accordingly (completely similar to the use of an optical mouse).If a user wants to click then he/she has to just perform a clicking gesture that is tapping with the index finger as shown in figure 5.
BRIEF DESCRIPTION OF FIGURES:
FIGURE -1 shows the initial arrangement to be made so that the index finger,the thumb and the middle finger is detected.
FIGURE-2 shows the gesture to be made in order to perform movement of index finger. The algorithm successfully tracks the movement of index finger.
FIGURE -3 shows the initial gesture to be made in order to perform clicking operation. The operation can be performed by a gesture as shown in the next figure.
FIGURE -4 shows the gesture to be made to perform clicking operation.
FIGURE-5 is related to the second part of the invention where mouse operations can be made by placing the hand on the table which comes under the visual range of the camera.
FIGURE-6 shows a user using the virtual mouse.

I CLAIM,
1. The main part is named as 'Virtual mouse' performs the same operations like digital mouse. The user performs all the operations like traditional mouse but the mouse is only imaginary and motion of the hand/gestures is detected using an algorithm that employs a single movable camera (>1.0 megapixel is advisable however VGA camera can also used but the detection is poor). This is exactly similar to the invention made by John Cauchi, however the current invention avoids the use of IR camera and IR Laser and uses only a normal camera for performing the operations.
2. The other part of the invention named 'gesture based fingermouse' obviates the use of any device attached to hand and uses only single camera i.e attached camera and performs the operations of the mouse. The difference is that hardware part (mouse) is dispensed off and input is provided simply through gesture.

Documents

Application Documents

# Name Date
1 1882-MUM-2011- AFR.pdf 2023-04-21
1 1882-MUM-2011-FORM 9(29-6-2011).pdf 2018-08-10
2 1882-mum-2011-form 5.pdf 2018-08-10
2 1882-MUM-2011-AbandonedLetter.pdf 2018-10-31
3 1882-mum-2011-form 3.pdf 2018-08-10
4 1882-mum-2011-form 2.pdf 2018-08-10
4 1882-mum-2011-abstract.pdf 2018-08-10
6 1882-MUM-2011-FORM 18(29-6-2011).pdf 2018-08-10
6 1882-mum-2011-claims.pdf 2018-08-10
7 1882-mum-2011-form 1.pdf 2018-08-10
7 1882-mum-2011-description(complete).pdf 2018-08-10
8 1882-MUM-2011-FER.pdf 2018-08-10
8 1882-mum-2011-drawing.pdf 2018-08-10
9 1882-MUM-2011-FER.pdf 2018-08-10
9 1882-mum-2011-drawing.pdf 2018-08-10
10 1882-mum-2011-description(complete).pdf 2018-08-10
10 1882-mum-2011-form 1.pdf 2018-08-10
11 1882-MUM-2011-FORM 18(29-6-2011).pdf 2018-08-10
11 1882-mum-2011-claims.pdf 2018-08-10
13 1882-mum-2011-form 2.pdf 2018-08-10
13 1882-mum-2011-abstract.pdf 2018-08-10
14 1882-mum-2011-form 3.pdf 2018-08-10
15 1882-mum-2011-form 5.pdf 2018-08-10
15 1882-MUM-2011-AbandonedLetter.pdf 2018-10-31
16 1882-MUM-2011-FORM 9(29-6-2011).pdf 2018-08-10
16 1882-MUM-2011- AFR.pdf 2023-04-21

Search Strategy

1 1882-MUM-2011_SS_08-09-2017.pdf