Claims:CLAIMS:
I / We Claim:
1. An artificial intelligence based smart home automation system, comprising:
plurality of appliances configured to be controlled by the system;
a voice recognition module configured in connection with a voice recognizing device to receive multiple voice commands from a user;
an image capturing module configured in connection with a camera to scan and recognize the user face;
a gesture sensing module configured in connection with a hand gesture sensor to recognize multiple hand signatures of the user;
a microcontroller configured with a trained artificial intelligence algorithm to receive said multiple voice commands, said recognized user face and said multiple hand signatures of the user and output atleast one control command to control said plurality of appliances;
a switching module configured to receive said control commands and thereby control atleast one home appliance from said plurality of appliances; and
a door unlocking module configured to receive a control command from the microcontroller to unlock home door based on the recognized user face.
2. The artificial intelligence based smart home automation system as claimed in claim 1, wherein said plurality of appliances include fan, light, air conditioning, TV etc.
3. The artificial intelligence based smart home automation system as claimed in claim 1, wherein said image capturing module recognizes the user face from images captured by the camera.
4. The artificial intelligence based smart home automation system as claimed in claim 1, wherein said voice recognition module, said image capturing module and said gesture sensing module are trained with required commands to recognize said multiple voice commands, said user face and said multiple hand signatures of the user.
5. The artificial intelligence based smart home automation system as claimed in claim 1, wherein said microcontroller is preloaded with multiple switching commands to output said control commands to said switching module.
6. The artificial intelligence based smart home automation system as claimed in claim 1, wherein said switching module is a relay.
7. The artificial intelligence based smart home automation system as claimed in claim 1, wherein said control commands include commands either to activate or deactivate an appliance or to control or adjust a feature of the appliance.
8. The artificial intelligence based smart home automation system as claimed in claim 1, wherein said microcontroller is further interfaced with a display module to display the system operation.
9. The artificial intelligence based smart home automation system as claimed in claim 8, wherein said display module is an LCD screen.
10. A method for artificial intelligence based smart home automation, comprises:
inputting multiple input commands by user either through a voice recognition module, an image capturing module and a gesture sensing module;
receiving and processing said user input commands by a microcontroller using artificial intelligence;
transmitting atleast one control command to a switching module by the microcontroller based on said user input commands;
controlling atleast one home appliance by the switching module if said input commands include either voice commands or hand signatures; and
transmitting a control command to a door unlocking module by the microcontroller to unlock home door if said input commands include user face recognition. , Description:DESCRIPTION:
Field of the invention:
[0001] The present disclosure generally relates to the technical field of smart home automation system, and in specific relates to a smart home automation system using artificial intelligence, voice recognition, face recognition and gesture sensing.
Background of the invention:
[0002] With social progress, requirement for higher quality of life is increased and intelligent electronic devices are evolved that offers comfort to the people and also becomes safer, energy-conservation, intelligence and convenience. As society advances, households within the society may become increasingly diverse, having varied household norms, procedures, and rules. Unfortunately, because so-called smart devices have traditionally been designed with pre-determined tasks and/or functionalities, comparatively fewer advances have been made regarding using these devices in diverse or evolving households or in the context of diverse or evolving household norms, procedures, and rules.

[0003] Home automation involves controlling various devices or systems that can be present in homes. Home automation technologies can allow for local and/or remote control of home automation devices. Remote control of devices has an extensive history. The history of home automation has been characterized by an absence of device interface standards, high costs, and awkward user interfaces. Until recently, computer based home automation was largely for hobbyists or the very wealthy.

[0004] Computerized devices are used in a variety of home automation applications such as, without limitation, autonomous vacuum cleaners, multifunction remote controllers, entertainment appliances, lighting systems and other appliances. Some existing devices may be pre-programmed at a factory in order to perform desired functionality. Some existing devices may be programmed by a user in order to perform desired functionality. Some home automation devices may interface with a portable device running a specific application in order to enable a user to operate the appliance.

[0005] Smart home technology allows users to control and monitor their connected home devices from Smart home apps, smart phones, or other networked devices. Users can remotely control connected home systems whether they are home or away. This allows for more efficient energy and electric use as well as ensuring your home is secure. Smart home technology contributes to health and well-being enhancement by accommodating people with special needs, especially older people.

[0006] Recently, a number of devices that perform control by receiving video or sound are increasing. The autonomous vehicle recognizes and analyzes the input data to control movement appropriate to the situation. Smartphones or security devices receive images, sounds, etc. to determine whether they are registered users. Devices with a voice recognition function recognize and analyze the voice and perform a control appropriate to the intention of the voice.

[0007] Compared with common household, smart home comprises network communication, information of household appliances, equipment automation; provide comprehensive information exchange function, even various energy expenditure sections. However, there are some shortcomings in use for existing smart home door lock where intelligence degree is relatively low. The opening of household door lock using remote control has disadvantages. In equipment, the performance for keeping its antitheft is poor and thereby unable to meet the user demand.

[0008] There are many existing systems on Artificial Intelligence based smart home. GSM based home automation is implemented in earlier days. Next, sound recognizing home automation system is introduced and then the artificial intelligence era started by implementing sensing devices by a semi-automated system is implemented during thereby increasing rapidly its usage. The further evolved voice recognition smart home came across many home applications controlling home appliances.

[0009] Hence, there is a need for an Artificial Intelligence based smart home automation system using internet of things that provides flexible, feasible and secured home automation system with low cost. There is a need for a system that controls different types of home devices and secures home locking system using Artificial Intelligence. There is a need for a system that aids blind and deaf people using voice recognition and hand gestures. There is a need for a home automation system that controls lighting, climate, entertainment systems, and appliances.
Objectives of the invention:
[0010] A primary objective of the present invention is to control the different types of home devices and secure the home locking system using Artificial Intelligence and Internet of Things.

[0011] Another objective of the invention is to provide home security such as door lock and unlock using Artificial Intelligence and Internet of Things.

[0012] The other objective of the invention is to control home devices such as lighting, climate, entertainment systems, and appliances.

[0013] Yet another objective of the invention is to control home devices through voice commands or hand signs using automatic switching system that aids blind and deaf people.

[0014] Further objective of the invention is to control home devices either activating or inactivating the devices or by controlling different features of the devices using artificial intelligence.

[0015] Yet another objective of the invention is to design and implement a low cost but flexible, feasible and secured home automation system.
Summary of the invention:
[0016] The present disclosure proposes an Artificial Intelligence based smart home automation system using internet of things. The following presents a simplified summary in order to provide a basic understanding of some aspects of the claimed subject matter. This summary is not an extensive overview. It is not intended to identify key/critical elements or to delineate the scope of the claimed subject matter. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is presented later.

[0017] According to aspect of the invention, the present invention discloses an artificial intelligence based smart home automation system that comprises plurality of appliances, a voice recognition module, an image capturing module, a gesture sensing module, a microcontroller, a switching module and a door unlocking module. The plurality of appliances is configured to be controlled by the system. The voice recognition module is configured in connection with a voice recognizing device to receive multiple voice commands from a user.

[0018] The image capturing module is configured in connection with a camera to scan and recognize the user face. The image capturing module recognizes the user face from the images captured by the camera. The gesture sensing module is configured in connection with a hand gesture sensor to recognize multiple hand signatures of the user. The voice recognition module, the image capturing module and the gesture sensing module are trained with required commands to recognize the multiple voice commands, the user face and the multiple hand signatures of the user.

[0019] The microcontroller is configured with a trained artificial intelligence algorithm to receive multiple voice commands, recognized user face and multiple hand signatures of the user and output atleast one control command to control the plurality of appliances. The microcontroller is preloaded with multiple switching commands to output control commands to the switching module. The control commands include commands either to activate or deactivate an appliance or to control or adjust a feature of the appliance.

[0020] The switching module is configured to receive the control commands and thereby control atleast one home appliance from the plurality of appliances. The switching module is a relay. The door unlocking module is configured to receive a control command from the microcontroller to unlock home door based on the recognized user face. The plurality of appliances includes fan, light, air conditioning, TV etc. The microcontroller is further interfaced with a display module to display the system operation and the display module is an LCD screen.

[0021] According to another aspect of the invention, a method is disclosed for artificial intelligence based smart home automation. The method comprises multiple input commands given as input by user either through the voice recognition module, the image capturing module and the gesture sensing module. The user input commands are received and processed by a microcontroller using artificial intelligence. Atleast one control command is transmitted to the switching module by the microcontroller based on the user input commands.

[0022] Next, atleast one home appliance is controlled by the switching module if the input commands include either voice commands or hand signatures. Or else a control command is transmitted to a door unlocking module by the microcontroller to unlock home door if the input commands include user face recognition.

[0023] Further objects and advantages of the present invention will be apparent from a study of the following portion of the specification and the claims.
Detailed description of drawings:
[0024] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate an embodiment of the invention, and, together with the description, explain the principles of the invention.

[0025] Fig. 1 illustrates a block diagram representation of a smart home automation system using artificial intelligence and internet of things, in accordance to an exemplary embodiment of the invention.

[0026] Fig. 2 illustrates a method for artificial intelligence based smart home automation, in accordance to an exemplary embodiment of the invention.
Detailed invention disclosure:
[0027] Various embodiments of the present invention will be described in reference to the accompanying drawings. Wherever possible, same or similar reference numerals are used in the drawings and the description to refer to the same or like parts or steps.

[0028] Home automation is building automation for a home, called a smart home or smart house. A home automation system will control lighting, climate, entertainment systems, and appliances. It may also include home security such as access control and alarm systems. When connected with the Internet, home devices are an important constituent of the Internet of Things. The home automation system typically connects controlled devices to a central hub or gateway. The user interface for control of the system uses wall-mounted terminals, tablet or desktop computers, a mobile phone application, or a web interface, that may also be accessible off-site through the Internet.

[0029] The present invention proposes controlling of different types of home devices and securing home locking system using Artificial Intelligence with voice recognition, face recognition and hand gestures using hologram photographic recording technology, and wherein the hand gestures recognizing system is specially designed for blind and deaf people.

[0030] According to an exemplary embodiment of the invention, Fig. 1 depicts a block diagram representation of a smart home automation system 100 using artificial intelligence and internet of things (IoT). The system 100 comprises a voice recognition module 101, an image capturing module 102, a gesture sensing module 103, a microcontroller 104, a switching module 105, plurality of appliances 106 i.e., device 106a, device 106b to device 106n, a door unlocking module 107 and a display module 108. The plurality of appliances 106 include fan, light, air conditioning, TV, motor etc.

[0031] In detail, the voice recognition module 101 is configured in connection with a voice recognizing device to receive multiple voice commands from a user. The image capturing module 102 is configured in connection with a camera to scan and recognize the user face. The image capturing module 102 recognizes images captured by the camera. The gesture sensing module 103 is configured in connection with a hand gesture sensor to recognize multiple hand signatures of the user. Hand signatures include various hand movements to control device operations.

[0032] The voice recognition module 101, the image capturing module 102 and the gesture sensing module 103 are trained with required commands to recognize multiple voice commands, user face and multiple hand signatures of the user. The microcontroller 104 is configured with a trained algorithm to receive the multiple voice commands, recognized user face and the multiple hand signatures of the user and output control commands to control the plurality of appliances.

[0033] The microcontroller 104 is preloaded with multiple switching commands to output the control commands to the switching module 105. The control commands include commands either to activate or deactivate an appliance or to control or adjust a feature of the appliance. The microcontroller is further interfaced with a display module 108 to display the system operation. The display module is an LCD screen.

[0034] The switching module 105 is configured to receive the control commands and thereby control the plurality of home appliances 106. The switching module is a relay. The door unlocking module 107 is configured to receive a control command from the microcontroller to thereby unlock home door based on the recognized user face.

[0035] According to another exemplary embodiment of the invention, Fig. 2 depicts a method 200 for artificial intelligence based smart home automation. The method 200 comprises the following steps. At step 201, multiple input commands are given by the user either through the voice recognition module, the image capturing module and the gesture sensing module. At step 202, the user input commands are received and processed by the microcontroller using artificial intelligence.

[0036] At step 203, control commands are transmitted to the switching module by the microcontroller based on the user input commands received. At step 204, verification is done whether the input commands are voice commands or hand signatures. At step 205, the home appliances are controlled by the switching module if the input commands are confirmed as voice commands or hand signatures. If not, then at step 206, verification is done whether the input command is face recognition. At step 207, a control command to the door unlocking module is transmitted by the microcontroller to unlock home door if the input command include user face recognition.

[0037] Here, when the voice commands or hand signs are given to the module then corresponding device switches. For example, when voice command is given as “light” to the device then it the light gets automatically turned “ON” by the artificial intelligence system through the switching module which is connected to the home appliance or device. When the command is given as “light off” then the device gets automatically turned “OFF”. Similarly, face recognition door unlocking system will be provided, where if the face is recognized the door will unlock and open automatically or manually based on type of the door. Respectively, the artificial intelligence based system switches all the home appliances like fan, air conditioning TV, etc. The operation is displayed on the LCD indicating the controlled status.

[0038] Hence, artificial intelligence based smart home using wireless voice transmitting system is implemented using voice recognition and by giving voice commands to the circuit by which the home devices are automatically turned on and off. Further, more and more increasing AI based smart home applications can be implemented for fully automated application like when human enters room then the home appliances will activate and when human leaves the room then home appliances will be deactivated and etc.

[0039] Thus from the proposed invention, control of different types of home devices and secured home locking system is achieved using artificial intelligence and Internet of Things. Home devices such as lighting, climate, entertainment systems, and appliances can be controlled. Voice commands or hand signs can be given to control the home devices using automatic switching system that aids blind and deaf people. Further, control of home devices includes either activating or inactivating the devices or controlling different features of the devices using artificial intelligence. Therefore, a low cost, flexible, feasible and secured home automation system is designed aiding the blind and deaf people.

[0040] It will readily be apparent that numerous modifications and alterations can be made to the processes described in the foregoing examples without departing from the principles underlying the invention, and all such modifications and alterations are intended to be embraced by this application.