Description:INTERNET OF THINGS (IOT) BASED HOME AUTOMATION SYSTEM USING AUGMENTED REALITY
Field of Invention
It is applicable in operating light bulbs, Kitchen appliances, security systems and controlling any other electrical items using Augmented reality as a medium along with IoT. It may be applicable in Industry level in future.
The objectives of this Invention
The primary purpose of home automation is to be of assistance to elderly and disabled individuals. Augmented reality gives users the ability to operate household appliances thanks to this. The users have a simpler and more effective means of controlling the devices. We are able to enable multiple operations on appliances, such as manually, via an app, via AR, and so on.
Background of the Invention
Through the use of augmented reality, virtual objects can now be experienced in the physical environment. There are many applications for augmented reality, including navigation in real-world surroundings, advertising, the military, emergency services, art, video games, architecture, sightseeing, education, entertainment, commerce, information visualization, and more. The fact that augmented reality applications are now accessible on a wide variety of smart devices and are simple to operate is the driving force behind the recent surge in popularity of this technology. In theory, augmented reality can be implemented on any computer or handheld device that uses video-see through technology. This technology allows users to "see through" the display, allowing them to observe both the real environment and computer-generated things that have been placed on top of it. Because of advances in automation technology, life is becoming less complicated and more straightforward in all respects. The use of automatic systems, as opposed to manual ones, is becoming increasingly popular in today's world. The Internet has been a significant contributor to the development of the field of automation.
This invention defines a location-specific augmented reality capability for portable devices using a camera (US2018/10089794B2). The system and method use recent images or digital drawings to help the user orient the portable device. Once synchronized, a digital scene is projected to the viewer over the camera view of the current, real-world surroundings, producing an augmented reality experience.
A technique may involve rendering a first view of a 3-D virtual scene from a position in the scene (US2018/10078917B1). The method may additionally render a second view with content items. The second scene may comprise a view of the display device as seen through augmented-reality glasses that display the content objects. Method may also include combining the first and second views. Method may also include displaying composite view on VR headset.
Extrapolating augmented reality is described. In one or more implementations, an augmented-reality display frame is produced based at least in part on an optical basis that characterizes a computer device's present orientation or position (US2017/9613463B2). While the frame is rendered, an extrapolation based on a previous basis and a sensor basis generates an updated optical basis that describes a likely orientation or position of the part of the computing device. The extrapolation accounts for a lag time between rendering the frame and displaying it on the augmented-reality display. Before the rendered frame is displayed, it is updated based at least in part on the updated optical basis that defines the likely orientation or position of the computing device portion.
Generate, perform, and report digital surveys using augmented reality and/or virtual reality devices (US2019/0139318A1). In one or more implementations, the disclosed systems and methods let administrators generate digital surveys using interactive virtual worlds and/or augmented reality aspects. The disclosed systems and methods can deliver digital surveys using augmented reality and/or virtual reality devices by monitoring user interactions and providing digital surveys based on the monitored user interactions. The disclosed systems and techniques can provide survey findings and allow administrators to interact with them using augmented or virtual reality devices.
An augmented reality display system uses map points to represent real-world items (US2018/10127723B2). The augmented reality system also includes a processor that communicates with one or more individual augmented reality display systems to pass a piece of passable world model data based at least in part on respective locations.
Summary of the invention
The proposed work integrates mobile AR with IoT, to control household appliances, with the help of cloud. Augmented reality (AR) is used to allow virtual pop ups when the camera of the cell phone is pointed towards the targeted images. The pop up enables us to turn on or off the supply by simple touch selection thus improving ways of automation.
Detailed description of the invention
Because of its enhanced safety and security, home automation is becoming increasingly popular. Home automation has advanced to the point that it can monitor all of a home's appliances. [1] Smart home technologies, such as home automation, save money and resources while also being easy to use. User happiness and comfort are the primary goals of this system. A safe, comfortable, and convenient living for every family is a modern society's goal. The field of home automation holds a lot of promise. Its primary advantages include improved comfort and security, as well as more efficient use of energy and other resources, resulting in significant financial savings over time. The design of a home automation system has a number of considerations. New devices should be able to be quickly integrated into the system because it should be scalable. Since the mobile phone does not need to be linked to the internet, the user can receive the alerts and the status of the IoT system from anywhere even if Internet connectivity is not widely available. This project aims to address the challenges currently faced by home security and surveillance systems in giving information about the situation to consumers while they are away from home. The ESP32 SoC integrated in this Project is used to remotely control devices and appliances. As technology and services have improved, people's expectations about automation and security have evolved significantly. Using this ESP32 project. A smartphone app, an augmented reality application, and physical switches let you operate four different appliances from a single location. In the absence of an internet connection, the relay module can be controlled via augmented reality and physical switches. In this IoT-based smart home system, the ESP32 can also watch the real-time feedback of the relays in the Blynk app if it is connected to Wi-Fi. The ESP32 will automatically connect to the Wi-Fi if the WiFi is available. Over the years, several automated systems have attempted to provide a safe, efficient, and convenient manner for people to reach their place of employment. Many current systems still employ Bluetooth modules instead of Wi-Fi modules, limiting their range of operation. The usage of Augmented Reality (AR) in this project allows the user to interact directly with all of the surrounding objects. Control four relays remotely and in real time with the help of ESP32, AR, and a manual switch in your home with home automation employing these three technologies. We use augmented reality as a medium for virtual communication in our suggested system. As a result of this, augmented reality is becoming increasingly popular in the field of home automation. When the user's camera is pointed at the switch or at the object to be controlled, an AR pop-up appears. The Vuforia engine, a software development kit (SDK), is necessary to make use of AR. (Unity 7 Platform Studio) has the Vuforia engine as an add-on GUI for software development projects. Build setup and automatic file generation are provided by this tool. Our own AR programme will allow us to create an overlay of a virtual image on top of the real-time camera image so that the user may select whether or not the overlay is activated when the camera of the smart device is aimed at an object. The applications in AR are controlled by the use of image tracking, processing, and communication. Appliances can be controlled remotely using a web browser on mobile devices. It's the server's job to activate the General-Purpose Input/Output (GPIO) pins, which in turn trigger the home's DC or AC power source electrical devices (e.g., switches for on/off). A web browser or a mobile web interface can be used to check the status of the appliances and to operate them through the internet. The potential for device automation is enormous, both now and in the future.
4 Claims & 1 Figure
Brief description of Drawing
In the figures which are illustrated exemplary embodiments of the invention.

Figure 1, Block diagram of Home Automation System using Augmented Reality , Claims:The scope of the invention is defined by the following claims:

Claim:
1. A system/method to automate the home using IoT and Augmented Reality, said system/method comprising the steps of:
a) The system starts from the IoT app (1), to measure the status of the electronics devices from different sensors (2), the status is monitored (3) from the user dashboard/AR framework (4).
b) Then proposed invention is incorporated with web socket to analyze the user input (5), status is transferred via TCP/IP stack (6) to the system server (7).
c) In the other end, if any electronics devices is in the on status then that will be measured from the ESP32 (8), that will be monitored or controlled by relay (9), from the relay output we can able to automate our electronics devices.
2. As mentioned in claim 1, the invented system starts with our application to check the status of our electronics devices by different sensors.
3. As mentioned in claim 1, the sensors values and status can be viewed from the AR based framework. After that, the concern values are transferred via TCP/IP stack to our main server.
4. As per claim 1, if any electronics devices are switched on that will be captured by ESP32 controller, then relay will be take the action to automate our electronic devices.