Description:INTEGRATED SYSTEM FOR NAVIGATION ASSISTANCE AND HOME AUTOMATION FOR SPECIALLY-ABLED INDIVIDUALS

FIELD OF INVENTION
The present invention relates to an integrated panel for home automation. The present invention specifically relates to an integrated system within a stick to provide navigation assistance and home automation for specially able individuals.

BACKGROUND
An integrated navigation system combines various technologies and tools to assist individuals in navigating their environment, particularly in complex or challenging settings. These systems are especially beneficial for individuals with visual impairments or other disabilities that hinder their ability to navigate autonomously. By integrating a range of features such as real-time obstacle detection, environmental awareness, and communication with home automation systems, these integrated systems offer enhanced safety, independence, and convenience.
Traditionally, navigation systems focused primarily on outdoor applications, providing basic directional assistance through GPS and simple audio cues. However, with advancements in technology, integrated navigation systems now provide more sophisticated features that cater to both outdoor and indoor environments. These systems leverage sensors like ultrasonic devices, cameras, and LiDAR to detect obstacles, map surroundings, and even provide feedback on environmental factors such as wet areas or uneven terrain.
Visually impaired individuals often face difficulties in navigating public spaces, encountering obstacles, or identifying potential hazards such as wet surfaces. Moreover, accessing and controlling home automation systems, which are primarily designed for able-bodied individuals, can be a challenge, though there are several prior arts which discuss this aspect of the invention like the prior art EP4362254 A1 titled as “INTEGRATED PANEL FOR HOME AUTOMATION” discusses an integrated panel for home automation where the panel is adapted to house electrical components for home or professional use, in particular for applications for automating or controlling the operation of electrical loads. The panel comprises a container configured to enclose wiring that can be combined with the aforesaid electrical loads and comprises surfaces facing inwards and/or outwards of a room for home or professional use, which is accessed through a door, said surfaces having a plurality of user-operable commands in order to act as control means on the aforesaid electrical loads, said surfaces further comprising audible and/or light indicators, which is characterised in that the aforesaid panel is integrated into the jamb of the aforesaid door.
Another prior art 2920MUM2015A titled as “INTELLIGENT HOME AUTOMATION AND SECURITY SYSTEM” discusses an integrated intelligent home automation system with affordability and simplicity. The said integrated intelligent home automation system comprises of RFID technology, GSM module and various other sensors for home automation. The advantage of the system is that it increases the security of the house widely. If the password is entered wrong thrice the system does not allow the users to enter the password. The users use the main user's password to get entry into the house. If in case there is any problem in the house such as leakage of the LPG gas, Fire outbreak or a theft entering the house, or it crosses the threshold value the sensors would sense it and send an alert message to the main users who has registered the no initially. Also, simultaneously the busser would get ON.
Yet another prior art WO12110677 A1 titled as “CONTROL BOARD FOR A HOME AUTOMATION SYSTEM” discusses an invention comprising an central processing unit disposed on a connector so that it can be replaced. The central processing unit is connected to a series of elements disposed close to the sides of the board, defined by six USB ports, a Gigabit Ethernet bridge, eight digital inputs, four analog inputs, an interface, a connector for different display screens, an RS-485 bridge, a buzzer, an audio output, and a single connector for externally powering the board, in order to facilitate access to the board.
Though the prior arts discuss different types of home automation units, none of them discuss the integration of a smart stick for navigation and a home automation system into a single, voice-controlled solution aims to address these issues, offering both independent outdoor navigation and the ability to control home appliances through voice commands, without the need for complex setups or interfaces. The present invention not only provides an efficient solution for outdoor navigation but also empowers individuals to control household functions such as lights, fans, and other appliances. The system's design leverages cloud technology via AWS for real-time processing and remote control, further enhancing usability, convenience, and safety for specially-abled individuals.
The present invention relates to the integration of a smart navigation system, embodied in a "smart stick," with a voice-controlled home automation system specifically designed for specially-abled individuals, such as those with visual impairments. This novel system provides a seamless solution for both outdoor navigation and in-home automation, improving accessibility and safety for individuals with mobility and vision challenges. The invention combines advanced technologies such as the ESP32 processor, ultrasonic sensors, AWS Lambda, and Alexa Skills Kit to deliver a unified platform that enhances daily life by enabling real-time navigation assistance and voice-controlled home appliance management through an Android-based application.

OBJECTIVE OF THE INVENTION:
The primary objective of the present invention is to provide a system for navigation and home automation capable of obstacle detection and wet area detection and issue emergency alerts to ensure user safety.
It is also another objective of the present invention to provide a system and method to enable seamless interaction using cloud technology with simplified management
It is yet another objective of the present invention to provide a system and method for navigation and home automation comprising a smart stick, a home automation system and an android application as its main components.

FIGURES
The accompanying drawings, which are incorporated in and constitute a part of this specification, show certain aspects of the subject matter disclosed herein and, together with the description, help explain some of the principles associated with the disclosed implementations. In the drawing,
Fig 1 Illustrates the block diagram of the home automation system
Fig 2 Illustrates the block diagram of the smart stick integration
Fig 3 Illustrates android application layout
Fig 4 Illustrates the user interface module connected with the system
SUMMARY:
The following summary is provided to facilitate a clear understanding of the new features in the disclosed embodiment and it is not intended to be a full, detailed description. A detailed description of all the aspects of the disclosed invention can be understood by reviewing the full specification, the drawing and the claims and the abstract, as a whole.
The invention provides an integrated solution for specially-abled individuals, combining navigation assistance and home automation functionalities. The system includes a smart stick designed with an ESP32 processor, equipped with ultrasonic sensors for detecting obstacles and wet areas, and an emergency buzzer for alerts. This smart stick communicates with an Android application that allows the user to control the stick’s features and access home automation functions, such as operating lights, fans, and motors through voice commands via Alexa or a similar voice assistant.
The home automation system uses a Raspberry Pi 4B integrated with Alexa Skills Kit and AWS Lambda for remote control of appliances. The Android application serves as a unified control interface, integrating both the smart stick and home automation system. It allows real-time transmission of sensor data from the stick, enabling users to track their environment and respond to emergencies promptly.
This system also supports remote monitoring, provides auditory feedback via Android Talkback for visually impaired users, and enables adjustable height and customizable features for the smart stick. Additionally, it includes a kit that facilitates easy setup and interfacing with the home automation devices, offering a complete, user-friendly experience for specially-abled individuals.

DETAILED DESCRIPTION
The principles of operation, design configurations and evaluation values in these non-limiting examples can be varied and are merely cited to illustrate at least one embodiment of the invention, without limiting the scope thereof.
The embodiments will be described in detail with corresponding marked references to the drawings, in which the illustrative components of the invention are outlined. The embodiments disclosed herein can be expressed in different forms and should not be considered as limited to the listed embodiments in the disclosed invention. The various embodiments outlined in the subsequent sections are construed such that it provides a complete and a thorough understanding of the disclosed invention, by clearly describing the scope of the invention, for those skilled in the art.
The integrated system comprises two main components integrated with android application: the smart stick for navigation and the home automation system. Both components are designed to operate together seamlessly through a unified Android application, providing easy and intuitive control for specially-abled users. The smart stick is equipped with an ESP32 processor, ultrasonic sensors, and an emergency buzzer, allowing it to detect obstacles, measure distances, and identify wet areas. The home automation system, built on a Raspberry Pi, uses Alexa Skills Kit and AWS Lambda to provide voice-controlled operation of household appliances. ( The system is illustrated in figure 1)
The system is designed to be lightweight, portable, and easy to use, with features such as adjustable height on the smart stick, real-time sensor data transmission, and cloud-based processing of voice commands. Through the Android application, users can control both the smart stick and the home automation system in a unified manner, eliminating the need for separate applications or devices.
1. Smart Stick: ( as illustrated in figure 2)
The smart stick is the primary navigation aid in the system, offering key functionalities to support independent outdoor navigation for specially-abled individuals. The stick integrates the following components:
• ESP32 Processor: This low-power microcontroller is used to process data from the sensors and handle communication between the smart stick and the Android application via Wi-Fi.
• Ultrasonic Sensors: These sensors are used to detect obstacles in the user's path by measuring the distance between the stick and nearby objects. The system emits auditory or vibrational feedback via vibration motor when obstacles are detected, allowing the user to navigate safely.
• Wet Area Detection: Special sensors (custom water sensors) are incorporated into the stick to detect wet surfaces, which can present a slipping hazard. The stick alerts the user when it detects a wet area, ensuring the user's safety.
• Emergency Buzzer: The stick includes an emergency button that, when pressed, activates a loud buzzer to signal for help in case of distress. This feature is crucial for ensuring safety in case of an emergency situation.
• Rechargeable Power Supply: The smart stick is powered by a rechargeable battery that provides hours of use before requiring a recharge, ensuring the stick remains operational for extended periods.
The smart stick communicates with the Android application through Wi-Fi, transmitting sensor data in real time. Users can track the stick’s status, receive alerts, and access additional functions such as "Find My Stick" in the application.
2. Home Automation System:
The home automation system integrates various home appliances and devices into a network that can be controlled through voice commands. The key components of the system are:
• Raspberry Pi 4B: This small, single-board computer acts as the central controller for the home automation system. It processes voice commands and communicates with other connected devices in the home.
• Alexa Skills Kit: Using the Alexa Skills Kit, the Raspberry Pi is configured to receive and respond to voice commands given through Amazon Alexa, enabling the user to control appliances such as lights, fans, and motors by simply speaking.
• AWS Lambda: AWS Lambda is used for processing commands and data in the cloud, enabling real-time communication between the user and home appliances, even when the user is remote. This service allows the system to scale and provide reliable, real-time responses.
Users can interact with the home automation system either through voice commands (using Alexa) or by using the Android application, which provides a graphical interface for controlling appliances manually.
3. Unified Android Application: ( as illustrated in fig 3 and fig 4)
The Android application is the core interface that unifies the control of both the smart stick and the home automation system. The app allows users to interact with both components from a single interface. Key features of the Android application include:
• Voice Control: Users can give voice commands using the integrated Google Assistant to perform tasks such as sharing their location, sending emergency notifications, or navigating between locations.
• Smart Stick Control: The app allows users to monitor real-time sensor data from the smart stick, receive alerts about obstacles and wet areas, and access the "Find My Stick" feature to locate the stick if it gets misplaced.
• Home Automation Control: The app also integrates with Alexa, providing a visual interface for controlling home appliances. Users can control appliances by tapping buttons or issuing voice commands.
The application is designed to be user-friendly and intuitive, with features such as Talkback support for visually impaired users. It provides a complete control solution for managing both navigation and home automation systems from a single device.
Operation and Integration:
The system operates by connecting the smart stick and home automation components to a Wi-Fi network. Once the devices are connected, users can interact with the system using the Android application. The voice commands issued via Alexa or the app are processed by the AWS Lambda server, which communicates with the Raspberry Pi and the smart stick, delivering real-time responses to the user. Data from the sensors on the smart stick is transmitted to the app via Wi-Fi, allowing users to monitor their environment and navigate safely.
When the user issues a command through the app or Alexa, the system processes the request and activates the corresponding appliance or sensor, sending feedback to the user in the form of voice alerts, notifications, or sensor readings.
Advantages
• Unified Control: The integration of outdoor navigation aids and home automation into a single system simplifies usage and improves accessibility for specially-abled individuals.
• Real-Time Communication: The use of Wi-Fi and AWS Lambda ensures that both the smart stick and home automation system provide real-time communication, enhancing the responsiveness of the system.
• Safety and Convenience: Features like wet area detection, obstacle alerts, emergency notifications, and voice control of household appliances improve the safety and convenience of users, making them more independent in their daily lives.
This invention represents a significant step forward in both assistive technology for outdoor navigation and home automation for specially-abled individuals, providing a comprehensive solution that improves safety, accessibility, and convenience.

, C , Claims:I/ WE CLAIM:
1. A system for providing navigation and home automation functionalities for specially-abled individuals, comprising:
a smart stick, which is microprocessor assisted and further comprising:
a plurality of sensors, configured to detect obstacles and wet areas and
an emergency buzzer to issue alerts to the user;
a home automation system further including microprocessor integrated with Alexa skills kits and AWS Lambda and enabled with voice-controlled operation of home appliances,
an android application that integrates both the smart stick and home automation system and allows remote access and control via a unified interface,
wherein the said microprocessors are communicatively connected to sensors and system.

2. A system for providing navigation and home automation functionalities for specially-abled individuals as claimed in claim 1 wherein the microprocessor in smart stick is ESP32 processor.

3. A system for providing navigation and home automation functionalities for specially-abled individuals as claimed in claim 1 wherein sensors in the smart stick are ultrasonic sensors and custom water sensors.

4. A system for providing navigation and home automation functionalities for specially-abled individuals as claimed in claim 1 wherein the alerts are issued via audible or vibrational alerts to the user.

5. A system for providing navigation and home automation functionalities for specially-abled individuals as claimed in claim 1 wherein the smart stick further includes a rechargeable power supply, a lightweight and adjustable design, and a user interface for transmitting sensor data to the Android application.

6. A system for providing navigation and home automation functionalities for specially-abled individuals as claimed in claim 1 wherein the home automation system allows for the voice-controlled operation of household appliances such as lights, fans, and motors via Amazon Alexa or a similar voice assistant.

7. A system for providing navigation and home automation functionalities for specially-abled individuals as claimed in claim 1 wherein the Android application combines the functionality of the smart stick control, voice control for home appliances, and remote monitoring of the user's location and status, including emergency alerts.

8. A system for providing navigation and home automation functionalities for specially-abled individuals as claimed in claim 1 wherein the smart stick features adjustable height for customized use and incorporates an emergency buzzer activated when the user presses a dedicated emergency button.

9. A system for providing navigation and home automation functionalities for specially-abled individuals as claimed in claim 1 wherein the Android application utilizes the Talkback feature on Android devices to provide auditory feedback and alerts for visually impaired users.

10. A system for providing navigation and home automation functionalities for specially-abled individuals as claimed in claim 1 further includes a kit for interfacing the home automation system with output devices, comprising a Raspberry Pi 4B, an ESP32 board, connecting wires, and a dot matrix for wired connections, powered by a 5V 2A charging adapter and capable of Wi-Fi connectivity

11. A method for assisting specially-abled individuals with navigation and home automation, comprising the steps of:
providing a smart stick with ultrasonic sensors for obstacle detection, wet area detection, and assisted with emergency alerts to notify the user;
integrating the smart stick with a home automation system using voice commands processed via Alexa Skills Kit and AWS Lambda;
an android application to control both the smart stick and home automation system, enabling user interaction with both systems through a single interface;
further comprising the step of enabling the transmission of real-time sensor data from the smart stick to the Android application via Wi-Fi, providing the user with an up-to-date status of the environment.