Description:TITLE OF THE INVENTION
AN IOT BASED SYSTEM FOR SMART STICK FOR VISUALLY IMPAIRED WITH OBJECT DETECTION AND IDENTIFICATION
FIELD OF THE INVENTION
The present invention herein particularly relates to a system of smart stick for visually impaired with object detection and identification.
BACKGROUND OF THE INVENTION
The statistics around vision impairment are staggering, and highlight the urgent need for innovative solutions such as the Smart IOT Enabled Intelligent Stick for Visually Impaired People. With over 2.2 billion people worldwide experiencing some form of vision impairment, it is clear that this is a significant global health issue that impacts individuals across the lifespan. Visually impaired individuals face unique challenges that are not encountered by individuals with other disabilities. With approximately 80 percent of information being processed through the sense of sight, visual impairment can significantly impact an individual's ability to perceive and navigate their surroundings. This can lead to an increased risk of accidents and difficulties in daily life activities.
In the absence of visual perception, individuals with visual impairments must rely on other senses, such as hearing or touch, to substitute for their lack of visual perception. Auditory senses and tactile can provide alternative means of sensing the environment and detecting potential hazards. However, even with the use of auditory and tactile senses, visually impaired individuals may still face significant barriers to independence and mobility. Children with premature severe vision impairment are particularly vulnerable, as they may experience lasting impacts on their motor, verbal, and emotional abilities, as well as poor academic performance. This can have long-term consequences for their quality of life and future prospects. For adults with visual impairment, the impact is no less significant. Many individuals with visual impairment experience decreased workforce participation and productivity levels, as well as greater rates of anxiety or depression. This can have a significant impact on their standard of living and overall well-being. Older people with vision impairment are also at risk of falling, which can have serious consequences for their health and mobility. They may also experience difficulty with daily tasks and social isolation, which can lead to early admission into nursing or care facilities.
In light of these challenges, the Smart IOT Enabled Intelligent Stick for Visually Impaired People can represent a critical solution that has the potential to improve the lives of millions of individuals worldwide. By empowering visually impaired individuals to navigate their surroundings with greater independence and confidence, this technology can enhance their overall quality of life and promote greater social inclusion and participation. By empowering individuals with visual impairments to navigate their environment with greater confidence and independence, we can promote greater social inclusion and participation and enhance their overall quality of life. Smart sticks will be equipped with sensors that can detect obstacles in the user's path, and alert them using different methods such as beeps, vibrations, or voice alerts. This technology will greatly enhance the mobility and independence of visually impaired individuals, enabling them to navigate their surroundings with greater ease and safety. Moreover, the smart stick will also be integrated with other technologies such as GPS and voice-activated assistants, enhanced obstacle detection, longer battery life, and more user-friendly interfaces further enhancing their functionality and usefulness for visually impaired individuals.
Following are some most relevant prior arts:
CN103637900B discloses an intelligent blind guiding stick based on image identification and belongs to the technical field of electronic information engineering. The intelligent blind guiding stick consists of a hand-shape stick handle, an intelligent stick body, a roller stick tip and a Bluetooth headset, wherein a man-machine interaction subsystem, a road condition recognition subsystem, a navigation subsystem and a roller braking system are embedded into the blind guiding stick; the Bluetooth headset works together with the man-machine interaction subsystem to realize favorable man-machine interaction. In order to matching up the image identification of the blind guiding stick, a conventional blind track is improved. The image identification and processing method is adopted to effectively identify blind tracks and bus information so as to help the blind to go out safely and independently. As the roller stick tip is designed, the stress of the blind is reduced, and as the design of the hand-shaped stick handle is integrated with humanized design factors, the operation is convenient. The intelligent blind guiding stick is designed to be practical and realizable, reflects strong humanistic concern and has favorable market popularization value and significance.
CN205494329U discloses an intelligence system, which is saved oneself and is led blind walking stick, including the walking stick body and establish in the walking stick body the treater with be used for the power supply power module, be provided with charge interface and starting switch on the walking stick body, the triaxial sensor and the camera of definite walking stick motion state are installed to walking stick body upper portion, the inside GPS module that still is provided with of walking stick body, and walking stick body lower part is provided with a plurality of ultrasonic sensor and a plurality of infrared sensor of temperature and humidity sensor, cooperation use, the treater includes the GPRS module of main chip and built -in SIM card, still be provided with on the walking stick body and pass through the pronunciation mode with information and transmit for user's the player and the Bluetooth module that can connect Bluetooth headset. The utility model discloses an intelligence is saved oneself and is led blind walking stick, the help blind person takes action alone, reduces it and because of the handicapped problem that the eyesight problem produced, still has the function of saving oneself, when the user meets accident, in time externally cries for help automatically.
CN102920117B disclosed an intelligent walking stick with an automatic alarming function in case of falling. The intelligent walking stick comprises a walking stick body and an automatic alarming device in case of falling, and the automatic alarming device in case of falling comprises a power source, a three-shaft acceleration sensor, a microprogrammed control unit (MCU), a button switch, a buzzer, a positioning module global positioning system (GPS) and a communication network module global system for mobile communication (GSM). The power source, the three-shaft acceleration sensor, the MCU, the button switch, the buzzer, the positioning module GPS and the communication network module GSM are respectively connected with a microprocessor. A cavity is arranged on the walking stick body and used for accommodating the automatic alarming device in case of falling. The intelligent walking stick automatically judges whether a user falls, when the user falls, the intelligent walking stick sends positioning information to inform family members automatically, the user can obtain timely help without any operation. Particularly the common communication network (GSM) and a GPS positioning terminal are used, and the intelligent walking stick has reliable performance.
CN201591719U provides an intelligent blind aid system and an intelligent blind aid cane. The intelligent blind aid system comprises a main controller, a wireless range acquisition unit, a control unit and a prompt unit, wherein the signal output of the wireless range acquisition unit is connected with the range acquisition signal input of the main controller, the signal output of the control unit is connected with the control signal input of the main controller, and the signal output of the main controller is connected with the signal input of the prompt unit. The utility model also provides an intelligent blind aid cane; a first ultrasonic range acquisition module is arranged at the middle of the cane; the ultrasonic transmitting head of the first ultrasonic range acquisition module faces to the front for detecting obstacles ahead; a second ultrasonic range acquisition module is arranged at the upper part of the cane; the ultrasonic transmitting head of the second ultrasonic range acquisition module faces upwards to the front for detecting obstacles in a front upper place; an infrared range acquisition module is arranged at the lower part of the cane at the vertical distance of 2-30 cm to the ground; and the infrared transmitting head faces to the front for detecting low obstacles on the ground.
None of the prior art indicate above either alone or in combination with one another disclose what the present invention has disclosed.
SUMMARY OF THE INVENTION
This summary is provided to introduce a selection of concepts, in a simplified format, that are further described in the detailed description of the invention.
This summary is neither intended to identify key or essential inventive concepts of the invention and nor is it intended for determining the scope of the invention.
The Smart IOT Enabled Intelligent Stick for Visually Impaired People can represent a critical solution that has the potential to improve the lives of millions of individuals worldwide. By empowering visually impaired individuals to navigate their surroundings with greater independence and confidence, this technology can enhance their overall quality of life and promote greater social inclusion and participation. By empowering individuals with visual impairments to navigate their environment with greater confidence and independence, we can promote greater social inclusion and participation and enhance their overall quality of life. Smart sticks will be equipped with sensors that can detect obstacles in the user's path, and alert them using different methods such as beeps, vibrations, or voice alerts. This technology will greatly enhance the mobility and independence of visually impaired individuals, enabling them to navigate their surroundings with greater ease and safety. Moreover, the smart stick will also be integrated with other technologies such as GPS and voice-activated assistants, enhanced obstacle detection, longer battery life, and more user-friendly interfaces further enhancing their functionality and usefulness for visually impaired individuals.
To further clarify advantages and features of the present invention, a more particular description of the invention is rendering by reference to specific embodiments thereof, which is illustrated in the appended drawing.
It is appreciated that the drawing depicts only typical embodiments of the invention and are therefore not to be considered limiting of its scope. The invention is being described and explained with additional specificity and detail with the accompanying drawing.

BRIEF DESCRIPTION OF DRAWINGS
The foregoing detailed description of embodiments is better understood when read in conjunction with the attached drawing. For better understanding, each component is represented by a specific number which is further illustrated as a reference number for the components used with the figures.
With the help of figures the detailed explanation of connections become easier and understandable. For easier understanding each component is represented by a reference numeral which is also used as a reference number for the components used in the illustration.
Figure 1 represents Block Diagram of the circuit
Figure 2 represents Design of the stick
Figure 3 represents Functional DFD on the stick
Further, skilled artisans will appreciate that elements in the drawings are illustrated for simplicity and may not have necessarily been drawn to scale. Furthermore, in terms of the construction of the system, one or more components of the system may have been represented in the drawing by conventional symbols, and the drawing may show only those specific details that are pertinent to understanding the embodiments of the present invention so as not to obscure the drawing with details that will be readily apparent to those of ordinary skill in the art having benefit of the description herein.

DETAILED DESCRIPTION OF THE INVENTION
For the purpose of promoting an understanding of the principles of the invention, reference will now be made to the embodiment illustrated in the drawing and specific language will be used to describe the same.
It will nevertheless be understood that no limitation of the scope of the invention is thereby intended, such alterations and further modifications in the illustrated system, and such further applications of the principles of the invention as illustrated therein being contemplated as would normally occur to one skilled in the art to which the invention relates. Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skilled in the art to which this invention belongs.
Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.
The present invention provides an Smart IOT Enabled Intelligent Stick for Visually Impaired People, which can represent a critical solution that has the potential to improve the lives of millions of individuals worldwide. Smart sticks will be equipped with sensors that can detect obstacles in the user's path, and alert them using different methods such as beeps, vibrations, or voice alerts. This technology will greatly enhance the mobility and independence of visually impaired individuals, enabling them to navigate their surroundings with greater ease and safety. Moreover, the smart stick will also be integrated with other technologies such as GPS and voice-activated assistants, enhanced obstacle detection, longer battery life, and more user-friendly interfaces further enhancing their functionality and usefulness for visually impaired individuals.
The smart stick will be equipped with sensors that can detect obstacles in the user's path, such as curbs, steps, or other objects. Additionally, it will detect damp surfaces and alert the user to avoid them for safety. The microcontroller in the smart stick will process the signals from the sensors and triggers alerts to the user, providing real-time feedback on the environment around them. The communication module in the smart stick will enable it to connect to the internet and transmit data to the cloud server. The cloud server receives and stores the data from the stick, including the user's location and any alerts triggered by the sensors. The user's caretaker can access this information by entering their unique credentials on the cloud server, allowing them to monitor the user's whereabouts and offer assistance if needed.
To ensure privacy, the credentials are unique for each concerned individual and can only be shared by the visually impaired user with those they feel comfortable with. This way, the user can maintain control over who has access to their location data and ensure that their privacy is protected. Overall, the proposed system provides visually impaired individuals with a powerful assistive device that combines advanced technology with practical functionality, enhancing their safety and independence while preserving their privacy. Figure 1 shows the block diagram of the stick.
Overall Architecture of the System:
The physical design of the smart stick is an essential consideration to ensure that the user is comfortable and able to use it effectively. The stick will have a good hand grip, making it easy to hold and maneuver. The grip will be made of non-slip materials to ensure that the user maintains a firm grip even when their hands are wet or sweaty. Another critical factor in the physical design is adjustability. As users will be of varying heights, the smart stick is adjustable to accommodate individuals of different heights. The length of the stick is adjustable to suit the user's height, ensuring that they can use it comfortably and effectively. Moreover, stick will be lightweight enough to be carried easily by the user while walking. This ensures that the user does not get tired quickly and can use the stick for extended periods without experiencing discomfort or fatigue. Figure 2 shows the design of the stick.
The physical design of the smart stick is an essential consideration to ensure that the user is comfortable and able to use it effectively. The smart stick will have a good hand grip, making it easy to hold and maneuver. The grip will be made of non-slip materials to ensure that the user maintains a firm grip even when their hands are wet or sweaty. Another critical factor in the physical design is adjustability. As users will be of varying heights, the smart stick is adjustable to accommodate individuals of different heights. The length of the stick is adjustable to suit the user's height, ensuring that they can use it comfortably and effectively. Moreover, stick is lightweight enough to be carried easily by the user while walking. This ensures that the user does not get tired quickly and can use the stick for extended periods without experiencing discomfort or fatigue.
Some of the main features of the present invention are as following:
• Obstacle detection and identification: The distance between the sensor and an object can be determined by measuring the time taken by sound waves to travel from the sensor to the object and back again. (Ultrasonic ranging). When an object is detected within a predetermined distance, the Raspberry Pi camera, captures images which will be processed by Open CV, with the help of a CNN (YOLO Architecture) to recognize objects and obstacles, once done the controller will activate an alert and play a corresponding audio message while also activating a relevant vibration motor.
• Water Detection: Copper shorting technique can be used for the purpose of water detection. A custom water sensor is developed with two copper terminals, which are linked to the receiver terminal of the IR sensor. When water comes into contact with the copper terminals, it creates a short circuit, which results in the output pin of the sensor going HIGH and sending a signal to the controller. The controller then generates an audio alert for water detection.
• GPS/SGM: Sharing of location can be accomplished by a small cellular module called SIM800L. It is a quad-band GSM/GPRS module that allows for voice and data transmission over cellular networks. Its operating voltage ranges from 3.4V to 4.4V hence will be used to achieve longer battery life.
• Location sharing: The live location of a visually impaired individual or their walking stick can be measured using previously mentioned GPS, and this information will be forwarded to an IOT server every 10 seconds using a GSM connection that is connected to the internet. In case of an emergency, the panic button allows the user to quickly send a location alert to their caretaker through an SMS message. This can be important for visually impaired individuals who may be at higher risk in emergency situations.
Those skilled in the art will appreciate that one or more of the described elements may well be combined into a single functional element. Alternatively, certain elements may be split into multiple functional elements. Elements from one embodiment may be added to another embodiment.
Advantages of the Invention:
Some of main advantages of this smart stick are:
1. Increased Safety: The intelligent stick helps the visually impaired person to detect obstacles in their path and avoid them, thus reducing the risk of accidents and injuries.
2. Greater Independence: The stick enables visually impaired people to navigate their environment more independently, reducing the need for assistance from others.
3. Real-Time Feedback: The smart sensors provide real-time feedback to the user about the environment around them, enabling them to make informed decisions about their movements.
4. Customizable Settings: The settings of the intelligent stick can be customized based on the user's preferences and needs, such as adjusting the sensitivity of the sensors or the volume of the alerts.
5. Multi-Functional: The intelligent stick is designed to perform multiple functions, such as GPS navigation, voice recognition, and emergency alert systems.
6. Cost-Effective: It is a cost-effective solution for visually impaired people compared to other assistive devices or hiring human assistants.
7. Easy to Use: The stick is easy to use and requires minimal training for the user to operate effectively.
, Claims:
1. An IoT based system for smart stick for visually impaired with object detection and identification, comprising, an adjustable walking stick, a sensor module, a camera, a battery, a raspberry Pi controller, a vibration motor, an earphone, GSM & GPS module and an IoT server.
2. The system as claimed in claim 1, wherein the sensor module further comprises, ultrasonic sensor and water sensor.
3. The system as claimed in claim 1, wherein, the distance between the sensor and an object can be determined by measuring the time taken by sound waves to travel from the sensor to the object and back again to detect the object within a predetermined distance, the Raspberry Pi camera, captures images to recognize objects and obstacles, once done the controller will activate an alert and play a corresponding audio message while also activating a relevant vibration motor.
4. The system as claimed in claim 1, wherein, the water sensor is having two copper terminals, which are linked to the receiver terminal of the IR sensor, to detect the water when comes into contact with the copper terminals, it creates a short circuit, which results in the output pin of the sensor going HIGH and sending a signal to the controller to give an audio alert for water detection.
5. The system as claimed in claim 1, wherein, the quad-band GSM/GPRS module used for voice and data transmission over cellular networks.
6. The system as claimed in claim 1, wherein, The live location of a visually impaired individual or their walking stick can be measured using previously mentioned GPS, and this information will be forwarded to an IOT server every 10 seconds using a GSM connection that is connected to the internet.