This invention relates to a system of Intelligent Control Unit for Assisting Visually Impaired People.
BACKGROUND OF THE INVENTION
SN Patent number Abstract Difference
1

2

3 CN10963566A

CN109740676A

CN106680798B In their daily lives, visually impaired people encounter numerous problems, the most significant of which is navigation, or getting from one location to another. To help them solve this challenge, we present an edge device for object detection. This edge device receives video stream as input and uses it to identify images and determine navigation direction using deep learning. The output is in the form of audio for helping visually impaired people. The device uses Google’s TTS API for text to speech conversion. This device has capability for detecting obstacles using LiDAR. The data is shared with the edge device and analyzed to calculate a safe distance, and generate an alert is for the user. In this way, the user will get the information in the form of audio alert. This solves a very critical issue of the society. • It provides object detection and object classification but our invention provides speech and text processing to improve the user experience
• Our invention integrates Google’s TTS API for better and more accurate text to speech support
• Our invention will provide distance calculation for identified object, and intimate sudden changes in surrounding.
• It provides pulse feedback to direct alignment for direction

None of the prior art indicate above either alone or in combination with one another disclose what the present invention has disclosed. Present invention is Intelligent Control Unit for Assisting Visually Impaired People.
SUMMARY OF THE INVENTION
This summary is provided to introduce a selection of concepts, in a simplified format, that are further described in the detailed description of the invention.
This summary is neither intended to identify key or essential inventive concepts of the invention and nor is it intended for determining the scope of the invention.
Discloses herein a system of intelligent control unit for assisting visually impaired people comprises a Computing Unit (100), Camera (104), Power Source (102), Microphone (106), Speaker (112), Neural Stick (110), and a LiDAR Sensor (108); wherein said Unit (100) receives a video feed from Unit 104, Sensory Data from Unit (108), and Audio data from Unit 106; said Unit 100 and Unit 110 then compute an output using an ML Model deployed on them and processes an output in the form of audio; and the output audio is played through Unit (112); and Unit 102 provides the necessary power requirements of the other deployed devices.
In another embodiment, LiDAR Sensor (108) emits pulsed light waves into the surrounding environment; and these pulses bounce off surrounding objects and return to the sensor.
In another embodiment, the sensor uses the time it took for each pulse to return to the sensor to calculate the distance it traveled; and Repeating this process millions of times per second creates a precise, real-time 3D map of the environment. An onboard computer can utilize this map for safe navigation.
In another embodiment, Neural Stick (110) Stick is a simple USB device that greatly accelerates AI processing and deep learning inference on consumer PCs; which are attached to edge devices such as Intel NUC or Raspberry Pi.
In another embodiment, Computing Unit (100) the Raspberry Pi that runs Linux, but it also provides a set of GPIO (general purpose input/output) pins, allowing user to control electronic components for physical computing.
In another embodiment, Camera (104) is used to take pictures and videos of the surrounding; and the Raspberry Pi uses Micro USB Power Supply.
In another embodiment, Microphone (106) is a device that translates sound vibrations in the air into electronic signals or scribes them to a recording medium; wherein Microphones enable many types of audio recording devices for purposes including communications of many kinds, as well as music and speech recording.
In another embodiment, Speaker (112) receives electrical input from a device, it sends the current through the causing it to move back and forth; and said motion then vibrates the outer cone, generating sound waves picked up by user’s ears.
To further clarify advantages and features of the present invention, a more particular description of the invention will be rendered by reference to specific embodiments thereof, which is illustrated in the appended drawings. It is appreciated that these drawings depict only typical embodiments of the invention and are therefore not to be considered limiting of its scope. The invention will be described and explained with additional specificity and detail with the accompanying drawings.
Everyday activities which we do subconsciously are mile to walk for blind people, so we hope to make their lives easier by giving them technology which can help them navigate on roads and observe their surrounding scenario in a better way which will help them to identify their destination by using the device with the below mentioned technology.
BRIEF DESCRIPTION OF THE DRAWINGS
The illustrated embodiments of the subject matter will be understood by reference to the drawings, wherein like parts are designated by like numerals throughout. The following description is intended only by way of example, and simply illustrates certain selected embodiments of devices, systems, and methods that are consistent with the subject matter as claimed herein, wherein:
Fig. 1: Flowchart
Fig. 2: Flowchart
Fig. 3: Edge diagram
The figures depict embodiments of the present subject matter for the purposes of illustration only. A person skilled in the art will easily recognize from the following description that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles of the disclosure described herein.
DETAILED DESCRIPTION OF THE INVENTION
The detailed description of various exemplary embodiments of the disclosure is described herein with reference to the accompanying drawings. It should be noted that the embodiments are described herein in such details as to clearly communicate the disclosure. However, the amount of details provided herein is not intended to limit the anticipated variations of embodiments; on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the scope of the present disclosure as defined by the appended claims.
It is also to be understood that various arrangements may be devised that, although not explicitly described or shown herein, embody the principles of the present disclosure. Moreover, all statements herein reciting principles, aspects, and embodiments of the present disclosure, as well as specific examples, are intended to encompass equivalents thereof.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments. As used herein, the singular forms “a",” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises,” “comprising,” “includes” and/or “including,” when used herein, specify the presence of stated features, integers, steps, operations, elements and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and/or groups thereof.
It should also be noted that in some alternative implementations, the functions/acts noted may occur out of the order noted in the figures. For example, two figures shown in succession may, in fact, be executed concurrently or may sometimes be executed in the reverse order, depending upon the functionality/acts involved.
In addition, the descriptions of "first", "second", “third”, and the like in the present invention are used for the purpose of description only, and are not to be construed as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Thus, features defining "first" and "second" may include at least one of the features, either explicitly or implicitly.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which example embodiments belong. It will be further understood that terms, e.g., those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
These and other advantages of the present subject matter would be described in greater detail with reference to the following figures. It should be noted that the description merely illustrates the principles of the present subject matter. It will thus be appreciated that those skilled in the art will be able to devise various arrangements that, although not explicitly described herein, embody the principles of the present subject matter and are included within its scope.
This invention works on a trained machine learning model developed using the combination of supervised, unsupervised, and reinforcement learning. The end-user gives a voice command at the press of a button which turns on the program which contains the machine learning model. The model is trained on data of common everyday objects, their distance from the user, and their importance in the given surrounding environment. This model takes input from the video feed using accelerated computer vision which is then passed to a CNN-based object detection system that separates them into individual frames and then detects the object of interest in the given environment as well as its distance from the user. The result achieved is then converted into text format and is passed onto a text-to-speech recognition system and to warn the user if there are any sudden changes in the frame. The generated audio is relayed to the end-user using a headset. The calculated distance helps the user get an accurate understanding of his/her surroundings as well as help them in aligning themselves to get around certain obstacles, turns, or even doors. It is a speech-activated and speech feedback object detection system while it also provides pulse feedback to help in alignment. This invention will help people on the streets in terms of navigation and alert the end user to find the destination and many other everyday activities.
Best Method of working:
The edge diagram contains a Computing Unit(100), camera(104), power source(102), microphone(106), speaker(112), neural stick(110), and a LiDAR Sensor(108). Unit(100) receives a video feed from Unit 104, Sensory Data from Unit (108), and Audio data from Unit 106. Unit 100 and Unit 110 then compute an output using an ML Model deployed on them and processes an output in the form of audio. The output audio is played through Unit (112). Unit 102 provides the necessary power requirements of the other deployed devices.
LiDAR Sensor (108)- A typical lidar sensor emits pulsed light waves into the surrounding environment. These pulses bounce off surrounding objects and return to the sensor. The sensor uses the time it took for each pulse to return to the sensor to calculate the distance it traveled. Repeating this process millions of times per second creates a precise, real-time 3D map of the environment. An onboard computer can utilize this map for safe navigation.
Neural Stick (110)- Neural Compute Stick is a simple USB device that can greatly accelerate AI processing and deep learning inference on consumer PCs. These are used for high-quality image processing, computer vision, and deep neural networks, making them suitable to drive the demanding mix of vision-centric tasks in modern smart devices. These devices can be easily attached to edge devices such as Intel NUC or Raspberry Pi.
Computing Unit (100)- The Raspberry Pi is a very cheap computer that runs Linux, but it also provides a set of GPIO (general purpose input/output) pins, allowing you to control electronic components for physical computing. It’s a single board computer. A single-board computer (SBC) is a complete computer built on a single circuit board, with microprocessor(s), memory, input/output (I/O) and other features required of a functional computer.
Camera (104)– A camera is used to take pictures and videos of the surrounding.
Power Source (102)– The Raspberry Pi uses Micro USB Power Supply.
Microphone (106)– A microphone is a device that translates sound vibrations in the air into electronic signals or scribes them to a recording medium. Microphones enable many types of audio recording devices for purposes including communications of many kinds, as well as music and speech recording.
Speaker (112)- When the speaker receives electrical input from a device, it sends the current through the causing it to move back and forth. This motion then vibrates the outer cone, generating sound waves picked up by our ears.
ADVANTAGES OF THE INVENTION:
This invention is targeted toward helping blind people in their day-to-day lives. It will combine object detection, depth perception, text and speech processing, distance prediction as well as audio feedback for alignment to help them navigate on the streets, take a walk in the park, and do many other everyday activities. The main advantage of this invention is giving freedom to blind people so they can do everyday activities on their own, without a walking stick, and enjoy their lives.
Novel Features of the Invention:
1. It intends to improve the reliability of life for blind people.
2. It helps in navigation across streets and helps in avoiding obstacles.
3. It helps to detect and warn sudden changes in frame and warns the end user.
4. It provides pulse feedback to help in alignment.
5. It will help to enhance algorithm based on our objective.
6. Edge device having component computing unit, camera, Neural Stick, LiDAR, microphone, speaker.

WE CLAIM:

1. A system of intelligent control unit for assisting visually impaired people comprises a Computing Unit (100), Camera (104), Power Source (102), Microphone (106), Speaker (112), Neural Stick (110), and a LiDAR Sensor (108); wherein said Unit (100) receives a video feed from Unit 104, Sensory Data from Unit (108), and Audio data from Unit 106.
2. The system as claimed in claim 1, wherein said Unit 100 and Unit 110 then compute an output using an ML Model deployed on them and processes an output in the form of audio; and the output audio is played through Unit (112); and Unit (102) provides the necessary power requirements of the other deployed devices.
3. The system as claimed in claim 1, wherein said LiDAR Sensor (108) emits pulsed light waves into the surrounding environment; and these pulses bounce off surrounding objects and return to the sensor.
4. The system as claimed in claim 1, wherein the sensor uses the time it took for each pulse to return to the sensor to calculate the distance it traveled; and Repeating this process millions of times per second creates a precise, real-time 3D map of the environment. An onboard computer can utilize this map for safe navigation.
5. The system as claimed in claim 1, wherein Neural Stick (110) Stick is a simple USB device that greatly accelerates AI processing and deep learning inference on consumer PCs; which are attached to edge devices such as Intel NUC or Raspberry Pi.
6. The system as claimed in claim 1, wherein Computing Unit (100) the Raspberry Pi that runs Linux, but it also provides a set of GPIO (general purpose input/output) pins, allowing user to control electronic components for physical computing.
7. The system as claimed in claim 1, wherein Camera (104) is used to take pictures and videos of the surrounding; and the Raspberry Pi uses Micro USB Power Supply.
8. The system as claimed in claim 1, wherein Microphone (106) is a device that translates sound vibrations in the air into electronic signals or scribes them to a recording medium; wherein Microphones enable many types of audio recording devices for purposes including communications of many kinds, as well as music and speech recording.
9. The system as claimed in claim 1, wherein Speaker (112) receives electrical input from a device, it sends the current through the causing it to move back and forth; and said motion then vibrates the outer cone, generating sound waves picked up by user’s ears.