The present invention, in general, relates to the field of information communication technologies, and more particularly to a blind smart glass.
Background of the invention
[002] Blind people are those who suffer from diseases or accidental injuries that cause blindness or blindness. Blind people are divided into congenital blind people and acquired blind people. According to estimates by the World Health Organization, there are between 40 million and 45 million blind people worldwide. How to solve their normal learning, work and life issues has become the focus of social attention.
[003] Visual impairment is caused by innate or acquired causes of partial or total loss of function of the visual system, so that it is impossible to accurately identify external things. According to the relevant regulations, visual failure is less than 0.3, or visual field is within 20 °. According to the degree of obstacles, visual impairment can be divided into two categories: the visual acuity of the two eyes is less than 0.3 above 0.03 or the visual field is less than 20°; the visual acuity of the two eyes is less than 0.03 for total blindness. People with amblyopia can usually use vision for daily life, but there are certain obstacles in visual observation. Generally, optical aids or special magnification equipment are needed to observe things.
[004] The difficulties encountered by the blind population are much greater than those of other visually impaired patients. The blind population cannot rely on vision for daily life at all, and usually only adopt alternative methods for daily life. For example, haptic aids, hearing aids, and other types of assistive devices are used in place of vision. Most information barrier technologies and devices can be applied to the entire blind population. Almost all visually impaired people can compensate for the quality of life and participate in social life through assistive devices.
[005] The wearable guiding device refers to an auxiliary device that can improve various situations in a complicated environment even if visual information is not accepted by detection and data analysis of the wearer's surrounding environment. Due to the particularity of the blind population, the wearable guiding device for the blind population should belong to the non-visual visual aid, making full use of functions other than vision, such as hearing and touch, to compensate for the defects of visual function and improve the quality of life of the visually impaired. Auxiliary devices involve all aspects of life, work, study, and entertainment for people with visual impairments. For example: for everyday use Blind mobile phones and telephones, vocal clocks for life; blind canes and blind roads for travel; Braille for reading and communication, dot display devices, audio books, various screen reading software, etc.
[006] In summary, the wearable guiding device for the blind population is of great significance to the life and work of the blind population. The existing types of wearable guiding devices have the characteristics of single function and poor expandability and are not in compliance with the principles of ease of use, application, simplicity, portability, and scalability.
[007] Blind person, due to its intrinsic dystopia, causes can have inconvenience in daily life. Especially the barrier on road and the dangerous hidden danger that the vehicle travelling on the way brings blind person's trip, make blind person's go off daily inconvenience. At present, go on a journey most dependance on walking stick of blind person are explored the pavement behavior in the place ahead, certainly also have minority blind person to rely on seeing-eye dog and accompany trip.
[008] Therefore, there is a need for a technology that can overcome these prior art difficulties and provide a device which helps the blind person to walk free in indoor and outdoor environment.
[009] Furthermore, for visually impaired people, the world can be a challenging place, including challenges associated with going to dinner or a park in an unfamiliar town such as immediate challenges of curbs, doors, trees, and more importantly, risks due to moving people and cars. Several solutions introduced over the years aide the visually impaired in safely navigating their environment. Tapping walking sticks are used to avoid immediate obstacles in the path of the visually impaired such as doors, trees, and locating curbs. Seeing eye dogs provide “eyes” and sight to avoid obstacles and risks such as moving vehicles and people. The development of cell phones with GPS and audible communication of directions has helped the visually impaired with the location of specific buildings or other identified geographic locations. Above-mentioned method and devices for the blind man fails to promote because of various reasons, by summary to various guide product relative merits, and requirement and the needs personal according to the blind person, urgent need will be improved. The present invention works on giving a visible power to a person who can’t see properly or blind. Therefore, with help of the present invention glasses, the totally blind person can predict the right path on his own.
[010] It is accordingly an object of the present invention to provide smart glasses that work on the real time Artificial intelligence (AI) based sensor which automatically inform the person(blind) every condition such as which way is correct, what is weather or if any person is coming towards him. The present invention also works with depth and corner view for the person (blind).
[011] The technical problem to be solved by the present invention is to provide a smart glasses for the problem that the blind person cannot be put into consideration in the above prior art.
[012] It is an object of the present invention to provide an improved method and system to address the existing challenge. Alternatively, it is an object of the present invention to address the foregoing problems or at least to provide the public with a useful choice.
Summary of the present invention
[013] The main goal of the present system is to provide a real time-based glasses or spectacles to give information automatically as the person walks and it also contains a vibration detection feature by which a person can easily distinguish whether he needs to move in a right direction or in left direction.
[014] The prior arts lack the functionality of fully artificial intelligence-based glasses for virtually impaired people. However, the present invention works on self-learning system and repeatedly acquire with the behavior of the person.
[015] The present invention glasses or specs also work in offline mode and offers required help by which a blind person can do the normal or daily routine work such as walking, identify the expressions of others. The disclosed glasses are very cost efficient compared to the existing products in market.
[016] The present invention comprises number of components such as Lidar (LIGHT DETECTION AND RANGE) technology, an ARDUINO UNO (Circuit to connect hardware to software), 3 micro vibration motors, an Arduino speaker, and a mic. The present invention also includes one or more camera. Further, the present invention also includes a blind stick. The components of this invention perform specific function such as the Arduino uno is a circuit which connects the hardware to the software of device. The vibration motors provide the particular direction to the user and the Arduino speaker and mic is used to provide commands to the user and vice versa. The blind stick or stick is used to hold the other components and functions properly.
[017] In an embodiment of the present invention, the stick is the core of information in which the Lidar component is set to collect the information of features such as depth, distance of object from the person (wearing glasses) even works for corners of the object. Said information is further drives to the Arduino Uno circuits, the uno circuit processes the given information using the software and respond with the suitable information to the person. Thereafter, the user can predict the exact distance such as after how much distance is there any left for his/her destination. The user can take right or left navigation result accordingly after the overall processing of the information.
[018] Further, it gives command to vibration motor which vibrate from left side if person need to move right or vibrate at right side if person need to move left. Also, if something comes in front of the blind person the third vibration mechanism vibrate and it is a signal for person to stop. In another scenario if something comes suddenly then also its reaction time is very fast and two vibration motors get activated instantly and then the lidar based sensor automatically detect the safe path for the person. Also, for safety purposes the mic informs the said person to move from the current place.
[019] Now if someone is in front or coming towards the blind person, the camera starts working and identify whether he/she is friend or not. The present invention also analyzes the expressions of the other person whom the user (blind person) is talking using Artificial intelligence technique. Furthermore, the present invention is also capable of informing about the weather of the day, etc. The user can ask about anything related to his/her surroundings with the help of another component as mic. For examples, the user can ask the system as “who is playing with piano”. Hence, the present system can answer, “a girl is playing a piano at footpath, she is in formal dress may be of 18 years”.
[020] One of the main features of the present invention is to guide the blind person with the help of Google maps. And communicate the direction towards the destination with the help of speaker and vibration motors. So that a blind person can walk fearlessly without thinking that he/she can be lost in somewhere. The present invention also remembers the basic road and corner ways to help go back to the person’s home easily. The stated specs further include an emergency feature which automatically dials to the family members of the user (blind person) or maybe the nearest relative or friend for asking help. The smart glasses comprise a buzz and in emergency it can create sound “HELP” for asking help of the surrounding people.
[021] Other objects and advantages of the present invention will become apparent from the following detailed description when viewed in conjunction with the accompanying drawings, which set forth certain embodiments of the invention.
Brief description of the Drawings
[022] FIG. 1 is a flowchart depicting operational steps, in accordance with an embodiment of the present invention to assist a visually impaired user in navigation of a physical environment, in accordance with an embodiment of the present invention
[023] FIG. 2 is a flowchart depicting the internal processing of the components of the present invention.
Detailed Description of the present Invention
[024] Description of the Invention for a thorough understanding of the present invention, reference is made to the following detailed description in connection with the abovementioned drawings. Although the present invention is described with reference to exemplary embodiments, the present invention is not intended to be limited to the specific forms set forth herein. It is understood that various omissions and substitutions of equivalents are contemplated as circumstances may suggest or render expedient, but these are intended to cover the application or implementation without departing from the spirit or scope of the present invention.
[025] Further, it will nevertheless be understood that no limitation in the scope of the invention is thereby intended, such alterations and further modifications in the figures and such further applications of the principles of the invention as illustrated herein being contemplated as would normally occur to one skilled in the art to which the invention relates.
[026] Also, it is to be understood that the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. Further, reference herein to “one embodiment” or “an embodiment” means that a particular feature, characteristic, or function described in connection with the embodiment is included in at least one embodiment of the invention.
[027] Furthermore, the appearances of such phrase at various places herein are not necessarily all referring to the same embodiment. The terms “a” and “an” herein do not denote a limitation of quantity, but rather denote the presence of at least one of the referenced items.
[028] The present invention, in general, relates to the field of information communication technologies, and more particularly to a blind smart glass.
[029] An object of the present invention is to provide smart glasses that work on the real time Artificial intelligence (AI) based sensor which automatically inform the person(blind) every condition such as which way is correct, what is weather or if any person is coming towards him. The present invention also works with depth and corner view for the person (blind).
[030] The main goal of the present system is to provide a real time-based glasses or spectacles to give information automatically as the person walks and it also contains a vibration detection feature by which a person can easily distinguish whether he needs to move in a right direction or in left direction.
[031] The prior arts lack the functionality of fully artificial intelligence-based glasses for virtually impaired people. However, the present invention works on self-learning system and repeatedly acquire with the behavior of the person.
[032] The present invention glasses or specs also work in offline mode and offers required help by which a blind person can do the normal or daily routine work such as walking, identify the expressions of others. The disclosed glasses are very cost efficient compared to the existing products in market.
[033] The present invention comprises number of components such as Lidar (LIGHT DETECTION AND RANGE) technology, an ARDUINO UNO (Circuit to connect hardware to software), 3 micro vibration motors, an Arduino speaker, and a mic. The present invention also includes one or more camera. Further, the present invention also includes a blind stick. The components of this invention perform specific function such as the Arduino uno is a circuit which connects the hardware to the software of device. The vibration motors provide the direction to the user and the Arduino speaker and mic is used to provide commands to the user and vice versa. The blind stick or stick is used to hold the other components and functions properly.
[034] In an embodiment of the present invention, the stick is the core of information in which the Lidar component is set to collect the information of features such as depth, distance of object from the person (wearing glasses) even works for corners of the object. Said information is further drives to the Arduino Uno circuits, the uno circuit processes the given information using the software and respond with the suitable information to the person. Thereafter, the user can predict the exact distance such as after how much distance is there any left for his/her destination. The user can take right or left navigation result accordingly after the overall processing of the information.
[035] Further, it gives command to vibration motor which vibrate from left side if person need to move right or vibrate at right side if person need to move left. Also, if something comes in front of the blind person the third vibration mechanism vibrate and it is a signal for person to stop. In another scenario if something comes suddenly then also its reaction time is very fast and two vibration motors get activated instantly and then the lidar based sensor automatically detect the safe path for the person. Also, for safety purposes the mic informs the said person to move from the current place.
[036] Now if someone is in front or coming towards the blind person, the camera starts working and identify whether he/she is friend or not. The present invention also analyzes the expressions of the other person whom the user (blind person) is talking using Artificial intelligence technique. Furthermore, the present invention is also capable of informing about the weather of the day, etc. The user can ask about anything related to his/her surroundings with the help of another component as mic. For examples, the user can ask the system as “who is playing with piano”. Hence, the present system can answer, “a girl is playing a piano at footpath, she is in formal dress may be of 18 years”.
[037] One of the main features of the present invention is to guide the blind person with the help of Google maps. And communicate the direction towards the destination with the help of speaker and vibration motors. So that a blind person can walk fearlessly without thinking that he/she can be lost in somewhere. The present invention also remembers the basic road and corner ways to help go back to the person’s home easily. The stated specs further include an emergency feature which automatically dials to the family members of the user (blind person) or maybe the nearest relative or friend for asking help. The smart glasses comprise a buzz and in emergency it can create sound “HELP” for asking help of the surrounding people. The technical problem to be solved by the present invention is to provide a blind person smart glasses for the problem that the blind person cannot be put into consideration previously.
[038] Furthermore, the smart or intelligent glasses embodying the invention has the following beneficial effects: integrating sensor technology using LIDAR, real-time based AI, speech recognition and broadcast, not only has a reasonable structure, but also has small volume, light weight, convenient use and practicability. Improved the guided user experience.
[039] In another embodiment, the object of the present invention is to provide a wearable guiding device for a blind population, which can collect real-life scenes in real time, process the collected images and transmit the images. Give remote monitoring equipment for remote monitoring purposes. At the same time, the system includes various sensors to monitor the surrounding conditions, and transmits signals to the wearer with sound, touch, and the like to achieve the function of full blind guidance.
[040] To achieve the above objective, the present invention provides a smart glasses or a blind population, comprising: smart glasses or specs connecting the various components of the system and for easy wearing by the user, an image capture device is maybe disposed in the smart glasses with a lidar based sensors for detecting external information and the state of the device and transmitting the signal to the data processing center. A speaker for voice interaction, the device informs the wearer of the information by means of voice, and the wearer can convey the command to the device through a mic used in the present system. An information output device e.g., Mic, for reminding the wearer of relevant information, such as voice reminder, pressure sensing, temperature sensing, vibration sensing, etc. The data processing center is used for overall control of the system, including device, acceptance, processing, analysis, and transmission of the sensor data; wherein the image and sound transmission are implemented by the transmission module. The transmission module collects images from the image acquisition device in real time while collecting sounds around the wearer and transmitting them remotely.
[041] Preferably, the camera collects the front side of the wearer or collects in various angles and collected from all angles of view, specially form corners. Preferably, the ranging sensors are in one-to-one correspondence with the image capturing device, and are aligned at the same angle for detecting peripheral information; the ranging sensor and the infrared sensor are also collected on the front side of the wearer, or All aspects of the collection are collected; if it is collected from all angles of view, the distance image and the infrared image of the omnidirectional view are separately imaged in the data processing center to form a distance panorama and an infrared panorama, or no splicing, The distance images of the respective viewing angles are stored separately from the infrared images.
[042] Preferably, the voice module for voice interaction is bidirectional, the device can monitor the user’s instructions, and the device can also send relevant information to the wearer as needed. Preferably, the information output device, if the object is approaching the user by analyzing the distance image and the infrared image, issues a prompt and indicates a direction to remind the user to pay attention to safety. In addition, the device can also guide the user by means of vibration sensing.
[043] Preferably, the camera collects inputs in real time and simultaneously collects sounds around the user and transmits them to the guide. Interaction to achieve remote monitoring purposes.
[044] Compared with the prior art, the present invention has the following beneficial effects: The invention is a wearable device, which has the advantages of simple portability, easy expansion, and the like, and can be used by all blind people in daily life; meanwhile, a data processing center is adopted, which can have other functions of the smart device; further, the present invention discloses the hardware can be used as a wearable auxiliary device platform for all blind people. For different types and different levels of functional requirements, the surrounding monitoring methods can be designed in a targeted manner to achieve real-time monitoring. At the same time, for different users' needs, signals can be output in different ways (sound, temperature, vibration, etc.) to remind the user of the surrounding situation.
[045] The main function of the system described in this embodiment is to provide guidance for the blind population. The system can not only monitor various environments, but also enable the patient to understand the surrounding environment even if he cannot see it. The data processing center can design different environmental monitoring programs in a targeted manner, so that patients can protect themselves in various environments and understand the surrounding conditions; the data processing center can also image signals, voice signals and necessary information. It is sent to the remote monitoring terminal by means of wireless transmission, so that the guardian can monitor the user of the system in real time through remote means.
[046] The system of the invention can collect real-life scenes in real time, utilizes sensors to comprehensively detect the surrounding environment, and wirelessly transmits the analyzed data to the remote monitoring device to achieve the functions of guiding blindness and remote monitoring.
[047] Navigation of unfamiliar territory is challenging for those of us who cannot see or who are visually impaired. Immediate obstacles, variations in terrain, moving vehicles, people or animals, street signs, fences, and trees are all unknown to the visually impaired. Without aide, the ability to safely navigate new or unfamiliar environments is almost impossible. Embodiments of the present invention recognize the visually impaired can use solutions involving integration of advances in technology to improve the quality of their lives and assist them in safely and independently navigating new or unfamiliar environments.
[048] It is accordingly an object of the present invention to provide a novel automated prediction system that helps to data scientists, researchers, and developers to predict the future information within less efforts and time and human interaction. The problem related to model selection and the type of problem selection in prediction have solved by the present invention.
[049] What has been described above includes examples of the subject invention. It is, of course, not possible to describe every conceivable combination of components or methodologies for purposes of describing the subject invention, but one of ordinary skill in the art may recognize that many further combinations and permutations of the subject invention are possible. Accordingly, the subject invention is intended to embrace all such alterations, modifications and variations that fall within the spirit and scope of the appended claims. Furthermore, to the extent that the term “includes” is used in either the detailed description or the claims, such term is intended to be inclusive in a manner similar to the term “comprising” as “comprising” is interpreted when employed as a transitional word in a claim.
[050] The foregoing descriptions of specific exemplary embodiments of the present invention have been presented for purposes of illustration and description only. They are not intended to be exhaustive or to limit the invention to the precise forms and sequence of steps disclosed, and obviously many modifications and variations are possible considering the above teachings.
[051] The exemplary embodiments were chosen and described in order to explain certain principles of the invention and their practical application, thereby enabling others skilled in the art to make and utilize various exemplary embodiments of the present invention, as well as various alternatives and modifications thereof.

We Claim:

1. A glass assembly for visually impaired, comprising:
Lidar (LIGHT DETECTION AND RANGE) module, an ARDUINO UNO (Circuit to connect hardware to software), 3 micro vibration motors, an Arduino speaker, and a mic, one or more camera and a blind stick.
2. The system as claimed in claim 1, wherein a real time Artificial intelligence (AI) based sensor which inform the person every condition such as which way is correct, what is weather or if any person is coming towards the person.
3. The system as claimed in claim 1, wherein the vibration motors provide the particular direction to the user and the Arduino speaker and mic is used to provide commands to the user and vice versa.
4. The system as claimed in claim 1, wherein the blind stick or stick is used to hold the other components and functions properly.
5. The system as claimed in claim 1, wherein the stick is the core of information in which the Lidar component is set to collect the information of features such as depth, distance of object from the person (wearing glasses) even works for corners of the object.
6. The system as claimed in claim 1, wherein the stated specs further include an emergency feature which automatically dials to the family members of the user (blind person) or maybe the nearest relative or friend for asking help.
7. The system as claimed in claim 1, wherein the smart glasses comprise a buzz and in emergency it can create sound “HELP” for asking help of the surrounding people.