The present invention relates to the field of communication system, and more particularly, the present invention relates to a deaf and blind communication system based on a mode recognition technology for solving a communication problem of disabled people.
BACKGROUND ART

[0002] The developments in science and technology have reached to great heights in making the human life easier and comfortable within a short span of time. During the last few decades, we have come across various technologies that have made life so easier and comfortable. But always running in the race to be ahead of everyone many have forgotten that society still have a section of population called the physically disabled people who are deprived of the advancements of science and technology because it has not given them that comfort that is required by them to feel that they too are the part of the society and they too can walk hand in hand with others. Communication being a fundamental aspect of human life is very much difficult for the people who are blind and deaf.
[0003] The available communication system is not economical, accurate and time efficient. Further, the available systems are not user friendly as these systems take time to respond. Some of the systems are not effectively used for multi-disable person. Also, the available systems are provided with the wrong information, which may mislead the user.
[0004] Following are some of the attempts made to develop a deaf and blind communication system based on a mode recognition technology for solving a communication problem of disabled people.
[0005] WO9717043A1 discloses eyeglasses provided with sensors for blind and/or deaf-blind people that relates to eyeglasses suitable for blind and/or deaf-blind people. More particularly, the invention relates to eyeglasses provided with sensors allowing to reveal obstacles and to indicate their distance to the user.
[0006] US2013181833A1 discloses a monitoring system for sudden infant death syndrome for blind and deaf parents that relates to a monitoring system for sudden infant death syndrome alerts parents, including parents who are blind and deaf, of any unexpected and unpleasant change in their infant's health condition, especially at night time.
[0007] CN105892624A discloses disabled-helping barrier-free communication method based on pattern recognition technology that relates to a method for facilitating disabled communication, in particular to a method for facilitating disabled communication based on pattern recognition technology.
[0008] Although, there are a number of solutions in the form of communication systems, none of them are specially designed with an accurate understanding. Although, some of the prior existing solutions attempt to create a reliable and economical communication systems for assisting physically disabled persons, but this solution fails to meet the user’s requirement. In the view of above prior art, it can be understood that many communication systems have been designed in an attempt to provide similar solution, however they are bulky, expensive, and inefficient.
[0009] In the light of foregoing, there is need a deaf and blind communication system based on a mode recognition technology for solving a communication problem of disabled people. that overcomes problems prevalent in the prior art.

OBJECTS OF THE INVENTION

[0010] The principal object of the present invention is to overcome the disadvantages of the prior art by providing a deaf and blind communication system based on a mode recognition technology for solving a communication problem of disabled people.
[0011] An object of the present invention is to provide a deaf and blind communication system, wherein the system is economical.
[0012] Another object of the present invention is to provide a deaf and blind communication system, wherein the system generates an alert for a user.
[0013] Another object of the present invention is to provide a deaf and blind communication system, wherein the system is energy efficient.
[0014] Another object of the present invention is to provide a deaf and blind communication system, wherein the system is time efficient.
[0015] Yet another object of the present invention is to provide a deaf and blind communication system, wherein the system is operated from a remote location.
[0016] The foregoing and other objects of the present invention will become readily apparent upon further review of the following detailed description of the embodiments as illustrated in the accompanying drawings.
SUMMARY OF THE INVENTION

[0017] The present invention relates to a deaf and blind communication system based on a mode recognition technology for solving a communication problem of disabled people.
[0018] In an exemplary, non-limiting implementation, the system uses following specifications:
1. "LANGUAGE USED: Python
2. TOOLS: PyCharm IDE
3. LIBRARIES USED: pyttsx3, gTTs, playsound, googletrans, tkinter, SpeechRecognition, pymsg box"
[0019] The system includes following steps:
[0020] In one embodiment, the user starts with user login.
[0021] At next step, the user selects the input function and enters the content through an input module of an electronic device.
[0022] At next step, according to the different input forms, the system automatically converts voice, text and mute language, and transfers the text information to a network server.
[0023] At next step, after the information reaches the network server, the network server converts the text to voice and text to gesture to adapt to the corresponding information of the disabled.
[0024] At next step, the recipient receives the content and constantly refreshes the activity history.
[0025] In one embodiment, the deaf and mute can enter mute words and gestures, enter text, the blind can enter voice, and the people with reduced mobility can enter voice.
[0026] In one embodiment, for the blind, the text message from the other party reaches the electronic device and is converted into voice; for the deaf and mute, the text information from the other party reaches the electronic device and is converted into a gesture; for the person with limited mobility, the text information from the other party reaches the electronic device is turned into gestures and voice.
[0027] In one embodiment, the login user at initial step includes blind login and other login methods.
[0028] In one embodiment, the blind login method is to input a login password by voice for voice recognition, and the system determines whether it is a legal user.
[0029] In one embodiment, the other login method is voice input "start recognition" for face recognition, and at the same time enter the login password, the system determines whether it is a legitimate user.
[0030] In one embodiment, the electronic device is a mobile or a laptop or a computer or a tablet or a like IOT based electronic device.
[0031] In one embodiment, the network server may include a wired communication module or a wireless communication module like a Bluetooth or a Wi-Fi or an internet.
[0032] In one embodiment, the text information is an email or a text message or a chat reply or information or a alphabets or numerals or alphanumeric information.
[0033] While the invention has been described and shown with reference to the preferred embodiment, it will be apparent that variations might be possible that would fall within the scope of the present invention.
DETAILED DESCRIPTION OF THE INVENTION

[0034] While the present invention is described herein by way of example using embodiments and illustrative drawings, those skilled in the art will recognize that the invention is not limited to the embodiments of drawing or drawings described and are not intended to represent the scale of the various components. It should be understood that the drawings and the detailed description thereto are not intended to limit the invention to the particular form disclosed, but on the contrary, the invention is to cover all modifications, equivalents, and alternatives falling within the scope of the present invention as defined by the appended claim.
[0035] As used throughout this description, the word "may" is used in a permissive sense (i.e. meaning having the potential to), rather than the mandatory sense, (i.e. meaning must). Further, the words "a" or "an" mean "at least one” and the word “plurality” means “one or more” unless otherwise mentioned. Furthermore, the terminology and phraseology used herein are solely used for descriptive purposes and should not be construed as limiting in scope. Language such as "including," "comprising," "having," "containing," or "involving," and variations thereof, is intended to be broad and encompass the subject matter listed thereafter, equivalents, and additional subject matter not recited, and is not intended to exclude other additives, components, integers, or steps. Likewise, the term "comprising" is considered synonymous with the terms "including" or "containing" for applicable legal purposes. Any discussion of documents, acts, materials, devices, articles, and the like are included in the specification solely for the purpose of providing a context for the present invention. It is not suggested or represented that any or all these matters form part of the prior art base or were common general knowledge in the field relevant to the present invention.
[0036] In this disclosure, whenever a composition or an element or a group of elements is preceded with the transitional phrase “comprising”, it is understood that we also contemplate the same composition, element, or group of elements with transitional phrases “consisting of”, “consisting”, “selected from the group of consisting of, “including”, or “is” preceding the recitation of the composition, element or group of elements and vice versa.
[0037] The present invention is described hereinafter by various embodiments with reference to the accompanying drawing, wherein reference numerals used in the accompanying drawing correspond to the like elements throughout the description. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiment set forth herein. Rather, the embodiment is provided so that this disclosure will be thorough and complete and will fully convey the scope of the invention to those skilled in the art. In the following detailed description, numeric values and ranges are provided for various aspects of the implementations described. These values and ranges are to be treated as examples only and are not intended to limit the scope of the claims. In addition, several materials are identified as suitable for various facets of the implementations. These materials are to be treated as exemplary and are not intended to limit the scope of the invention.
[0038] The present invention relates to a deaf and blind communication system based on a mode recognition technology for solving a communication problem of disabled people. The system is economical. The system is provided with a translator. The system is energy efficient. The system basically controls the electronic device’s functions of the blind person's voice, listens to music, listens to crosstalk, schedule reminders, voice chat and other functions, and basically meets the daily communication needs of the blind person. The login function of face recognition is designed for deaf-mute people and people with reduced mobility, making it fast and simple to log in to the system and use the system. At the same time, the provided voice control computer can use the computer in a comprehensive, simple and barrier-free way. In terms of communication with the disabled, the blind, deaf-mute, people with reduced mobility, and normal people can choose their own way to transmit their information and receive information from the other party, and truly achieve barrier-free communication. The application is flexible and versatile. It can not only meet the application requirements of barrier-free electronic devices for people with disabilities, but also solve the problem of communication barriers for people with disabilities in online information shearing through chat. This system can be widely used in the field of disability assistance to help disabled people better. Use information, get information, exchange information.
[0039] The basic approach of the barrier of disabilities in communication of the people suffering from any of the possible combination of blindness and deafness among themselves as well as normal people. There are two type of disabilities and facilitate every disabled person and the normal person to communicate with the differently-abled. The person can communicate and transfer the message as per his ability and desire. Those who are unable to understand the text can make use to get the output in the audio form for normal or blind people and for blind and deaf person. Moreover, the message can also be displayed in the form of text on the screen for deaf people. Thus, this approach can tackle to any type of difficulty that can come across the process of communication among differently abled people and the normal world.
[0040] The present invention relates to a deaf and blind communication system based on a mode recognition technology for solving a communication problem of disabled people.
[0041] In an exemplary, non-limiting implementation, the system uses following specifications:
1. "LANGUAGE USED: Python
2. TOOLS: PyCharm IDE
3. LIBRARIES USED: pyttsx3, gTTs, playsound, googletrans, tkinter, SpeechRecognition, pymsg box"
[0042] In a first non-limiting exemplary implementation, the system includes following steps:
[0043] In one embodiment, the user starts with user login.
[0044] At next step, the user selects the input function and enters the content through an input module of an electronic device.
[0045] At next step, according to the different input forms, the system automatically converts voice, text and mute language, and transfers the text information to a network server.
[0046] At next step, after the information reaches the network server, the network server converts the text to voice and text to gesture to adapt to the corresponding information of the disabled.
[0047] At next step, the recipient receives the content and constantly refreshes the activity history.
[0048] The deaf and mute can enter mute words and gestures, enter text, the blind can enter voice, and the people with reduced mobility can enter voice. For the blind, the text message from the other party reaches the electronic device and is converted into voice; for the deaf and mute, the text information from the other party reaches the electronic device and is converted into a gesture; for the person with limited mobility, the text information from the other party reaches the electronic device is turned into gestures and voice. The login user at initial step includes blind login and other login methods. The blind login method is to input a login password by voice for voice recognition, and the system determines whether it is a legal user. The other login method is voice input "start recognition" for face recognition, and at the same time enter the login password, the system determines whether it is a legitimate user. The electronic device is a mobile or a laptop or a computer or a tablet or a like IOT based electronic device. The network server may include a wired communication module or a wireless communication module like a Bluetooth or a Wi-Fi or an internet. The text information is an email or a text message or a chat reply or information or a alphabets or numerals or alphanumeric information.
[0049] In a second non-limiting exemplary implementation, the system includes following steps:
[0050] First enter the login password by voice to perform voice recognition, and the system determines whether it is a legitimate user. The system selects the corresponding functions through voice reminders, including four functions: listening to music, listening to crosstalk, schedule reminders, and voice chat. The user enters the function name of the corresponding function by voice input, and the voice recognition opens the corresponding function. After opening different functions, the voice prompts the system status and available operations. The user speaks the corresponding voice command or content according to the prompt. After the system performs voice recognition, it completes the corresponding tasks, including selecting a song, pausing or resuming music playback, and selecting a date, create schedule reminders, enter chat content, etc. Users can switch functions by switching voice input function instructions.
[0051] In a third non-limiting exemplary implementation, the system includes following steps:
[0052] For deaf and mute people, the operation of the system is no different from the operation of ordinary people on the electronic device, which can be achieved by input module, or you can use voice to control the electronic device. For people with limited mobility, first input voice "start recognition" for face recognition, and at the same time enter the login password, the system determines whether it is a legitimate user. After logging in to the system, you can perform the following operations: voice control programs (such as browsing the web, etc.), manually write documents, and open the chat function. After finishing one of the above operations, return to the program interface, and then turn on other functions.
[0053] Various modifications to these embodiments are apparent to those skilled in the art from the description and the accompanying drawings. The principles associated with the various embodiments described herein may be applied to other embodiments. Therefore, the description is not intended to be limited to the 5 embodiments shown along with the accompanying drawings but is to be providing the broadest scope consistent with the principles and the novel and inventive features disclosed or suggested herein. Accordingly, the invention is anticipated to hold on to all other such alternatives, modifications, and variations that fall within the scope of the present invention and appended claims.

We Claim:

1) A deaf and blind communication system (100), the system (100) method comprises the following steps:

login user;

the user selects the input function and enters the content through an input module of an electronic device;

according to the different input forms, the system automatically converts voice, text and mute language, and transfers the text information to a network server;

After the information reaches the network server, the network server converts the text to voice and text to gesture to adapt to the corresponding information of the disabled;

the recipient receives the content and constantly refreshes the activity history.

2) The system as claimed in claim 1 wherein the deaf and mute can enter mute words and gestures, enter text, the blind can enter voice, and the people with reduced mobility can enter voice.

3) The system as claimed in claim 1, wherein for the blind, the text message from the other party reaches the electronic device and is converted into voice; for the deaf and mute, the text information from the other party reaches the electronic device and is converted into a gesture; for the person with limited mobility, the text information from the other party reaches the electronic device is turned into gestures and voice.

4) The system as claimed in claim 1, wherein the login user at initial step includes blind login and other login methods.

5) The system as claimed in claim 4, wherein the blind login method is to input a login password by voice for voice recognition, and the system determines whether it is a legal user.

6) The system as claimed in claim 4, wherein the other login method is voice input "start recognition" for face recognition, and at the same time enter the login password, the system determines whether it is a legitimate user.

7) The system (100) as claimed in claim 1, wherein the electronic device is a mobile or a laptop or a computer or a tablet or a like IOT based electronic device.

8) The system (100) as claimed in claim 1, wherein the network server may include a wired communication module or a wireless communication module like a Bluetooth or a Wi-Fi or an internet.

9) The system (100) as claimed in claim 1, wherein the text information is an email or a text message or a chat reply or information or a alphabets or numerals or alphanumeric information.