Abstract: The present subject matter relates to an in-vehicle voice enhancement system (112). The system (112) includes a receiver (214) to receive multiple audio inputs from an infotainment microphone(s) (108), a smartphone microphone(s) (116), and a connected device microphone(s) (124). The system (112) includes a logical decision maker (222) to retrieve a noise sample from a storage (212) based on ascertained current vehicle condition. The system (112) further includes an audio processor (216) to compare the multiple audio inputs with the noise sample, and based on comparison, identify one of the multiple audio inputs as a noise input and one of the multiple audio inputs as a voice input. The system (112) further includes a combiner (218) to combine the noise sample with the noise input to obtain a combined noise input, and a noise canceller (220) to generate an audio output by reducing noise from the voice input through destructive interference/filtering of the voice input with the combined noised input.
Claims:1. An in-vehicle voice enhancement system (112), comprising:
a receiver (214) to receive multiple audio inputs from an infotainment microphone(s) (108), a smartphone microphone(s) (116), and a connected device microphone(s) (124);
a logical decision maker (222) to retrieve a noise sample from a storage (212) based on ascertained current vehicle condition;
an audio processor (216) coupled to the receiver (24), wherein the audio processor (216) is to:
compare the multiple audio inputs with the noise sample, and
based on comparison, identify one of the multiple audio inputs as a noise input and one of the multiple audio inputs as a voice input,
a combiner (218), coupled to the audio processor (216), to combine the noise sample with the noise input to obtain a combined noise input; and
a noise canceller (220), coupled to the combiner (218) and the audio processor (216), to generate an audio output by reducing noise from the voice input through filtering of the voice input using the combined noised input.
2. The system (112) as claimed in claim 1, wherein the logical decision maker (222) is to ascertain the current vehicle condition based on vehicle sensor data (118).
3. The system (112) as claimed in claim 1, wherein the cabin noise audio database (212) regularly receives updated noise samples from a centralized database over a network (302).
4. The system (112) as claimed in claim 1, wherein the audio processor (216) is to identify one of the multiple audio inputs as the noise input when said audio input matches with the noise sample.
5. The system (112) as claimed in claim 1, wherein the audio processor (216) is to identify multiple audio inputs as the voice input when said audio input fails to match with the noise sample.
6. A method for operating an in-vehicle voice enhancement system (112), the method comprising:
receiving, at a smartphone (114), multiple audio inputs from an infotainment microphone(s) (108), a smartphone microphone(s) (116), and a connected device microphone(s) (124);
retrieving, by a logic decision maker (216) of the smartphone (114), a noise sample from a storage (212) based on ascertained current vehicle condition;
comparing, by an audio processor (216) of the smartphone (114), all the multiple audio inputs with the noise sample;
based on comparison, identifying by the audio processor (216) one of the multiple audio inputs as a noise input and one of the multiple audio inputs as a voice input;
combining, by a combiner (218) of the smartphone (114), the noise sample with the noise input to obtain a combined noise input; and
generating, by a canceller (220) of the smartphone (114), an audio output by reducing noise from the voice input through filtering the voice input using the combine noised input.
7. The method as claimed in claim 6, wherein the method comprising ascertaining, by the logical decision maker (216), the current vehicle condition based on vehicle sensor data (118).
8. The method as claimed in claim 6, wherein the storage (212) is a cabin noise audio database that regularly receives updated noise samples from a centralized database over a network (302).
9. The method as claimed in claim 6, wherein the identifying comprising identifying one of the multiple audio inputs as the noise input when said audio input matches with the noise sample.
10. The method as claimed in claim 6, wherein the identifying comprising identifying one of the multiple audio inputs as the voice input when said audio input fails to match with the noise sample.
Description:TECHNICAL FIELD
[0001] The present disclosure relates generally to an in-vehicle voice enhancement system or method with learning capability for achieving noise reduction for hands free telephony and voice recognition functions inside the vehicle. This noise reduction feature may be implemented on a smartphone application utilizing hardware and software capability of the smartphone.
BACKGROUND
[0002] For both safety and convenience reasons, in-vehicle infotainment systems with hands-free function have become popular to include within a vehicle cabin. Such in-vehicle infotainment systems may be implemented within the vehicle cabin to allow a user, e.g., driver or passenger, to use verbal commands for controlling certain vehicle functions, or to communicate with others through a series of communication networks.
[0003] In order to be effective, it is important that the user's speech is clearly detectable from other noises that may be received by an infotainment microphone implemented in the vehicle cabin for receiving the user's speech. The noises in the vehicle cabin are sounds picked up by the infotainment microphone, where in-cabin noise is recognized to be caused by known vehicle components and/or known/unknown external factors. Further, level and type of the in-cabin noise are always changing thereby creating limitation in performance of the voice-based functions/features of the in-vehicle infotainment system.
[0004] One known solution in the state of the art to reduce the in-cabin noise is to implement noise filtering/cancellation mechanism in the in-vehicle infotainment system. However, these noise filtering/cancellation mechanisms are limited by hardware/software capability of the infotainment microphone and the in-vehicle infotainment system. Limitations of the filtering/noise cancellation mechanism may include, but not limited to, filters may compromise between level of cancellation and voice quality, filters may be tuned for specific condition, i.e., noise type and inferior performance in other scenarios, filters may include static/hard-coded parameters that can’t be updated, filters may be implemented in limited processing capability of the in-vehicle infotainment system, filters may not have any awareness regarding driving condition, environment conditions etc., and filter may compromise between level of cancellation and voice quality filters.
[0005] Also, the filtering/noise cancellation mechanism may depend on type and number of infotainment microphone installed in the vehicle cabin. For instance, in one known solution in the state of the art may include the usage of two infotainment microphones, where one microphone is used to detect the vehicle cabin noise and another microphone is used to detect a voice input from a user of the in-vehicle infotainment system. However, having two infotainment microphones results in complexity of packaging, increased processing power requirement on infotainment system, results in increase in overall cost and fails to achieve desired results in certain scenarios.
[0006] In addition to that, the infotainment microphone would not be able to capture the voice properly in case a user using the hands-free function is seated anywhere else than the driver’s seat in the vehicle as the infotainment microphone is generally mounted on driver’s side.
[0007] Accordingly, there is a need for a mechanism to reduce the noise from the voice input while received at the device connected for hands-free operation.
SUMMARY
[0008] This summary is provided to introduce concepts related to an in-vehicle voice enhancement system. The concepts are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
[0009] The present disclosure relates to an in-vehicle voice enhancement system. The system includes a receiver to receive multiple audio inputs from an infotainment microphone(s), a smartphone microphone(s), and a connected device microphone(s). In an example, the connected device may include connected smart wearables like smart watches, smart glasses, Bluetooth earphones etc. which are all having microphones and may be connected to smartphone/infotainment system. The system also includes an logic decision maker to retrieve a pre-recorded noise sample as reference from a storage based on ascertained current vehicle condition, compare all the received audio inputs from microphones with the noise sample, and based on comparison, identify one of the audio inputs as noise input and one of them as a voice input. The noise input is combined with the noise sample by a combiner of the system to obtain a combined noise input. Thereafter, a canceller of the system generates an audio output by reducing noise from the voice input through destructive interference or similar filtering algorithm.
[0010] In an aspect, the logic decision maker is to ascertain the current vehicle condition based on vehicle sensor data.
[0011] In an aspect, the storage is a cabin noise audio database stored on smartphone that regularly receives updated noise samples from a centralized database over a network.
[0012] In an aspect, the audio processor is to identify one of the audio inputs as a noise input when said audio input is the best match with the noise sample.
[0013] In an aspect, the audio processor is to identify one of the audio inputs as a voice input when said audio input is the worst match with the noise sample.
[0014] The present disclosure further relates to a method for operating an in-vehicle voice enhancement system. The method includes the step of receiving, at a smartphone, multiple audio inputs from an infotainment microphone(s), a smartphone microphone(s), and a connected device microphone(s); retrieving, by a logic decision maker of the smartphone, a noise sample from a storage based on ascertained current vehicle condition; comparing, by an audio processor of the smartphone, all the multiple audio inputs with the noise sample; based on comparison, identifying by the audio processor one of the multiple audio inputs as a noise input and one of the multiple audio inputs as a voice input; combining, by a combiner of the smartphone, the noise sample with the noise input to obtain a combined noise input; and generating, by a canceller of the smartphone, an audio output by reducing noise from the voice input through destructive interference or similar filtering algorithm.
[0015] In an aspect, the method includes the steps of ascertaining, by the logic decision maker, the current vehicle condition based on vehicle sensor data.
[0016] In an aspect of the method, the storage is a cabin noise audio database that regularly receives updated noise samples from a centralized database over a network. When a non-matching noise source is found, the information is stored in the app for further analysis and/or sent over network to the cloud. Based on study of this non-matching noise, the same can be used to update the current noise sample database as a new condition, if found to consistent across various conditions. This can be caused due to fitment of new part in the vehicle or some other modification to the vehicle.
[0017] In an aspect, the method of identifying includes the step of identifying one of the multiple audio inputs as the noise input when said audio input matches with the noise sample.
[0018] In an aspect, the method of identifying includes the step of identifying one of the multiple audio inputs as the voice input when said audio input fails to match with the noise sample.
[0019] To further understand the characteristics and technical contents of the present subject matter, a description relating thereto will be made with reference to the accompanying drawings. However, the drawings are illustrative only but not used to limit the scope of the present subject matter.
[0020] Various objects, features, aspects, and advantages of the inventive subject matter will become more apparent from the following detailed description of preferred embodiments, along with the accompanying drawing figures in which like numerals represent like components.
BRIEF DESCRIPTION OF FIGURES
[0021] The illustrated embodiments of the present disclosure will be best understood by reference to the drawings, wherein like parts are designated by like numerals throughout. The following description is intended only by way of example, and simply illustrates certain selected embodiments of devices, systems, and processes that are consistent with the subject matter as claimed herein, wherein:
[0022] FIG. 1 illustrates an exemplary network in which various inventive techniques and devices can be employed in an exemplary implementation of the present disclosure;
[0023] FIG. 2 illustrates various components of an exemplary in-vehicle voice enhancement system that can be utilized to implement one or more exemplary embodiments of the present disclosure;
[0024] FIG. 3 illustrates exemplary implementation of the in-vehicle voice enhancement system, according to an exemplary embodiment of the present disclosure; and
[0025] FIG. 4 illustrates a method for implementing the in-vehicle voice enhancement system, according to an exemplary embodiment of the present disclosure.
[0026] The figures depict embodiments of the present subject matter for the purposes of illustration only. A person skilled in the art will easily recognize from the following description that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles of the disclosure described herein.
DETAILED DESCRIPTION
[0027] A few aspects of the present disclosure are explained in detail below with reference to the various figures. Example implementations are described to illustrate the disclosed subject matter, not to limit its scope, which is defined by the claims. Those of ordinary skill in the art will recognize a number of equivalent variations of the various features provided in the description that follows.
[0028] In the disclosure hereinafter, one or more terms are used to describe various aspects of the present disclosure. For a better understanding of the present disclosure, a few definitions are provided herein for better understating of the present disclosure.
[0029] “In-vehicle infotainment system” is defined as a combination of vehicle systems which are used to deliver entertainment and information to the driver and the passengers through audio/ video interfaces, control elements like touch screen displays, button panel, hands-free telephony, voice commands, and more.
[0030] “In-vehicle voice enhancement” may be defined as voice enhancing technology that allows for comfortable and safe conversations. In-vehicle voice enhancement may, including, but not necessarily limited to, hardware and software interface that uses microphones available in the vehicle cabin to detect voice signals amid the vehicle noise. The In-vehicle voice enhancement system enhances the voice signal and removes unwanted noise to create a natural sounding reproduction of the voice through the vehicle’s infotainment microphone.
[0031] “Audio processor” may be defined as a processor for signal processing that is concerned with an electronic or software manipulation of audio signals and has logic in it to compare different audio signals with noise sample to determine noise and voice inputs.
[0032] “Combiner” may be defined as a processor comprising of hardware and/or software elements to couple different audio streams into a single audio stream by assigning different weights to each. In an example, the combiner can be an electronic or software module.
[0033] “Noise Canceller” may be defined as a system or technique of applying destructive interference to eliminate noise from the audio containing voice using information of noise in it which is obtained from another audio source.
EXEMPLARY IMPLEMENTATIONS
[0034] While the present disclosure may be embodied in various forms, there are shown in the drawings, and will hereinafter be described, some exemplary and non-limiting embodiments, with the understanding that the present disclosure is to be considered an exemplification of the invention and is not intended to limit the invention to the specific embodiments illustrated. Not all of the depicted components described in this disclosure may be required, however, and some implementations may include additional, different, or fewer components from those expressly described in this disclosure. Variations in the arrangement and type of the components may be made without departing from the scope of the claims as set forth herein.
[0035] A hands free in-vehicle infotainment system implemented as part of a vehicle’s overall vehicle system may be comprised of a speech command system configured to receive a user's speech command input, recognize a command from the user's speech command input, and control a vehicle component or feature based on the recognized command from the user's speech command input. The hands free in-vehicle infotainment system implemented as part of the vehicle’s overall vehicle system may also be comprised of a hands free phone system configured to link with a communication device, e.g., smart phone that is linked to the hands free phone component, or a telecommunications component that is part of the vehicle, in order to receive a user's speech input via a microphone within the vehicle cabin and/or on the communication device, communicate the user’s speech input to another communication device, receive an external user's speech input from the other communication device, and output the external user's speech input through one or more speakers included in the vehicle cabin for the user to hear within the vehicle.
[0036] The speech command system and hands free phone system are just two examples of a hands free in-vehicle infotainment system that may be implemented within a vehicle that may utilize the noise reduction features described herein. However, for purposes of simplifying the description provided herein, the hands free in-vehicle infotainment system will be described in terms of being the hands free phone system. Even so, it should be noted that other types of hands free in-vehicle infotainment system are also contemplated as being within the scope of the subject matter described herein.
[0037] A hands free phone system may operate to allow a user within the vehicle to connect a phone, e.g., smartphone capable of wirelessly, or via wire, link to the vehicle's hands free phone system, to the hands free phone system and make a call to another phone via a telecommunications network. The connection of the hands free phone system to the phone may be in accordance to any one or more standards that include, for example, Bluetooth, Near Field Communication (NFC), WiFi (Wireless Fidelity), or other communications network may be used. In addition to the wireless connection protocols described, the hands free phone system may also connect with the phone via a wired connection.
[0038] Connecting the phone to the vehicle's hands free phone system is advantageous because it allows the user to utilize an infotainment microphone within the vehicle cabin to pick up the user's speech input, and also utilize speakers within the vehicle cabin to output a speech input received from the other phone at the other end of the call communication. In this way, the user is not required to physically hold the phone to the user's mouth and ears, as the infotainment's microphone and speakers take the place of the phone's microphone and speakers. This provides the user with the advantage of not being distracted with holding and operating the phone while driving the vehicle, or otherwise being a passenger within the vehicle. It should be noted that although this disclosure describes a phone as connecting to the vehicle's hands free phone system, this is provided for exemplary purposes. It is within the scope of the subject matter described herein to have the hands free phone system connect to other types of communication devices that are capable of communication through a communications network. For example, a laptop, a computer, tablet computing device, personal digital assistant (PDA), or other computing device capable of communicating with another communication device via a communication network may be used.
[0039] Although the hands free phone system offers the benefit of freeing up the user's hands from operating a communications device, the hands free phone system still engages in efforts to achieve a high quality call conversation with minimal noise interference. This is because the vehicle cabin from which the infotainment microphone of the hands free phone system picks up the user's speech input may be a noisy environment. For example, the vehicle cabin may be infiltrated with noises originating from various vehicle components that are operating during a call conversation. In addition, other external factors may also contribute to the noise that infiltrates the vehicle cabin. Therefore, the voice input picked up by the infotainment microphone may be comprised of the user's speech, as well as noise from various sources. It follows that it is a goal to recognize a source of a noise picked up by the infotainment microphone within the vehicle cabin, and reduce, at least in part, the noise within the voice input that may interfere with the user's actual speech.
[0040] In order to achieve this goal of noise reduction for a vehicle’s hands free in-vehicle infotainment system, an in-vehicle voice enhancement system may be utilized. The in-vehicle voice enhancement system may be a program, application, and/or some combination of software and hardware that is incorporated on one or more of the components of user’s smartphone connect to the hands free in-vehicle infotainment system. Further description for the in-vehicle voice enhancement system and the components of the user’s smartphone running the in-vehicle voice enhancement system is described in more detail below.
[0041] FIG. 1 illustrates, as an example, an environment 100 for implementation of an embodiment of the present disclosure. The environment 100 includes a vehicle 102 having an in-vehicle infotainment system 104 allowing hands free calling operation to an occupant or a user 106 of the vehicle 100. In an aspect, the in-vehicle infotainment system 104 may include an infotainment microphone(s) 108 and an audio manager 110 so as to allow the user 102 make a hands free call from the in-vehicle infotainment system 104. However, as mentioned above, while making a telephonic call through the audio manager 110 of the in-vehicle infotainment system 104, the infotainment microphone(s) 108 picks noise along with voice input.
[0042] To overcome this issue, the present disclosure proposes an in-vehicle noise enhancement system 112 running on the user’s smartphone 114. Those skilled in the art can appreciate that although the in-vehicle noise enhancement system 112 is described as running on user’s smartphone 114, the in-vehicle noise enhancement system 112 can execute on any other user device embedded with built-in microphone or is connected to device(s) with built-in microphones without deviating from the scope of the present disclosure. Examples of the user devices may include but are not limited to, personal digital assistants (PDAs), laptop computers, notebooks, smart cameras, smart wearables and other smart devices.
[0043] Further, in operation, when the user 106 makes a telephone call through the hands free audio manager 110 of the in-vehicle infotainment system 104, the user’s smartphone 114 is required to be communicatively connected with the in-vehicle infotainment system 104. In an aspect, the connection of the in-vehicle infotainment system 104 to the user’s smartphone 114 may be in accordance to any one or more wire/wireless communication standards 126 that include, for example, Bluetooth, Near Field Communication (NFC), WiFi (Wireless Fidelity), or other communications network may be used.
[0044] Once the connection of the in-vehicle infotainment system 104 is established with the user’s smartphone 114 and the user dials a mobile number on the user’s smartphone 114, the in-vehicle noise enhancement system 112 executing on the user’s smartphone 114 gets activated and receives a multiple audio inputs from the infotainment microphone(s) 108, a smartphone microphone(s) 116, and connected device(s) microphone(s) 124. Then, the in-vehicle noise enhancement system 112 retrieves a noise sample from a storage based on current vehicle condition. In an aspect, the current vehicle condition is ascertained using a vehicle sensor data 118 retrieved from a vehicle bus 120. In an example, the vehicle bus 120 can be, but not limited to, a Controller Area Network (CAN) bus, a Local Interconnect Network (LIN) bus, a FlexRay bus, an Ethernet bus, and so forth. The vehicle bus 120 includes data related to rain sensor 120A, engine RPM (revolution per minute) sensor 120B, vehicle speed sensor 120C, accelerometer data sensor 120D, blower speed sensor 120E, air conditioner setting sensor 120F, outside temperature sensor 120G, gear position sensor, cabin temperature sensor and any other sensors 120H added later in the vehicle. Based on the data available in vehicle bus 120, the current vehicle condition can be ascertained in an easy manner. For example, based on the data related to the rain sensor 120A for wiper, it can be determined if it is raining or not if the noise is due to the rain, and accordingly a noise sample of rain noise is retrieved from a storage by the in-vehicle noise enhancement system 112.
[0045] The in-vehicle noise enhancement system 112 then compares multiple audio inputs with the retrieved noise sample. Based on comparison, the in-vehicle noise enhancement system 112 identifies one of the multiple audio inputs as a voice input and remaining audio inputs as a noise input. Thereafter, the in-vehicle noise enhancement system 112 combines the noise sample with the noise input to obtain a combined noise input; and generates an audio output by reducing noise from the voice input through destructive interference of the voice input with the combined noise input. This audio output with reduced noise is sent over a communication network 128 to a receiver’s smartphone 122. In an example, the communication network 128 includes, but not limited to, 2G network, 3G network, 4G network, LTE network, and so forth.
[0046] Although destructive interference is used herein for reducing unwanted noise, those skilled in the art can appreciate that other noise reducing methods or algorithms or filters can be implemented without deviating from the scope of the present disclosure.
[0047] Thus, with the implementation of the present disclosure, the in-vehicle noise enhancement system 112 provides a superior noise cancelation or voice enhancement technique utilizing smartphone and/or connected device resources and vehicle information.
[0048] The working of the in-vehicle noise enhancement system 112 implemented in the user’s Smartphone 114, is described in more detail with reference to FIG. 2.
[0049] FIG. 2 illustrates various components of the in-vehicle noise enhancement system 112, in accordance with one example of the present disclosure. The in-vehicle noise enhancement system 112 includes a processor(s) 202, an interface(s) 204, a memory 206, the infotainment microphone(s) 108, the smartphone microphone(s) 116, and the connected device microphone(s) 124.
[0050] The processor(s) 202 may be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, logic circuitries, and/or any devices that manipulate data based on operational instructions. Among other capabilities, the one or more processor(s) 202 are configured to fetch and execute computer-readable instructions stored in the memory 206 of the in-vehicle noise enhancement system 112. The memory 206 may store one or more computer-readable instructions or routines, which may be fetched and executed to create or share the data units over a network service. The memory 206 may include any non-transitory storage device including, for example, volatile memory such as RAM, or non-volatile memory such as EPROM, flash memory, and the like.
[0051] The interface(s) 204 may include a variety of interfaces, for example, interfaces for data input and output devices referred to as I/O devices, storage devices, and the like. The interface(s) 204 may facilitate communication of the in-vehicle noise enhancement system 112 with various devices coupled to the in-vehicle noise enhancement system 112. The interface(s) 204 may also provide a communication pathway for one or more components of the in-vehicle noise enhancement system 112. Examples of such components include, but are not limited to, processing engine(s) 208 and data 210. The data 210 may include a cabin noise audio database 212 and a vehicle sensors data input 213. In an aspect, the cabin noise audio database 212 regularly receives updated noise samples from a centralized database over a network using, say, Over-the-air (OTA) updates.
[0052] The processing engine(s) 208 may be implemented as a combination of hardware and programming (for example, programmable instructions) to implement one or more functionalities of the processing engine(s) 208. In examples described herein, such combinations of hardware and programming may be implemented in several different ways. For example, the programming for the processing engine(s) 208 may be processor executable instructions stored on a non-transitory machine-readable storage medium and the hardware for the processing engine(s) 208 may include a processing resource (for example, one or more processors), to execute such instructions. In the present examples, the machine-readable storage medium may store instructions that, when executed by the processing resource, implement the processing engine(s) 208. In such examples, the in-vehicle noise enhancement system 112 may include the machine-readable storage medium storing the instructions and the processing resource to execute the instructions or the machine-readable storage medium may be separate but accessible to the in-vehicle noise enhancement system 112 and the processing resource. In other examples, the processing engine(s) 208 may be implemented by electronic circuitry.
[0053] In an example, the processing engine(s) 208 may include may include a receiver 214, an audio processor 216, a combiner 218, a noise canceller 220, a logical decision maker 222, and other engine(s) 224. The other engine(s) 224 may implement functionalities that supplement applications or functions performed by the in-vehicle noise enhancement system 112 or the processing engine(s) 208.
[0054] In operation as shown in FIG. 3, when the user 106 makes a telephone call through the hands free audio manager 110 of the in-vehicle infotainment system 104, the user’s Smartphone 114 is required to be communicatively connected with the in-vehicle infotainment system 104. In an aspect, the connection of the in-vehicle infotainment system 104 to the user’s Smartphone 114 may be in accordance to any one or more standards that include, for example, Bluetooth, Near Field Communication (NFC), WiFi (Wireless Fidelity), or other communications network may be used.
[0055] Once the connection of the in-vehicle infotainment system 104 is established with the user’s smartphone 114 and the user dials a mobile number on the user’s smartphone 114, the in-vehicle noise enhancement system 112 executing on the user’s smartphone 114 activates the receiver 214. The receiver 214 receives multiple audio inputs from the infotainment microphone(s) 108, the smartphone microphone(s) 116, and the connected device microphone(s) 124. Since the user 106 could be seated anywhere in the vehicle, it could not be figured out that from which microphone a voice input is received and from which microphone a noise input is received.
[0056] However, to clear the assumptions, the logical decision maker 222 retrieves a noise sample from a storage based on current vehicle condition. In an aspect, the current vehicle condition is ascertained by the logical decision maker 222 using the vehicle sensor data 118 retrieved from the vehicle bus 120. As mentioned above, the vehicle bus 120 includes data related to rain sensor 120A, engine RPM (revolution per minute) 120B, vehicle speed 120C, accelerometer data 120D, blower speed 120E, air conditioner setting 120F, outside temperature 120G and any other sensor data 120H. Based on the data available in vehicle bus 120, the current vehicle condition can be ascertained in an easy manner. For example, by comparing cabin temperature with set air conditioner temperature, it can be determined if the noise is due to air conditioner usage, and accordingly a noise sample of air conditioner noise is retrieved from the cabin noise audio database 212 by the logical decision maker 222.
[0057] Also, in an implementation, where multiple condition like rain, uneven road and maximum blower speed happen at same time, multiple noise sample(s) corresponding to the conditions happening together may be retrieved from the cabin noise audio database 212 by the logical decision maker 222.
[0058] The audio processor 212 then compares both the multiple audio inputs with the retrieved noise sample(s). Based on the comparison, the audio processor 212 identifies one of the multiple audio inputs as a voice input and one of the remaining audio inputs as a noise input.
[0059] In an aspect, the audio processor 212 identifies two audio inputs from amongst the multiple audio inputs, one (noise input) which is most similar to the noise sample and another (voice input) which is most different to noise sample.
[0060] In another aspect, the audio processor 212 identifies some of the multiple audio inputs as the noise input when said audio inputs match with the noise sample(s), and identifies remaining one of the multiple audio inputs as a voice input when said audio input fails to match with the noise sample.
[0061] Thereafter, the combiner 218 performs weighed combination of the noise sample(s) with the noise input to obtain a combined noise input.
[0062] Finally, the noise canceller 220 generates an audio output by reducing noise from the voice input through destructive interference/filtering of the voice input using the combined noise input. This audio output with reduced noise is sent over network 302 to the receiver’s Smartphone 122 for telephonic communication.
[0063] Although destructive interference method is used herein for reducing unwanted noise, those skilled in the art can appreciate that other noise reducing methods or algorithms or filters can be implemented without deviating from the scope of the present disclosure.
[0064] In an implementation, noise reduction is achieved using destructive interference.
[0065] FIG. 4 illustrates a method 400 for operating the in-vehicle noise enhancement system 112, according to an implementation of the present disclosure. The order in which the method 400 is described is not intended to be construed as a limitation, and any number of the described method blocks can be combined in any appropriate order to carry out the method 400 or an alternative method. Additionally, individual blocks may be deleted from the method 400 without departing from the scope of the subject matter described herein.
[0066] The method 400 can be performed by programmed computing devices, for example, based on instructions retrieved from the non-transitory computer-readable medium or non-transitory computer-readable media. The computer-readable media can include machine-executable or computer-executable instructions to perform all or portions of the described method. The computer readable media may be, for example, digital memories, magnetic storage media, such as magnetic disks and magnetic tapes, hard drives, solid state drives or optically readable data storage media.
[0067] Referring to FIG. 4, the method 400 may be performed by in-vehicle noise enhancement system 112.
[0068] At block 402, the method 400 includes receiving, at a smartphone 114, multiple audio inputs from the infotainment microphone(s) 108, a smartphone microphone(s) 116, and connected device(s) microphone(s) 124.
[0069] At block 404, the method 400 includes retrieving, by a logical decision maker 222 of the smartphone 114, a noise sample from a storage based on ascertained current vehicle condition.
[0070] At block 406, the method 400 includes comparing, by the audio processor 216, all the multiple audio inputs with the noise sample.
[0071] At block 408, the method 400 includes, based on comparison, identifying by the audio processor 216 one of the multiple audio inputs as a noise input and one of the multiple audio inputs as a voice input.
[0072] At block 410, the method 400 includes combining, by a combiner 218 of the smartphone 114, the noise sample with the noise input to obtain a combined noise input.
[0073] At block 412, the method 400 includes generating, by a canceller 220 of the smartphone 114, an audio output by reducing noise from the voice input through destructive interference of the voice input with the combine noised input.
[0074] Thus, with the implementation of the method 400 of the present subject matter, the in-vehicle noise enhancement system 112 provides a superior noise cancelation or voice enhancement technique utilizing Smartphone resources and vehicle information.
[0075] Also, although the present disclosure is implemented using one microphone implemented in a vehicle cabin, those skilled in the art can appreciate that more than one microphones can be implemented inside the vehicle cabin to achieve the similar results. For example, one microphone can be position on a first row and another microphone can be position on a second row.
[0076] Further, with the implementation of the present disclosure, the cabin noise present inside the vehicle is clearly identified using the noise samples of the previous noises occurred in the same or different vehicle. Such usage of previous noise samples makes the process more enhanced as those skilled in the art can appreciate that it is already known what is the major source of noise in the cabin and same can be removed from the voice input by the noise canceller. Accordingly, the present disclosure provides an in-vehicle voice enhancement system which reduces cabin noise during interfacing with the hands free features of the in-vehicle infotainment system. Yet further, although the subject matter is described with reference to making a telephonic call, the present subject matter is equally applicable to other hands free functions including voice commands, voice recordings, speech to text, and voice control functions.
[0077] The above description does not provide specific details of the manufacture or design of the various components. Those of skill in the art are familiar with such details, and unless departures from those techniques are set out, techniques, known, related art or later developed designs and materials should be employed. Those in the art are capable of choosing suitable manufacturing and design details.
[0078] It should be understood, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise, as apparent from the discussion herein, it is appreciated that throughout the description, discussions utilizing terms such as “receiving,” or “retrieving,” or “comparing,” or “generating,” or the like, refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission or display devices.
[0079] The exemplary embodiment also relates to a system for performing the operations discussed herein. This apparatus may be specially constructed for the required purposes, or it may comprise a general-purpose computer selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a computer-readable storage medium, such as, but is not limited to, any type of disk including floppy disks, optical disks, CD-ROMs, and magnetic-optical disks, read-only memories (ROMs), random access memories (RAMs), EPROMs, EEPROMs, solid state drives, magnetic or optical cards, or any type of media suitable for storing electronic instructions, and each coupled to a computer system bus.
[0080] Further, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. It will be appreciated that several of the above-disclosed and other features and functions, or alternatives thereof, may be combined into other systems or applications. Various presently unforeseen or unanticipated alternatives, modifications, variations, or improvements therein may subsequently be made by those skilled in the art without departing from the scope of the present disclosure as encompassed by the following claims.
[0081] The claims, as originally presented and as they may be amended, encompass variations, alternatives, modifications, improvements, equivalents, and substantial equivalents of the embodiments and teachings disclosed herein, including those that are presently unforeseen or unappreciated, and that, for example, may arise from applicants/patentees and others.
[0082] It will be appreciated that variants of the above-disclosed and other features and functions, or alternatives thereof, may be combined into many other different systems or applications. Various presently unforeseen or unanticipated alternatives, modifications, variations, or improvements therein may be subsequently made by those skilled in the art which are also intended to be encompassed by the following claims.
| # | Name | Date |
|---|---|---|
| 1 | 202011054805-STATEMENT OF UNDERTAKING (FORM 3) [16-12-2020(online)].pdf | 2020-12-16 |
| 2 | 202011054805-POWER OF AUTHORITY [16-12-2020(online)].pdf | 2020-12-16 |
| 3 | 202011054805-FORM 1 [16-12-2020(online)].pdf | 2020-12-16 |
| 4 | 202011054805-FIGURE OF ABSTRACT [16-12-2020(online)].jpg | 2020-12-16 |
| 5 | 202011054805-DRAWINGS [16-12-2020(online)].pdf | 2020-12-16 |
| 6 | 202011054805-DECLARATION OF INVENTORSHIP (FORM 5) [16-12-2020(online)].pdf | 2020-12-16 |
| 7 | 202011054805-COMPLETE SPECIFICATION [16-12-2020(online)].pdf | 2020-12-16 |
| 8 | 202011054805-Proof of Right [19-03-2021(online)].pdf | 2021-03-19 |
| 9 | 202011054805-FORM 18 [14-04-2021(online)].pdf | 2021-04-14 |
| 10 | 202011054805-FER.pdf | 2022-08-01 |
| 11 | 202011054805-FER_SER_REPLY [11-01-2023(online)].pdf | 2023-01-11 |
| 12 | 202011054805-ENDORSEMENT BY INVENTORS [11-01-2023(online)].pdf | 2023-01-11 |
| 13 | 202011054805-CLAIMS [11-01-2023(online)].pdf | 2023-01-11 |
| 14 | 202011054805-PatentCertificate07-03-2024.pdf | 2024-03-07 |
| 15 | 202011054805-IntimationOfGrant07-03-2024.pdf | 2024-03-07 |
| 16 | 202011054805-PROOF OF ALTERATION [25-06-2024(online)].pdf | 2024-06-25 |
| 1 | Search202011054805(1)E_26-07-2022.pdf |