CA2546535C - A double talk activity detector and method for an echo canceler circuit - Google Patents
A double talk activity detector and method for an echo canceler circuit Download PDFInfo
- Publication number
- CA2546535C CA2546535C CA002546535A CA2546535A CA2546535C CA 2546535 C CA2546535 C CA 2546535C CA 002546535 A CA002546535 A CA 002546535A CA 2546535 A CA2546535 A CA 2546535A CA 2546535 C CA2546535 C CA 2546535C
- Authority
- CA
- Canada
- Prior art keywords
- data
- echo canceler
- double talk
- center
- response
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B3/00—Line transmission systems
- H04B3/02—Details
- H04B3/20—Reducing echo effects or singing; Opening or closing transmitting path; Conditioning for transmission in one direction or the other
- H04B3/23—Reducing echo effects or singing; Opening or closing transmitting path; Conditioning for transmission in one direction or the other using a replica of transmitted signal in the time domain, e.g. echo cancellers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M9/00—Arrangements for interconnection not involving centralised switching
- H04M9/08—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic
- H04M9/082—Two-way loud-speaking telephone systems with means for conditioning the signal, e.g. for suppressing echoes for one or both directions of traffic using echo cancellers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B3/00—Line transmission systems
- H04B3/02—Details
- H04B3/20—Reducing echo effects or singing; Opening or closing transmitting path; Conditioning for transmission in one direction or the other
Abstract
A double talk activity detector (30) and method for an echo canceler circuit (10) improves the probability of detecting a double talk condition based on at least pre-echo canceler uplink data (40). The echo canceler circuit (10) includes a double talk activity probability data generator (30) and an echo canceler stage (20). The double talk activity probability data generator (30) receives pre-echo canceler uplink data (40) and in response produces double talk activity probability data (50). The echo canceler stage (20) is coupled to the double talk activity probability data generator (30) and receives downlink data (60), pre-echo canceler uplink data (40) and the double talk activity probability data (50) and in response produces attenuated uplink data (70).
Description
A DOUBLE TALK ACTIVITY DETECTOR AND METHOD FOR AN ECHO
CANCELER CIRCUIT
FIELD OF THE INVENTION
The invention relates generally to communication systems and more particularly to echo cancelers and echo cancellation methods.
BACKGROUND OF THE INVENTION
Echo in a communication system is commonly characterized as the return of a part of a transmitted signal from an end user back to the originator of the transmitted signal after a delay period. As is known in the art, a near end user transmits an uplink signal to a far end user. Conversely, the near end user receives a downlink signal from the far end user. For example, echo at the near end occurs when the near end user originates an uplink signal on an uplink path, and a part of the transmitted signal is reflected at the far end as an echo signal on a downlink path back to the near end.
Echo at the fax end occurs when the far end user originates a downlink signal on the downlink path, and a part of the transmitted signal is reflected at the near end as an echo signal on the uplink path back to the far end. The reflection of the transmitted signal may occur due to a number of reasons, such as an impedance mismatch in a four/two wire hybrid at the far end or feedback due to acoustic coupling in a telephone, wireless device or hands-free speaker phone. An echo signal corresponding to the delayed transmitted signal is perceived as annoying to the near end user and, in some cases, can result in an unstable condition known as "howling."
Echo cancelers are required at any echo generating source at both the near end and at the far end in an attempt to eliminate or reduce the transmission of echo signals. Echo cancelers may be employed in wireless devices, such as personal data assistants (PDAs), cellular phones, two-way radios, car-kits for cellular telephones, car phones and other suitable devices that can move throughout a geographic area.
Additionally, echo cancelers may be employed in wireline devices, such as hands-free speaker phones, video and audio conference phones and telephones otherwise commonly referred to in the telecommunications industry as plain old telephone system (POTS) devices. Hands-free speaker phones typically include a microphone to produce the uplink signal, a speaker to acoustically produce the downlink signal, an echo canceler to cancel the echo signal and a telephone circuit.
Echo cancelers attempt to cancel the echo signals produced at the near end when the far end is transmitting by generating echo estimation data corresponding to a portion of an amplified downlink audio signal traveling through the acoustic coupling channel between the speaker and the microphone. The echo canceler models the acoustic coupling channel and in response generates the echo estimation data through the use of an echo canceler adaptive filter. The echo canceler adaptive filter employs modeling techniques using for example a Least Mean Squared (LMS) finite impulse response (FIR) filter having a set of weighting coefficients to model the acoustic coupling chamiel or other similar modeling techniques known in the art. The echo canceler adaptive filter attempts to subtract the echo estimation data from pre-echo canceler uplink data received by the microphone in order to produce post-echo canceler uplink data. The post-echo canceler uplink data is used by the echo canceler adaptive filter to dynamically update the weighting coefficients of the finite impulse response filter.
The hands-free speaker phone may be integrated into an in-vehicle audio system. The vehicle may be any suitable vehicle, such as an automobile, boat or airplane. The in-vehicle audio system may include an amplifier, speakers and an audio source, such as a tuner circuit, a CD/DVD player, a tape player, a hard drive playback system, a satellite radio, etc. The in-vehicle audio system may be integrated with a communication apparatus, such as a telematics communication module. For example, the telematics communication module may be a component of a General Motors' OnStar system. The telematics communication module typically collects and disseminates data, such as location information and audio, such as speech.
Typically, the downlink audio signal received from the far end through the downlink path is played through at least one speaker in the in-vehicle audio system.
However, the hands-free speaker phone installed in the vehicle may experience significant coupling between the at least one speaker and the microphone. As a result, an aanplified downlink audio signal transmitted through the at least one speaker will be partially received by the microphone as an echo signal.
CANCELER CIRCUIT
FIELD OF THE INVENTION
The invention relates generally to communication systems and more particularly to echo cancelers and echo cancellation methods.
BACKGROUND OF THE INVENTION
Echo in a communication system is commonly characterized as the return of a part of a transmitted signal from an end user back to the originator of the transmitted signal after a delay period. As is known in the art, a near end user transmits an uplink signal to a far end user. Conversely, the near end user receives a downlink signal from the far end user. For example, echo at the near end occurs when the near end user originates an uplink signal on an uplink path, and a part of the transmitted signal is reflected at the far end as an echo signal on a downlink path back to the near end.
Echo at the fax end occurs when the far end user originates a downlink signal on the downlink path, and a part of the transmitted signal is reflected at the near end as an echo signal on the uplink path back to the far end. The reflection of the transmitted signal may occur due to a number of reasons, such as an impedance mismatch in a four/two wire hybrid at the far end or feedback due to acoustic coupling in a telephone, wireless device or hands-free speaker phone. An echo signal corresponding to the delayed transmitted signal is perceived as annoying to the near end user and, in some cases, can result in an unstable condition known as "howling."
Echo cancelers are required at any echo generating source at both the near end and at the far end in an attempt to eliminate or reduce the transmission of echo signals. Echo cancelers may be employed in wireless devices, such as personal data assistants (PDAs), cellular phones, two-way radios, car-kits for cellular telephones, car phones and other suitable devices that can move throughout a geographic area.
Additionally, echo cancelers may be employed in wireline devices, such as hands-free speaker phones, video and audio conference phones and telephones otherwise commonly referred to in the telecommunications industry as plain old telephone system (POTS) devices. Hands-free speaker phones typically include a microphone to produce the uplink signal, a speaker to acoustically produce the downlink signal, an echo canceler to cancel the echo signal and a telephone circuit.
Echo cancelers attempt to cancel the echo signals produced at the near end when the far end is transmitting by generating echo estimation data corresponding to a portion of an amplified downlink audio signal traveling through the acoustic coupling channel between the speaker and the microphone. The echo canceler models the acoustic coupling channel and in response generates the echo estimation data through the use of an echo canceler adaptive filter. The echo canceler adaptive filter employs modeling techniques using for example a Least Mean Squared (LMS) finite impulse response (FIR) filter having a set of weighting coefficients to model the acoustic coupling chamiel or other similar modeling techniques known in the art. The echo canceler adaptive filter attempts to subtract the echo estimation data from pre-echo canceler uplink data received by the microphone in order to produce post-echo canceler uplink data. The post-echo canceler uplink data is used by the echo canceler adaptive filter to dynamically update the weighting coefficients of the finite impulse response filter.
The hands-free speaker phone may be integrated into an in-vehicle audio system. The vehicle may be any suitable vehicle, such as an automobile, boat or airplane. The in-vehicle audio system may include an amplifier, speakers and an audio source, such as a tuner circuit, a CD/DVD player, a tape player, a hard drive playback system, a satellite radio, etc. The in-vehicle audio system may be integrated with a communication apparatus, such as a telematics communication module. For example, the telematics communication module may be a component of a General Motors' OnStar system. The telematics communication module typically collects and disseminates data, such as location information and audio, such as speech.
Typically, the downlink audio signal received from the far end through the downlink path is played through at least one speaker in the in-vehicle audio system.
However, the hands-free speaker phone installed in the vehicle may experience significant coupling between the at least one speaker and the microphone. As a result, an aanplified downlink audio signal transmitted through the at least one speaker will be partially received by the microphone as an echo signal.
Echo cancelers operate in response to detecting four possible modes:
downlink talking, uplink talking, double talk and idle. During the downlink talking mode, the echo canceler adaptive filter attempts to model the acoustic coupling channel by dynamically adapting the weighting coefficients of the FIR filter.
Additionally, pre- processors and post-processors, such as attenuators, may also be used to reduce the effects of the echo signal.
During the idle mode, the near end user and the far end users are not talking and, therefore, the echo canceler adaptive filter is typically idle, since no downlink signal is present. However, during the double talk mode, the pre-echo canceler uplink microphone signal includes both interfering signals and the echo signal. The interfering signals include near end speech, various noise components, and distortion.
The various noise components include nonlinearities of the audio system, speaker distortion, air turbulence over the microphone, road noise, wind rumble, turn signal and windshield wiper noises. As a result, the echo canceler adaptive filter will attempt to remove the echo components based on previous weighting coefficient modeling and attempt to pass the desired transmit signal. If the FIR weighting coefficients are updated during the double talk mode, the weighting coefficients may diverge, resulting in an incorrect estimation of the acoustic coupling channel, which causes the echo canceler adaptive filter to become less effective.. The adaptive filter under this condition may effectively remove all the echo components and become unstable. As a result, the corrupted post-echo canceler uplink data may cause audio residual echo or even annoying loud noises at the far end.
According to one method, the echo canceler employ's a double talk detector to detect the double talk mode. In response to detecting the double talk mode, the echo canceler will freeze the coefficient updates but still allow the filter to operate in an attempt to remove echo based on previous modeling efforts.. However, these double talk detectors produce a binary output, based on a singular metric such as a pre-echo canceler uplink microphone energy level threshold or some form of a correlation threshold. As a result, these double talk detectors are not consistently accurate over the range of conditions encountered in noisy environments, such as an automobile environment. Further, these double talk detectors perform poorly in noisy environments because noise may cause the double talk detector to falsely indicate the presence of near end speech. As a result, residual echo may be heard at the far-end or the uplink data may be improperly attenuated.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention is illustrated, by way of example and not limitation, in the accompanying figures, in which like reference numerals indicate similar elements and in which:
FIG. 1 is a block diagram illustrating one example of an echo canceler circuit according to one embodiment of the invention;
FIG. 2 is a flowchart illustrating one example of a method for controlling an echo canceler in response to double talk activity probability data according to one embodiment of the invention;
FIG. 3 is a block diagram illustrating one example of a telematics communication module according to another embodiment of the invention;
FIG. 4 is a block diagram illustrating an example of a double talk activity detector according to one embodiment of the invention;
FIG. 5 is a flowchart illustrating one example of a method for controlling the echo canceler circuit in response to double talk activity probability data according to another embodiment of the invention;
FIG. 6 is a flowchart illustrating one example of a method for controlling the echo canceler circuit in response to double talk activity probability data according to yet another embodiment of the invention;
FIG. 7 is a block diagram illustrating an example of a communication system according to one exemplary embodiment of the invention; and FIG. 8 is a block diagram of an in-vehicle communication system according to one exemplary embodiment of the invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
A double talk activity detector and method for an echo canceler circuit improves the probability of detecting a double talk condition based on at least pre-echo canceler uplink data. The echo canceler circuit includes a double talk activity probability data generator and an echo canceler stage. The double talk activity probability data generator receives pre-echo canceler uplink data and in response produces double talk activity probability data. The echo canceler stage is coupled to the double talk activity probability data generator and receives downlink data, pre-echo canceler uplink data and the double talk activity probability data. The echo canceler stage produces attenuated uplink data in response to the pre-echo canceler uplink data and the double talk activity probability data.
Among other advantages, the present invention improves the accuracy of double talk detection even in harsh acoustic environments and further mitigates or eliminates the effects of double talk. Rather than producing a binary indication of a double talk mode based on a singular metric, the double talk activity probability data generator produces double talk activity probability data for establishing a confidence level with respect to the detection of a double talk condition based on multiple metrics. Additionally, the double talk activity probability data produces the double talk activity probability data. The double talk activity probability data generator provides a more accurate indication of a double talk condition than may be provided by a double talk detector that provides a binary indication of a double talk mode based on a singular metric. Additionally, the generation of the double tally activity probability data allows for independent adjustment or control of different components of the echo canceler circuit, such as for example an adaptive filter, a pre-processor and a post-processor which may require different degrees of confidence in the presence of double talk to make the appropriate control decisions.
Accordingly, the double talk activity probability data generator may be used to provide one or more mechanisms of control for the various elements of the echo canceler circuit with greater robustness than an echo canceler circuit depending on a singular binary decision. For example, the double talk activity probability data generator may variably control the rate of adaptation of the echo canceler adaptive filter in order to improve the stability of the echo canceler adaptive filter and to adapt to the double talk activity condition. Independently, the double talk activity probability data generator may control the pre or post processing elements of an echo canceller based on separate thresholds related to the degree of confidence in the presence of double talk. The double tally activity probability data generator allows for the control of multiple parameters within the echo canceler circuit based on multiple metrics, such as the detection of noise echo as a result of acoustic coupling between the speaker and microphone and the detection of near end speech.
FIG. 1 is a block diagram of an echo canceler circuit 10 including the echo canceler stage 20 and a double talk activity probability data generator 30.
The double talk activity probability data generator 30 receives pre-echo canceler uplink data 40 and in response produces double talk activity probability data 50. The echo canceler stage 20 is coupled to the double talk activity probability data generator 30.
The echo canceler stage 20 receives downlink data 60, the pre-echo canceler uplink data 40 and the double talk activity probability data 50, and in response produces at least attenuated uplink data 70.
The echo canceler circuit 10 may compensate for the effects of acoustic coupling between a microphone and a speaker or may compensate for reflections at a far end due to an impedance mismatch, such as a mismatch with a network hybrid circuit as is known in the art. Additionally, the echo canceler circuit 10 may be employed in an analog or digital modem in a telecommunications system as is known in the art. The various links shown in FIG. 1 may be any suitable mechanism for conveying electrical signals or data as appropriate.
The echo canceler circuit 10 may be one or more suitably programmed processors, such as a microprocessor, a microcontroller or a digital signal processor (DSP), and therefore includes associated memory that contains executable instructions that when executed causes the echo canceler's circuit 10 to carry out the operations described herein. In addition, the echo canceler circuit 10 as used her~in may include discrete logic, state machines or any other suitable combination of hardware, software, middleware and/or firmware.
FIG. 2 illustrates a method 200 for detecting double talk activity according to one embodiment of the invention. The method 200 may be carried out by the echo canceler circuit 10 with respect to FIG. 1. However, any other suitable structure may also be used. It will be recognized that method 200, beginning with step 210, will be described as a series of operations, but the operations may be performed in any suitable order and may be repeated in any suitable combination.
downlink talking, uplink talking, double talk and idle. During the downlink talking mode, the echo canceler adaptive filter attempts to model the acoustic coupling channel by dynamically adapting the weighting coefficients of the FIR filter.
Additionally, pre- processors and post-processors, such as attenuators, may also be used to reduce the effects of the echo signal.
During the idle mode, the near end user and the far end users are not talking and, therefore, the echo canceler adaptive filter is typically idle, since no downlink signal is present. However, during the double talk mode, the pre-echo canceler uplink microphone signal includes both interfering signals and the echo signal. The interfering signals include near end speech, various noise components, and distortion.
The various noise components include nonlinearities of the audio system, speaker distortion, air turbulence over the microphone, road noise, wind rumble, turn signal and windshield wiper noises. As a result, the echo canceler adaptive filter will attempt to remove the echo components based on previous weighting coefficient modeling and attempt to pass the desired transmit signal. If the FIR weighting coefficients are updated during the double talk mode, the weighting coefficients may diverge, resulting in an incorrect estimation of the acoustic coupling channel, which causes the echo canceler adaptive filter to become less effective.. The adaptive filter under this condition may effectively remove all the echo components and become unstable. As a result, the corrupted post-echo canceler uplink data may cause audio residual echo or even annoying loud noises at the far end.
According to one method, the echo canceler employ's a double talk detector to detect the double talk mode. In response to detecting the double talk mode, the echo canceler will freeze the coefficient updates but still allow the filter to operate in an attempt to remove echo based on previous modeling efforts.. However, these double talk detectors produce a binary output, based on a singular metric such as a pre-echo canceler uplink microphone energy level threshold or some form of a correlation threshold. As a result, these double talk detectors are not consistently accurate over the range of conditions encountered in noisy environments, such as an automobile environment. Further, these double talk detectors perform poorly in noisy environments because noise may cause the double talk detector to falsely indicate the presence of near end speech. As a result, residual echo may be heard at the far-end or the uplink data may be improperly attenuated.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention is illustrated, by way of example and not limitation, in the accompanying figures, in which like reference numerals indicate similar elements and in which:
FIG. 1 is a block diagram illustrating one example of an echo canceler circuit according to one embodiment of the invention;
FIG. 2 is a flowchart illustrating one example of a method for controlling an echo canceler in response to double talk activity probability data according to one embodiment of the invention;
FIG. 3 is a block diagram illustrating one example of a telematics communication module according to another embodiment of the invention;
FIG. 4 is a block diagram illustrating an example of a double talk activity detector according to one embodiment of the invention;
FIG. 5 is a flowchart illustrating one example of a method for controlling the echo canceler circuit in response to double talk activity probability data according to another embodiment of the invention;
FIG. 6 is a flowchart illustrating one example of a method for controlling the echo canceler circuit in response to double talk activity probability data according to yet another embodiment of the invention;
FIG. 7 is a block diagram illustrating an example of a communication system according to one exemplary embodiment of the invention; and FIG. 8 is a block diagram of an in-vehicle communication system according to one exemplary embodiment of the invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
A double talk activity detector and method for an echo canceler circuit improves the probability of detecting a double talk condition based on at least pre-echo canceler uplink data. The echo canceler circuit includes a double talk activity probability data generator and an echo canceler stage. The double talk activity probability data generator receives pre-echo canceler uplink data and in response produces double talk activity probability data. The echo canceler stage is coupled to the double talk activity probability data generator and receives downlink data, pre-echo canceler uplink data and the double talk activity probability data. The echo canceler stage produces attenuated uplink data in response to the pre-echo canceler uplink data and the double talk activity probability data.
Among other advantages, the present invention improves the accuracy of double talk detection even in harsh acoustic environments and further mitigates or eliminates the effects of double talk. Rather than producing a binary indication of a double talk mode based on a singular metric, the double talk activity probability data generator produces double talk activity probability data for establishing a confidence level with respect to the detection of a double talk condition based on multiple metrics. Additionally, the double talk activity probability data produces the double talk activity probability data. The double talk activity probability data generator provides a more accurate indication of a double talk condition than may be provided by a double talk detector that provides a binary indication of a double talk mode based on a singular metric. Additionally, the generation of the double tally activity probability data allows for independent adjustment or control of different components of the echo canceler circuit, such as for example an adaptive filter, a pre-processor and a post-processor which may require different degrees of confidence in the presence of double talk to make the appropriate control decisions.
Accordingly, the double talk activity probability data generator may be used to provide one or more mechanisms of control for the various elements of the echo canceler circuit with greater robustness than an echo canceler circuit depending on a singular binary decision. For example, the double talk activity probability data generator may variably control the rate of adaptation of the echo canceler adaptive filter in order to improve the stability of the echo canceler adaptive filter and to adapt to the double talk activity condition. Independently, the double talk activity probability data generator may control the pre or post processing elements of an echo canceller based on separate thresholds related to the degree of confidence in the presence of double talk. The double tally activity probability data generator allows for the control of multiple parameters within the echo canceler circuit based on multiple metrics, such as the detection of noise echo as a result of acoustic coupling between the speaker and microphone and the detection of near end speech.
FIG. 1 is a block diagram of an echo canceler circuit 10 including the echo canceler stage 20 and a double talk activity probability data generator 30.
The double talk activity probability data generator 30 receives pre-echo canceler uplink data 40 and in response produces double talk activity probability data 50. The echo canceler stage 20 is coupled to the double talk activity probability data generator 30.
The echo canceler stage 20 receives downlink data 60, the pre-echo canceler uplink data 40 and the double talk activity probability data 50, and in response produces at least attenuated uplink data 70.
The echo canceler circuit 10 may compensate for the effects of acoustic coupling between a microphone and a speaker or may compensate for reflections at a far end due to an impedance mismatch, such as a mismatch with a network hybrid circuit as is known in the art. Additionally, the echo canceler circuit 10 may be employed in an analog or digital modem in a telecommunications system as is known in the art. The various links shown in FIG. 1 may be any suitable mechanism for conveying electrical signals or data as appropriate.
The echo canceler circuit 10 may be one or more suitably programmed processors, such as a microprocessor, a microcontroller or a digital signal processor (DSP), and therefore includes associated memory that contains executable instructions that when executed causes the echo canceler's circuit 10 to carry out the operations described herein. In addition, the echo canceler circuit 10 as used her~in may include discrete logic, state machines or any other suitable combination of hardware, software, middleware and/or firmware.
FIG. 2 illustrates a method 200 for detecting double talk activity according to one embodiment of the invention. The method 200 may be carried out by the echo canceler circuit 10 with respect to FIG. 1. However, any other suitable structure may also be used. It will be recognized that method 200, beginning with step 210, will be described as a series of operations, but the operations may be performed in any suitable order and may be repeated in any suitable combination.
As shown in step 220, the double talk activity probability data generator 30 receives pre-echo canceler uplink data 40. The double talk activity probability data generator 30 may calculate the power level, energy level or amplitude level for the pre-echo canceler uplink data 40 in order to produce the double talk activity probability data 50. For example, the pre-echo canceler uplink data 40 may include one or more speech frames such that the double talk activity probability data generator 30 may calculate the power level, energy level or amplitude level of the pre-echo canceler uplink data 40 over a suitable period of time. For example, the double talk activity probability data generator 30 may calculate the power level, energy level or amplitude level over one or more speech frames based on an average or any other suitable function. According to one example, a speech frame may span a period of twenty milliseconds corresponding to 160 samples at 8,000 samples per second.
The speech frame may correspond to any suitable period of time and any suitable number of samples at any suitable sampling rate.
As shown in step 230, the echo canceler stage 20 receives the pre-echo canceler uplink data 40 and the double talk activity probability data 50 and in response produces the attenuated uplink data 70. The double talk activity probability data generator 30 may analyze the pre-echo canceler uplink data 40 and produce the double talk activity probability data 50 based on a probability density function that relates the detection of near end speech, background noise and far end speech resulting in a probability of double talk activity. According to one embodiment, the probability density function utilized in the double talk activity probability data generator 30 is optimized such that the double talk activity probability data generator is not overly sensitive to false indications of double talk activity due to for 25 example, the presence of background noise or acoustic echo. Additionally, the double talk activity probability data generator 30 is optimized such that the detection of near end speech is sufficiently sensitive and accurate such that appropriate action may be taken by, for example, controlling one or more parameters of the echo canceler stage 20 to prevent the divergence of an echo canceler adaptive filter.
30 FIG. 3 is a block diagram of a communication system 300 including a communication apparatus 310, an audio system 320, a microphone 330 and an antenna 340. The microphone 330 receives, fox example, an echo signal 342, near end speech 344 and background noise 346. The communication apparatus 310 includes the echo canceler circuit 10 and transceiver 350. The echo canceler circuit includes the echo canceler stage 20, the double talk activity probability data generator 30 and an analog-to-digital converter 360.
5 The echo canceler stage 20 includes pre-processor 370, post-processor 380, echo canceler adaptive filter 382, adder logic 384 and a digital-to-analog converter 386. According to one embodiment, the echo canceler adaptive filter 382 reduces a rate of echo cancellation adaptation in response to the double talk activity probability data 50. For example, the echo canceler adaptive filter 382 may slow coefficient 10 weighting adaptation when a high probability of double talk occurs or when the confidence that a double talk condition is low in order to reduce the likelihood that the background noise 346 or near end speech 344 causes instability in the echo canceler adaptive filter 382. Slowing coefficient weighting adaptation therefore reduces the likelihood of producing corrupted post-echo canceler uplink data 388.
Similarly, the double talk activity probability data 50 can be used to independently control other mechanisms in the echo canceller such as the pre-processor 370 and the post-processor 380. In this manner, greater system control and robustness is achieve through use of the double talk probability data 50 when compared to typical binary double talk metrics known in the art.
The pre-processor 370 receives downlink data 60 and the double talk activity probability data 50 and in response produces attenuated downlink data 72 in response to the downlink data 60. The echo canceler adaptive filter 382 receives attenuated downlink data 72 and post-echo canceler uplink data 388, and in response produces echo estimation data 386. Accordingly, the double talk activity probability data generator 30 accurately detects the presence of background noise 346 and near end speech 344 so that measures may be taken to avoid causing the echo canceler adaptive filter 382 to become unstable. The double talk activity probability data generator 30 distinguishes between the echo signal 342 caused by the acoustic coupling channel 398, near end speech 344, and background noise 346. Accordingly, the double talk activity probability generator 30 avoids misinterpreting the background noise 346 or the near end speech 344 as the echo signal 342 so that the echo canceler adaptive filter 382 does not become unstable. The double talk activity probability data generator 30 accurately detects and distinguishes between the presence of background noise 346, near end speech 346 and the echo signal 342 in order to accurately attenuate the pre-echo canceler uplink data 40 so that corrupted post-echo canceler uplink data 388 is not noticed by the far end user.
According to one embodiment, coefficient weighting adaptation in the echo canceler adaptive filter 382 may be slowed down if there is a high probability of double talk in order to avoid divergence. For example, there may be little harm in slowing coefficient weighting adaptation unnecessarily; however, performing coefficient weighting adaptation in the presence of double talk or excessive background noise 346 may cause instability and the generation of corrupted post-echo canceler uplink data 388. Since the double talk activity probability data generator 30 seeks to avoid the transmission of corrupted attenuated uplink data 70, falsely attenuating the post-echo canceler uplink data 388 is preferred to potentially allowing corrupted attenuated uplink data 70 from being transmitted that will be noticed by the far end user.
The adder logic 384 receives the pre-echo canceler uplink data 40 and echo estimation data 386 and in response produces post-echo canceler uplink data 388.
The post-processor 380 is operative to receive the post-echo canceler uplink data 388 and the double talk activity probability data 50 and in response attenuates the post-echo canceler uplink data 388 to produce the attenuated uplink data 70.
According to one embodiment, the post-processor 380 includes an uplink data attenuator 390 and the pre-processor 370 includes downlink a data attenuator 392. The uplink data attenuator 390 attenuates the post-echo canceler uplink data 388 to produce the attenuated uplink data 70 in response to the double talk activity probability data 50.
Accordingly, if the double talk activity probability data generator 30 determines that a double talk condition exists, and if the probability of a double talk condition exceeds a predetermined level, then the uplink data attenuator 390 may adjust the attenuation of the post-echo canceler uplink data 388 as compared to the situation where downlink data is detected but there is a low probability of double talk.. The uplink data attenuator 390 reduces the amplitude of the corrupted post-echo canceler uplink data 388 prior to transmission as attenuated uplink data 70 such that residual echo or possibly corrupted post-echo canceler uplink data 388 is not noticed by the far end user. However, different attenuation strategies may be employed depending on the double talk probability data 50 to ensure no or a reduced level of residual echo is heard at the far end while still allowing desired near end speech to transmit relatively unaffected.
The digital-to-analog converter 386 is coupled to the downlink data attenuator 392. The digital-to-analog converter 386 receives the attenuated downlink data and in response produces a downlink audio signal 394. Audio system 320 includes playback system 322, an amplifier 324 and at least one speaker 326. The playback system 322 includes a tuner circuit 332, a tape player 334, a CD/DVD player 336 and a hard drive 338. The amplifier 324 is coupled to the digital-to-analog converter 386 and receives the downlink audio signal 394 and in response produces an amplified downlink audio signal 396. The microphone 330 is operative to receive at least a portion of the amplified downlink audio signal 396 acoustically produced by the at least one speaker 326 via the acoustic coupling channel 398. In response to the amplified downlink audio signal 396, the microphone 330 produces a pre-echo canceler uplink signal 399. The analog-to-digital converter 360 is coupled to the microphone 330, the adder logic 384 and the double talk activity probability data generator 30. The analog-to-digital converter 360 receives the pre-echo canceler uplink signal 399 and in response produces the pre-echo canceler uplink data 40.
FIG. 4 is a block diagram of the double talk activity probability data generator in accordance with one embodiment of the invention. The double talk activity probability data generator 30 includes a center power clipped data generator 440, a center to composite power ratio data generator 450, a distortion data generator 460 and double talk soft decision logic 470. The center power clipped data generator 440 25 receives the pre-echo canceler uplink data 40 and in response produces center power clipped data 472.
The amplified downlink audio signal 396 that is transmitted through the speaker 326 may have a portion of its frequency spectrum altered in a non-perceptual manner so that the portion of the amplified downlink audio signal 396 that is detected 30 by the microphone 330 and processed by the double talk activity probability data generator 30 as pre-echo canceler uplink data 40 may be identified as near-end speech 344 as opposed to the echo signal 342 or background noise 346. In one such embodiment, a notch filter may remove a portion of the spectrum in the amplified downlink audio signal 396 so that, if the pre-echo canceler uplink data 40 received by the double talk activity probability data generator 30 appears to have the corresponding portion of the spectral band removed, then the double talk activity probability data generator 30 will be able to determine that the received pre-echo canceler uplink data 40 is likely due to the amplified downlink audio signal 396 rather than near end speech 394. As a result, the double talk activity probability data generator 30 may determine that there is a low probability of the occurrence of a double talk condition. Conversely, if the double talk activity probability data generator 30 determines that the pre-echo canceler uplink data 40 includes energy in the spectral band defined by the notch filter, then the double talk activity probability data generator 30 may determine that the pre-echo canceler uplink data 40 is likely receiving near-end speech 344 and therefore a double talk condition exists with a higher degree of probability. Accordingly, the center power clipped data generator 440 may analyze the energy content of the spectral band defined by the notch filter and compare the energy level with a threshold level. If the energy level in the spectrum defined by the spectral band is above an absolute energy level, then the probability of the presence of a double talk condition will be increased.
The center to composite power ratio data generator 450 receives the pre-echo canceler uplink data 40 and in response produces center to composite power ratio data 474. The distortion data generator 460 receives the pre-echo canceler uplink data 40 and in response produces distortion data 476. The double talk soft decision logic 470 is coupled to the center power clipped data generator 440, a center to composite power ratio data generator 450 and the distortion data generator 460. The double talk soft decision logic 470 receives the center power clipped data 472, the center to composite power ratio data 474 and the distortion data 476 and in response produces the double talk activity probability data 50.
The center power clipped data generator 440 includes a center band pass filter 480, pre-clipping power estimate logic 482, center clipper logic 484 and post-clipping power estimate logic 486. The center band pass filter 480 receives the pre-echo canceler uplink data 40 and in response produces the center band pass data 488. The center clipper logic 484 receives the center band pass data 488 and in response produces center clipped band pass data 462. The pre-clipping power estimate logic 482 receives the center band pass data 488 and in response produces center power clipped data 489. The post-clipping power estimate logic 486 receives the center clipped band pass data 462 and in response produces the center power clipped data 472.
The center to composite power ratio data generator 450 includes a lower band pass filter 489, an upper band pass filter 490, adder logic 491, composite power estimate logic 492 and a center to composite power ratio data generator 493.
The lower band pass filter 489 receives the pre-echo canceler uplink data 40 and in response produces the lower band data 494. The upper band pass filter 490 receives the pre-echo canceler uplink data 40 and in response produces the upper band data 495. The adder logic 491 receives the lower band data 494 and the upper band data 495 and in response produces composite band data 496. For example, the composite band data 496 represents the upper and lower side band energy level outside of the bandwidth defined by the center band pass filter 480 in order to provide a baseline reference for comparing the energy level within the center of the bandwidth defined by the center band pass filter 480.
The composite to power estimate logic 492 is operative to receive the composite band data 496 and in response produces composite power data 497. The center to composite power ratio data generator 493 receives the composite power data 497 and the center power pre-clipped data 489 and in response produces the center to composite power ratio data 474.
FIG. 5 illustrates a method 500 for controlling the echo canceler circuit 10 in response to the double talk activity probability data 50 according to another embodiment of the invention. The method 500 may be carried out by the echo canceler 10. However, any other suitable structure may also be used. It will be recognized that the method 500 beginning with step 510 will be described as a series of operations, but the operations may be performed in any suitable order and may be repeated in any suitable combination. Furthermore, although method 500 ends with step 590, method 500 may loop back to step 510 or to any other suitable step.
As shown in step 520, the double talk activity probability data generator 30 receives the pre-echo canceler uplink data 40. As shown in step 530, the center power clipped data generator 440 generates center power clipped data 472 in response to the pre-echo canceler uplink data 40.
As shown in step 540, the center to composite power ratio data generator 450 generates center to composite power ratio data 474 in response to the pre-echo canceler uplink data 40. For example, the, center to composite power ratio data generator 450 compares the energy within the spectral band defined by the center band pass filter 480 with the energy on both the upper and lower side bands of the spectral bandwidth defined by the center band pass filter 480. Accordingly, a relative measurement is made between the center bandwidth defined by the bandwidth of the center band pass filter 480 and the upper and the lower side bands of the bandwidth defined by the center band pass filter 480. The relative measurement may provide a measurement of the relative amount of energy between the bandwidth of the center band pass filter 480 and the upper and lower side bands. According to this embodiment, the upper and lower side bands form the composite measurement in order to compare the energy level in the center of the spectrum as defined by the bandwidth of the center band pass filter 480.
As shown in step 550, the distortion data generator 460 generates distortion data 476 in response to the pre-echo canceler uplink data 40. For example, if the received pre-echo canceler uplink data 40 is distorted, the distortion may add noise to the spectrum of the bandwidth defined by the center band pass filter 480, thereby affecting the ability of detecting relevant information in the notch in the spectral bandwidth of the pre-echo canceler uplink data 40. Accordingly, if the distortion data generator 460 determines that the pre-echo canceler uplink data 40 is distorted, then the double talk activity probability data generator 30 may then compensate for the possibility that the spectral energy within the bandwidth defined by the center band pass filter 480 may have been filled or otherwise altered.
As shown in step 560, the double talk soft decision logic 470 generates double talk activity probability data 50 in response to the clipped center power data 472, the center to composite power ratio data 474 and the distortion data 476.
Accordingly, the double talk soft decision logic 470 generates double talk activity probability data 50 based on a combination of the absolute power measurement of the in-band signal energy, the relative difference between the in-band and side band energy level measurements, and the detection of distortion.
As shown in step 570, the double talk soft decision logic 470 provides the double talk activity probability data 50 to the echo canceler adaptive filter 382 to adjust the adaptive filter weighting coefficients in response to the double talk activity probability data 50. As previously described, the echo canceler adaptive filter 382 may also reduce the rate of adaptation of the weighting coefficients in order to avoid the divergence of the weighting coefficients and therefore reduce the probability that the echo canceler adaptive filter 382 becomes less effective or possibly unstable.
As shown in step 580, the double talk activity probability data generator 30 provides the double talk activity probability data 50 to the pre-processor 370 to process the downlink data 60. Additionally, the post-processor 380 may process the post-echo canceler uplink data 388 in response to the double talk activity probability data 50. As previously described, the pre-processor 370 and the post-processor may attenuate the downlink data 60 and the post-echo canceler uplink data 388.
However, any other type of suitable processing may be employed such as filtering, clipping, spectral or temporal masking, or any other device or technique.
FIG. 6 is a flowchart illustrating one example of a method 600 for controlling the echo canceler circuit in response to the double talk activity probability data 50 according to yet another embodiment of the invention. The method 600 may be carried out by the echo canceler 10. However, any other suitable structure may also be used. It will be recognized that the method 600 beginning with step 610 will be described as a series of operations, but the operations may be performed in any suitable order and may be repeated in any suitable combination. For example, although the method 600 ends with step 670, the method 600 may be xepeated by returning to the start at step 610 or at any suitable step and in any combination.
As shown in step 611, the double talk activity probability data generator 30 receives the pre-echo canceler uplink data 40. This step is similar to step 520 in FIG. 5 and step 220 in FIG. 2 as previously described.
As shown in step 612, the center band pass filter 480 generates center band pass data 488 in response to the pre-echo canceler uplink data 40. As shown in step 614, the center clipper logic 484 generates the center clipped band pass data 462 in response to the center band pass data 488. As shown in step 616, the post-clipping power estimate logic 486 generates center power clipped data 472 in response to the center clipped band pass data 462.
As shown in step 620, the lower band pass filter 489 generates lower band data 494 in response to the pre-echo canceler uplink data 40. As shown in step 622, the upper band pass filter 490 generates upper band data 495 in response to the pre-echo canceler uplink data 40. As shown in step 624, the adder logic 491 combines the lower band data 494 and the upper band data 495 to produce composite band data 496. The composite power estimate logic 492 in step 624 produces the composite power data 497 in response to the composite band data 496. As shown in step 626, the center to composite power ratio data generator 493 generates center to composite power ratio data 474 in response to the center power clipped data 489 and the composite power data 497. As shown in step 618, the distortion data generator generates distortion data 476 in response to the pre-echo canceler uplink data 40.
As shown in step 640, the double talk soft decision logic 470 generates the double talk activity probability data 50 in response to the clipped center power data 472, the center to composite power ratio data 474 and the distortion data 476.
As shown in step 650, the double talk activity probability data generator 30 provides the double talk activity probability data SO to the echo canceler adaptive filter 382 to adjust the rate of adaptation, the weighting coefficients, or any other suitable echo canceler filter adaptation parameter. According to one embodiment, the double talk activity probability data generator 30 provides the double talk activity probability data 50 to downlink data attenuator 392 to attenuate the downlink data 60 and in response to produce the attenuated downlink data 72. As shown in step 660, the uplink data attenuator 390 receives the post-echo canceler uplink data 388 and the double talk activity probability data 50 and in response produces the attenuated uplink data 70 in .
FIG. 7 is a block diagram of a communication system 700 according to one exemplary embodiment of the invention. The communication system 700 includes the communication apparatus 310, the audio system 320, the speaker 326, the microphone 330, a wireless wide area network (WWAN) transceiver 710, WWAN
antennas 720, 730, 750, 753, a wireless devices 740, 742, wireless interface 744, and wireless local area network (WLAN) antennas 760, 770.
The communication apparatus 310 further includes a processor 772, a WWAN
transceiver 780, a WLAN transceiver 790 and a location information generator 792, such as a global positioning system (GPS) receiver. The processor 772 receives location information 793 from the location information generator 792 and in response relays the location information 793 to the WWAN transceiver 710, 780 or to the wireless devices 740, 742.
The processor 772 includes the echo canceler circuit 10. The echo canceler circuit 10 may be coupled to one or more of the WWAN transceiver 710, the wireless wide area network transceiver 780, the wireless device interface 744 or the WLAN transceiver 790. For example, the WWAN transceivers 780, 710 may represent any one of a number of wireless devices, such as, for example, an in-vehicle mobile phone, a portable cellular phone, a wireless personal digital assistant, a wireless fidelity device (WiFi-i.e., a device based on the IEEE 802.11 specification) or any suitable communication device. According to one embodiment, the WWAN
transceiver 710 may be external to the communication apparatus 310, and therefore the echo canceler circuit 10 may be coupled to the wireless wide area network transceiver 710 via an appropriate link, such as a wired cable as is known in the art.
According to another embodiment, the WWAN transceiver 790 may be integrated into the communication apparatus 310.
The WLAN transceiver 790 may be a Bluetooth-compliant device or a wireless fidelity device (WiFi-i.e., a device based on the IEEE 802.11 specification) or any suitable communication device. For example, the WWAN transceiver 790 may interface with the wireless device 740 via a local area network interface 794, the WLAN antenna 760, and the wireless local area network antenna 770. The wireless devices 740 may be a cellular phone, a personal digital assistant equipped with a wireless interface, or a portable computer also equipped with a WWAN
interface.
The wireless devices 740, 742 and WWAN transceivers 710, 780, 790 may communicate with a WWAN, such as a cellular telephone system suitable for communicating with a public switching telephone network (PSTN). Accordingly, the wireless devices 740, 742 may communicate with a cellular telephone system using any wireless communication protocol, such as, for example, code division multiple access (CDMA), time division multiple access (TDMA), advanced mobile phone standard (AMPS) or group special mobile (GSM), or any suitable currently implemented or future protocols, such as the third generation (3G) and higher wireless communication protocols.
The communication apparatus 310 according to one embodiment includes a housing containing the processor 772, the WWAN transceiver 780, the WLAN
transceiver WLAN 790 and the location information generator 792. Additional or fewer components may be included in the communication apparatus 310 other than those described above. As is known in the art, the processor 772, the WWAN
transceiver 780, the WLAN 790 and the location information generator 792 may each be manufactured as separate circuit boards or integrated circuit chips from one or more manufacturers. The circuit boards may be interconnected as required through the use of a mother board, a flat or non-flat flexible mufti-conductor cable, a multi-conductor wired cable or any suitable type of interconnection device. Each circuit board may be attached or coupled either directly or indirectly to the housing or to other circuit boards via a suitable fastening device as is known in the art, such as a connector, a clamp, a clip, a screw, a nut and a bolt. The integrated circuit chips may be interconnected as required via a circuit board, a mufti-circuit chip carrier, a flat flexible multiconductor cable, a multiconductor wired cable or any suitable type of interconnection device. The circuit boards and integrated circuit chips may be mounted using chemical bonding such as an adhesive or any suitable fastening device.
According to one embodiment, the communication apparatus 310 housing may include: a circuit board comprising the processor 772 and memory 320, a circuit board comprising the WWAN transceiver 780, and a circuit board comprising the WLAN
transceiver 790. The circuit boards may be interconnected and attached or coupled to the housing either directly or indirectly as previously discussed.
Additionally, the communication apparatus 310 housing may include connectors for coupling to external components such as the audio system 320, the microphone, 330, WWAN
antenna 730, WLAN antenna 770, WWAN transceiver 710 or any other suitable device. For example, the communication apparatus 310 may interface with other suitable components not described herein. The connectors may be any suitable device for interconnecting the communication apparatus 310 to any external components such as via a wired cable, a fiber optic link, or a radio frequency interface.
According to one embodiment, the communication apparatus 310 is a telematics communication module supporting the collection and dissemination of data, including audio speech. For example, the telematics communication module may be based on General Motors' OnStar System, which automatically calls for emergency assistance if the vehicle is in an accident. According to another embodiment, the communication apparatus 310 also can perform such functions as remote engine diagnostics, tracking stolen vehicles and providing roadside assistance, as well as other functions.
FIG. 8 is a block diagram of an in-vehicle communication system 800 according to at least one embodiment of the invention. The in-vehicle communication system 800 includes the communication apparatus 310 coupled to the wireless device 740 via the wireless local area network antenna 770. For example, the WLAN
transceiver 790 between the wireless device 740 and the communication apparatus 310 may be a Bluetooth interface or a hard wire connection via a wireless device cradle as previously discussed. For example, the communication apparatus 310 may interface with the wireless device 742 via the wireless device interface 612 such as a wireless device cradle.
According to one embodiment as shown in FIG. 8, the in-vehicle communication system 800 may include the wireless local area network transceiver 790 or, alternatively, it may include the wireless wide area network transceiver 780 that is integrated into the communications apparatus 310 as shown previously with respect to FIG. 7. Alternatively, the communication apparatus 310 may interface with the wireless wide area network transceiver 710 externally to the communication apparatus 310 and may be mounted in any suitable location within the vehicle.
The communication apparatus 310 may also interface with the audio system 320 as previously described. Accordingly, although the audio system 320 and the communication apparatus 310 are shown in the trunk area of the vehicle, the communication apparatus 310 and/or the audio system 310 may be located in any suitable location, including on top of, under or in front of the dashboard.
According to one embodiment, the vehicle's audio system 320 may include the communication apparatus 310 and any suitable transceiver, such as the wireless wide area network transceiver 780 and the wireless local area network transceiver 790.
Among other advantages, the present invention improves the accuracy of double talk detection even in harsh acoustic environments and also mitigates or eliminates the effects of double talk. Rather than producing a binary indication of a double talk mode based on a singular metric, the double talk activity probability data generator 30 produces double talk activity probability data 50 for establishing a confidence level with respect to the detection of a double talk condition based on multiple metrics. The double talk activity probability data generator 30 provides more robust echo canceller system control, in contrast to the limited control provided by a double talk detector that provides a binary indication of a double talk mode based on a singular metric. The generation of double talk activity probability data 50 allows for independent adjustment or control of different components of the echo canceler circuit 10, such as for example the echo canceler adaptive filter 382, the pre-processor 370 and the post-processor 380. Accordingly, the double talk activity probability data generator 30 may be used to provide one or more mechanisms of control for the various elements of the echo canceler circuit. For example, the double talk activity probability data generator 30 may variably control the rate of adaptation of the echo canceler adaptive filter 382 in order to improve the stability of the echo canceler adaptive filter 382 and to adjust to the double talk activity condition. The double talk activity probability data generator 30 allows for the control of multiple parameters within the echo canceler circuit 10 based on multiple metrics, such as the detection of noise echo as a result of acoustic coupling between the speaker 326 and the microphone330 and the detection of near end speech 344.
It is understood that the implementation of other variations and modifications of the invention and its various aspects will be apparent to those of ordinary skill in the art and that the invention is not limited by the specific embodiments described. It is therefore contemplated to cover the present modifications, variations or equivalents that fall within the broad scope of the basic underlying principles disclosed and claimed herein.
The speech frame may correspond to any suitable period of time and any suitable number of samples at any suitable sampling rate.
As shown in step 230, the echo canceler stage 20 receives the pre-echo canceler uplink data 40 and the double talk activity probability data 50 and in response produces the attenuated uplink data 70. The double talk activity probability data generator 30 may analyze the pre-echo canceler uplink data 40 and produce the double talk activity probability data 50 based on a probability density function that relates the detection of near end speech, background noise and far end speech resulting in a probability of double talk activity. According to one embodiment, the probability density function utilized in the double talk activity probability data generator 30 is optimized such that the double talk activity probability data generator is not overly sensitive to false indications of double talk activity due to for 25 example, the presence of background noise or acoustic echo. Additionally, the double talk activity probability data generator 30 is optimized such that the detection of near end speech is sufficiently sensitive and accurate such that appropriate action may be taken by, for example, controlling one or more parameters of the echo canceler stage 20 to prevent the divergence of an echo canceler adaptive filter.
30 FIG. 3 is a block diagram of a communication system 300 including a communication apparatus 310, an audio system 320, a microphone 330 and an antenna 340. The microphone 330 receives, fox example, an echo signal 342, near end speech 344 and background noise 346. The communication apparatus 310 includes the echo canceler circuit 10 and transceiver 350. The echo canceler circuit includes the echo canceler stage 20, the double talk activity probability data generator 30 and an analog-to-digital converter 360.
5 The echo canceler stage 20 includes pre-processor 370, post-processor 380, echo canceler adaptive filter 382, adder logic 384 and a digital-to-analog converter 386. According to one embodiment, the echo canceler adaptive filter 382 reduces a rate of echo cancellation adaptation in response to the double talk activity probability data 50. For example, the echo canceler adaptive filter 382 may slow coefficient 10 weighting adaptation when a high probability of double talk occurs or when the confidence that a double talk condition is low in order to reduce the likelihood that the background noise 346 or near end speech 344 causes instability in the echo canceler adaptive filter 382. Slowing coefficient weighting adaptation therefore reduces the likelihood of producing corrupted post-echo canceler uplink data 388.
Similarly, the double talk activity probability data 50 can be used to independently control other mechanisms in the echo canceller such as the pre-processor 370 and the post-processor 380. In this manner, greater system control and robustness is achieve through use of the double talk probability data 50 when compared to typical binary double talk metrics known in the art.
The pre-processor 370 receives downlink data 60 and the double talk activity probability data 50 and in response produces attenuated downlink data 72 in response to the downlink data 60. The echo canceler adaptive filter 382 receives attenuated downlink data 72 and post-echo canceler uplink data 388, and in response produces echo estimation data 386. Accordingly, the double talk activity probability data generator 30 accurately detects the presence of background noise 346 and near end speech 344 so that measures may be taken to avoid causing the echo canceler adaptive filter 382 to become unstable. The double talk activity probability data generator 30 distinguishes between the echo signal 342 caused by the acoustic coupling channel 398, near end speech 344, and background noise 346. Accordingly, the double talk activity probability generator 30 avoids misinterpreting the background noise 346 or the near end speech 344 as the echo signal 342 so that the echo canceler adaptive filter 382 does not become unstable. The double talk activity probability data generator 30 accurately detects and distinguishes between the presence of background noise 346, near end speech 346 and the echo signal 342 in order to accurately attenuate the pre-echo canceler uplink data 40 so that corrupted post-echo canceler uplink data 388 is not noticed by the far end user.
According to one embodiment, coefficient weighting adaptation in the echo canceler adaptive filter 382 may be slowed down if there is a high probability of double talk in order to avoid divergence. For example, there may be little harm in slowing coefficient weighting adaptation unnecessarily; however, performing coefficient weighting adaptation in the presence of double talk or excessive background noise 346 may cause instability and the generation of corrupted post-echo canceler uplink data 388. Since the double talk activity probability data generator 30 seeks to avoid the transmission of corrupted attenuated uplink data 70, falsely attenuating the post-echo canceler uplink data 388 is preferred to potentially allowing corrupted attenuated uplink data 70 from being transmitted that will be noticed by the far end user.
The adder logic 384 receives the pre-echo canceler uplink data 40 and echo estimation data 386 and in response produces post-echo canceler uplink data 388.
The post-processor 380 is operative to receive the post-echo canceler uplink data 388 and the double talk activity probability data 50 and in response attenuates the post-echo canceler uplink data 388 to produce the attenuated uplink data 70.
According to one embodiment, the post-processor 380 includes an uplink data attenuator 390 and the pre-processor 370 includes downlink a data attenuator 392. The uplink data attenuator 390 attenuates the post-echo canceler uplink data 388 to produce the attenuated uplink data 70 in response to the double talk activity probability data 50.
Accordingly, if the double talk activity probability data generator 30 determines that a double talk condition exists, and if the probability of a double talk condition exceeds a predetermined level, then the uplink data attenuator 390 may adjust the attenuation of the post-echo canceler uplink data 388 as compared to the situation where downlink data is detected but there is a low probability of double talk.. The uplink data attenuator 390 reduces the amplitude of the corrupted post-echo canceler uplink data 388 prior to transmission as attenuated uplink data 70 such that residual echo or possibly corrupted post-echo canceler uplink data 388 is not noticed by the far end user. However, different attenuation strategies may be employed depending on the double talk probability data 50 to ensure no or a reduced level of residual echo is heard at the far end while still allowing desired near end speech to transmit relatively unaffected.
The digital-to-analog converter 386 is coupled to the downlink data attenuator 392. The digital-to-analog converter 386 receives the attenuated downlink data and in response produces a downlink audio signal 394. Audio system 320 includes playback system 322, an amplifier 324 and at least one speaker 326. The playback system 322 includes a tuner circuit 332, a tape player 334, a CD/DVD player 336 and a hard drive 338. The amplifier 324 is coupled to the digital-to-analog converter 386 and receives the downlink audio signal 394 and in response produces an amplified downlink audio signal 396. The microphone 330 is operative to receive at least a portion of the amplified downlink audio signal 396 acoustically produced by the at least one speaker 326 via the acoustic coupling channel 398. In response to the amplified downlink audio signal 396, the microphone 330 produces a pre-echo canceler uplink signal 399. The analog-to-digital converter 360 is coupled to the microphone 330, the adder logic 384 and the double talk activity probability data generator 30. The analog-to-digital converter 360 receives the pre-echo canceler uplink signal 399 and in response produces the pre-echo canceler uplink data 40.
FIG. 4 is a block diagram of the double talk activity probability data generator in accordance with one embodiment of the invention. The double talk activity probability data generator 30 includes a center power clipped data generator 440, a center to composite power ratio data generator 450, a distortion data generator 460 and double talk soft decision logic 470. The center power clipped data generator 440 25 receives the pre-echo canceler uplink data 40 and in response produces center power clipped data 472.
The amplified downlink audio signal 396 that is transmitted through the speaker 326 may have a portion of its frequency spectrum altered in a non-perceptual manner so that the portion of the amplified downlink audio signal 396 that is detected 30 by the microphone 330 and processed by the double talk activity probability data generator 30 as pre-echo canceler uplink data 40 may be identified as near-end speech 344 as opposed to the echo signal 342 or background noise 346. In one such embodiment, a notch filter may remove a portion of the spectrum in the amplified downlink audio signal 396 so that, if the pre-echo canceler uplink data 40 received by the double talk activity probability data generator 30 appears to have the corresponding portion of the spectral band removed, then the double talk activity probability data generator 30 will be able to determine that the received pre-echo canceler uplink data 40 is likely due to the amplified downlink audio signal 396 rather than near end speech 394. As a result, the double talk activity probability data generator 30 may determine that there is a low probability of the occurrence of a double talk condition. Conversely, if the double talk activity probability data generator 30 determines that the pre-echo canceler uplink data 40 includes energy in the spectral band defined by the notch filter, then the double talk activity probability data generator 30 may determine that the pre-echo canceler uplink data 40 is likely receiving near-end speech 344 and therefore a double talk condition exists with a higher degree of probability. Accordingly, the center power clipped data generator 440 may analyze the energy content of the spectral band defined by the notch filter and compare the energy level with a threshold level. If the energy level in the spectrum defined by the spectral band is above an absolute energy level, then the probability of the presence of a double talk condition will be increased.
The center to composite power ratio data generator 450 receives the pre-echo canceler uplink data 40 and in response produces center to composite power ratio data 474. The distortion data generator 460 receives the pre-echo canceler uplink data 40 and in response produces distortion data 476. The double talk soft decision logic 470 is coupled to the center power clipped data generator 440, a center to composite power ratio data generator 450 and the distortion data generator 460. The double talk soft decision logic 470 receives the center power clipped data 472, the center to composite power ratio data 474 and the distortion data 476 and in response produces the double talk activity probability data 50.
The center power clipped data generator 440 includes a center band pass filter 480, pre-clipping power estimate logic 482, center clipper logic 484 and post-clipping power estimate logic 486. The center band pass filter 480 receives the pre-echo canceler uplink data 40 and in response produces the center band pass data 488. The center clipper logic 484 receives the center band pass data 488 and in response produces center clipped band pass data 462. The pre-clipping power estimate logic 482 receives the center band pass data 488 and in response produces center power clipped data 489. The post-clipping power estimate logic 486 receives the center clipped band pass data 462 and in response produces the center power clipped data 472.
The center to composite power ratio data generator 450 includes a lower band pass filter 489, an upper band pass filter 490, adder logic 491, composite power estimate logic 492 and a center to composite power ratio data generator 493.
The lower band pass filter 489 receives the pre-echo canceler uplink data 40 and in response produces the lower band data 494. The upper band pass filter 490 receives the pre-echo canceler uplink data 40 and in response produces the upper band data 495. The adder logic 491 receives the lower band data 494 and the upper band data 495 and in response produces composite band data 496. For example, the composite band data 496 represents the upper and lower side band energy level outside of the bandwidth defined by the center band pass filter 480 in order to provide a baseline reference for comparing the energy level within the center of the bandwidth defined by the center band pass filter 480.
The composite to power estimate logic 492 is operative to receive the composite band data 496 and in response produces composite power data 497. The center to composite power ratio data generator 493 receives the composite power data 497 and the center power pre-clipped data 489 and in response produces the center to composite power ratio data 474.
FIG. 5 illustrates a method 500 for controlling the echo canceler circuit 10 in response to the double talk activity probability data 50 according to another embodiment of the invention. The method 500 may be carried out by the echo canceler 10. However, any other suitable structure may also be used. It will be recognized that the method 500 beginning with step 510 will be described as a series of operations, but the operations may be performed in any suitable order and may be repeated in any suitable combination. Furthermore, although method 500 ends with step 590, method 500 may loop back to step 510 or to any other suitable step.
As shown in step 520, the double talk activity probability data generator 30 receives the pre-echo canceler uplink data 40. As shown in step 530, the center power clipped data generator 440 generates center power clipped data 472 in response to the pre-echo canceler uplink data 40.
As shown in step 540, the center to composite power ratio data generator 450 generates center to composite power ratio data 474 in response to the pre-echo canceler uplink data 40. For example, the, center to composite power ratio data generator 450 compares the energy within the spectral band defined by the center band pass filter 480 with the energy on both the upper and lower side bands of the spectral bandwidth defined by the center band pass filter 480. Accordingly, a relative measurement is made between the center bandwidth defined by the bandwidth of the center band pass filter 480 and the upper and the lower side bands of the bandwidth defined by the center band pass filter 480. The relative measurement may provide a measurement of the relative amount of energy between the bandwidth of the center band pass filter 480 and the upper and lower side bands. According to this embodiment, the upper and lower side bands form the composite measurement in order to compare the energy level in the center of the spectrum as defined by the bandwidth of the center band pass filter 480.
As shown in step 550, the distortion data generator 460 generates distortion data 476 in response to the pre-echo canceler uplink data 40. For example, if the received pre-echo canceler uplink data 40 is distorted, the distortion may add noise to the spectrum of the bandwidth defined by the center band pass filter 480, thereby affecting the ability of detecting relevant information in the notch in the spectral bandwidth of the pre-echo canceler uplink data 40. Accordingly, if the distortion data generator 460 determines that the pre-echo canceler uplink data 40 is distorted, then the double talk activity probability data generator 30 may then compensate for the possibility that the spectral energy within the bandwidth defined by the center band pass filter 480 may have been filled or otherwise altered.
As shown in step 560, the double talk soft decision logic 470 generates double talk activity probability data 50 in response to the clipped center power data 472, the center to composite power ratio data 474 and the distortion data 476.
Accordingly, the double talk soft decision logic 470 generates double talk activity probability data 50 based on a combination of the absolute power measurement of the in-band signal energy, the relative difference between the in-band and side band energy level measurements, and the detection of distortion.
As shown in step 570, the double talk soft decision logic 470 provides the double talk activity probability data 50 to the echo canceler adaptive filter 382 to adjust the adaptive filter weighting coefficients in response to the double talk activity probability data 50. As previously described, the echo canceler adaptive filter 382 may also reduce the rate of adaptation of the weighting coefficients in order to avoid the divergence of the weighting coefficients and therefore reduce the probability that the echo canceler adaptive filter 382 becomes less effective or possibly unstable.
As shown in step 580, the double talk activity probability data generator 30 provides the double talk activity probability data 50 to the pre-processor 370 to process the downlink data 60. Additionally, the post-processor 380 may process the post-echo canceler uplink data 388 in response to the double talk activity probability data 50. As previously described, the pre-processor 370 and the post-processor may attenuate the downlink data 60 and the post-echo canceler uplink data 388.
However, any other type of suitable processing may be employed such as filtering, clipping, spectral or temporal masking, or any other device or technique.
FIG. 6 is a flowchart illustrating one example of a method 600 for controlling the echo canceler circuit in response to the double talk activity probability data 50 according to yet another embodiment of the invention. The method 600 may be carried out by the echo canceler 10. However, any other suitable structure may also be used. It will be recognized that the method 600 beginning with step 610 will be described as a series of operations, but the operations may be performed in any suitable order and may be repeated in any suitable combination. For example, although the method 600 ends with step 670, the method 600 may be xepeated by returning to the start at step 610 or at any suitable step and in any combination.
As shown in step 611, the double talk activity probability data generator 30 receives the pre-echo canceler uplink data 40. This step is similar to step 520 in FIG. 5 and step 220 in FIG. 2 as previously described.
As shown in step 612, the center band pass filter 480 generates center band pass data 488 in response to the pre-echo canceler uplink data 40. As shown in step 614, the center clipper logic 484 generates the center clipped band pass data 462 in response to the center band pass data 488. As shown in step 616, the post-clipping power estimate logic 486 generates center power clipped data 472 in response to the center clipped band pass data 462.
As shown in step 620, the lower band pass filter 489 generates lower band data 494 in response to the pre-echo canceler uplink data 40. As shown in step 622, the upper band pass filter 490 generates upper band data 495 in response to the pre-echo canceler uplink data 40. As shown in step 624, the adder logic 491 combines the lower band data 494 and the upper band data 495 to produce composite band data 496. The composite power estimate logic 492 in step 624 produces the composite power data 497 in response to the composite band data 496. As shown in step 626, the center to composite power ratio data generator 493 generates center to composite power ratio data 474 in response to the center power clipped data 489 and the composite power data 497. As shown in step 618, the distortion data generator generates distortion data 476 in response to the pre-echo canceler uplink data 40.
As shown in step 640, the double talk soft decision logic 470 generates the double talk activity probability data 50 in response to the clipped center power data 472, the center to composite power ratio data 474 and the distortion data 476.
As shown in step 650, the double talk activity probability data generator 30 provides the double talk activity probability data SO to the echo canceler adaptive filter 382 to adjust the rate of adaptation, the weighting coefficients, or any other suitable echo canceler filter adaptation parameter. According to one embodiment, the double talk activity probability data generator 30 provides the double talk activity probability data 50 to downlink data attenuator 392 to attenuate the downlink data 60 and in response to produce the attenuated downlink data 72. As shown in step 660, the uplink data attenuator 390 receives the post-echo canceler uplink data 388 and the double talk activity probability data 50 and in response produces the attenuated uplink data 70 in .
FIG. 7 is a block diagram of a communication system 700 according to one exemplary embodiment of the invention. The communication system 700 includes the communication apparatus 310, the audio system 320, the speaker 326, the microphone 330, a wireless wide area network (WWAN) transceiver 710, WWAN
antennas 720, 730, 750, 753, a wireless devices 740, 742, wireless interface 744, and wireless local area network (WLAN) antennas 760, 770.
The communication apparatus 310 further includes a processor 772, a WWAN
transceiver 780, a WLAN transceiver 790 and a location information generator 792, such as a global positioning system (GPS) receiver. The processor 772 receives location information 793 from the location information generator 792 and in response relays the location information 793 to the WWAN transceiver 710, 780 or to the wireless devices 740, 742.
The processor 772 includes the echo canceler circuit 10. The echo canceler circuit 10 may be coupled to one or more of the WWAN transceiver 710, the wireless wide area network transceiver 780, the wireless device interface 744 or the WLAN transceiver 790. For example, the WWAN transceivers 780, 710 may represent any one of a number of wireless devices, such as, for example, an in-vehicle mobile phone, a portable cellular phone, a wireless personal digital assistant, a wireless fidelity device (WiFi-i.e., a device based on the IEEE 802.11 specification) or any suitable communication device. According to one embodiment, the WWAN
transceiver 710 may be external to the communication apparatus 310, and therefore the echo canceler circuit 10 may be coupled to the wireless wide area network transceiver 710 via an appropriate link, such as a wired cable as is known in the art.
According to another embodiment, the WWAN transceiver 790 may be integrated into the communication apparatus 310.
The WLAN transceiver 790 may be a Bluetooth-compliant device or a wireless fidelity device (WiFi-i.e., a device based on the IEEE 802.11 specification) or any suitable communication device. For example, the WWAN transceiver 790 may interface with the wireless device 740 via a local area network interface 794, the WLAN antenna 760, and the wireless local area network antenna 770. The wireless devices 740 may be a cellular phone, a personal digital assistant equipped with a wireless interface, or a portable computer also equipped with a WWAN
interface.
The wireless devices 740, 742 and WWAN transceivers 710, 780, 790 may communicate with a WWAN, such as a cellular telephone system suitable for communicating with a public switching telephone network (PSTN). Accordingly, the wireless devices 740, 742 may communicate with a cellular telephone system using any wireless communication protocol, such as, for example, code division multiple access (CDMA), time division multiple access (TDMA), advanced mobile phone standard (AMPS) or group special mobile (GSM), or any suitable currently implemented or future protocols, such as the third generation (3G) and higher wireless communication protocols.
The communication apparatus 310 according to one embodiment includes a housing containing the processor 772, the WWAN transceiver 780, the WLAN
transceiver WLAN 790 and the location information generator 792. Additional or fewer components may be included in the communication apparatus 310 other than those described above. As is known in the art, the processor 772, the WWAN
transceiver 780, the WLAN 790 and the location information generator 792 may each be manufactured as separate circuit boards or integrated circuit chips from one or more manufacturers. The circuit boards may be interconnected as required through the use of a mother board, a flat or non-flat flexible mufti-conductor cable, a multi-conductor wired cable or any suitable type of interconnection device. Each circuit board may be attached or coupled either directly or indirectly to the housing or to other circuit boards via a suitable fastening device as is known in the art, such as a connector, a clamp, a clip, a screw, a nut and a bolt. The integrated circuit chips may be interconnected as required via a circuit board, a mufti-circuit chip carrier, a flat flexible multiconductor cable, a multiconductor wired cable or any suitable type of interconnection device. The circuit boards and integrated circuit chips may be mounted using chemical bonding such as an adhesive or any suitable fastening device.
According to one embodiment, the communication apparatus 310 housing may include: a circuit board comprising the processor 772 and memory 320, a circuit board comprising the WWAN transceiver 780, and a circuit board comprising the WLAN
transceiver 790. The circuit boards may be interconnected and attached or coupled to the housing either directly or indirectly as previously discussed.
Additionally, the communication apparatus 310 housing may include connectors for coupling to external components such as the audio system 320, the microphone, 330, WWAN
antenna 730, WLAN antenna 770, WWAN transceiver 710 or any other suitable device. For example, the communication apparatus 310 may interface with other suitable components not described herein. The connectors may be any suitable device for interconnecting the communication apparatus 310 to any external components such as via a wired cable, a fiber optic link, or a radio frequency interface.
According to one embodiment, the communication apparatus 310 is a telematics communication module supporting the collection and dissemination of data, including audio speech. For example, the telematics communication module may be based on General Motors' OnStar System, which automatically calls for emergency assistance if the vehicle is in an accident. According to another embodiment, the communication apparatus 310 also can perform such functions as remote engine diagnostics, tracking stolen vehicles and providing roadside assistance, as well as other functions.
FIG. 8 is a block diagram of an in-vehicle communication system 800 according to at least one embodiment of the invention. The in-vehicle communication system 800 includes the communication apparatus 310 coupled to the wireless device 740 via the wireless local area network antenna 770. For example, the WLAN
transceiver 790 between the wireless device 740 and the communication apparatus 310 may be a Bluetooth interface or a hard wire connection via a wireless device cradle as previously discussed. For example, the communication apparatus 310 may interface with the wireless device 742 via the wireless device interface 612 such as a wireless device cradle.
According to one embodiment as shown in FIG. 8, the in-vehicle communication system 800 may include the wireless local area network transceiver 790 or, alternatively, it may include the wireless wide area network transceiver 780 that is integrated into the communications apparatus 310 as shown previously with respect to FIG. 7. Alternatively, the communication apparatus 310 may interface with the wireless wide area network transceiver 710 externally to the communication apparatus 310 and may be mounted in any suitable location within the vehicle.
The communication apparatus 310 may also interface with the audio system 320 as previously described. Accordingly, although the audio system 320 and the communication apparatus 310 are shown in the trunk area of the vehicle, the communication apparatus 310 and/or the audio system 310 may be located in any suitable location, including on top of, under or in front of the dashboard.
According to one embodiment, the vehicle's audio system 320 may include the communication apparatus 310 and any suitable transceiver, such as the wireless wide area network transceiver 780 and the wireless local area network transceiver 790.
Among other advantages, the present invention improves the accuracy of double talk detection even in harsh acoustic environments and also mitigates or eliminates the effects of double talk. Rather than producing a binary indication of a double talk mode based on a singular metric, the double talk activity probability data generator 30 produces double talk activity probability data 50 for establishing a confidence level with respect to the detection of a double talk condition based on multiple metrics. The double talk activity probability data generator 30 provides more robust echo canceller system control, in contrast to the limited control provided by a double talk detector that provides a binary indication of a double talk mode based on a singular metric. The generation of double talk activity probability data 50 allows for independent adjustment or control of different components of the echo canceler circuit 10, such as for example the echo canceler adaptive filter 382, the pre-processor 370 and the post-processor 380. Accordingly, the double talk activity probability data generator 30 may be used to provide one or more mechanisms of control for the various elements of the echo canceler circuit. For example, the double talk activity probability data generator 30 may variably control the rate of adaptation of the echo canceler adaptive filter 382 in order to improve the stability of the echo canceler adaptive filter 382 and to adjust to the double talk activity condition. The double talk activity probability data generator 30 allows for the control of multiple parameters within the echo canceler circuit 10 based on multiple metrics, such as the detection of noise echo as a result of acoustic coupling between the speaker 326 and the microphone330 and the detection of near end speech 344.
It is understood that the implementation of other variations and modifications of the invention and its various aspects will be apparent to those of ordinary skill in the art and that the invention is not limited by the specific embodiments described. It is therefore contemplated to cover the present modifications, variations or equivalents that fall within the broad scope of the basic underlying principles disclosed and claimed herein.
Claims (9)
1. An echo canceler circuit comprising:
a double talk activity probability data generator operative to receive pre-echo canceler uplink data and in response to produce double talk activity probability data; and an echo canceler stage, operatively coupled to the double talk activity probability data generator and operative to receive downlink data, the pre-echo canceler uplink data and the double talk activity probability data and in response to produce attenuated uplink data.
a double talk activity probability data generator operative to receive pre-echo canceler uplink data and in response to produce double talk activity probability data; and an echo canceler stage, operatively coupled to the double talk activity probability data generator and operative to receive downlink data, the pre-echo canceler uplink data and the double talk activity probability data and in response to produce attenuated uplink data.
2. The echo canceler circuit of claim 1 wherein the echo canceler stage includes an echo canceler adaptive filter operatively coupled to the double talk activity probability data generator and operative to receive the double talk activity probability data and the attenuated downlink data and in response to produce echo estimation data and to adjust a rate of echo cancellation adaptation.
3. The echo canceler circuit of claim 1 wherein the echo canceler stage further includes:
adder logic operative to receive the pre-echo canceler uplink data and echo estimation data and in response to produce post-echo canceler uplink data, an uplink data attenuator, operatively coupled to the adder logic, and operative to receive the post-echo canceler uplink data and the double talk activity probability data and in response to attenuate the post-echo canceler uplink data to produce the attenuated uplink data.
adder logic operative to receive the pre-echo canceler uplink data and echo estimation data and in response to produce post-echo canceler uplink data, an uplink data attenuator, operatively coupled to the adder logic, and operative to receive the post-echo canceler uplink data and the double talk activity probability data and in response to attenuate the post-echo canceler uplink data to produce the attenuated uplink data.
4. The echo canceler circuit of claim 1 wherein the double talk activity probability data generator further includes:
a center power clipped data generator operative to receive the pre-echo canceler uplink data and in response to produce center power pre-clipped data and clipped center power data;
a center to composite power ratio data generator operative to receive the pre-echo canceler uplink data and the center power pre-clipped data and in response to produce center to composite power ratio data;
a distortion data generator operative to receive the pre-echo canceler uplink data and in response to produce distortion data; and double talk soft decision logic operatively coupled to the center power clipped data generator, the center to composite power ratio data generator and the distortion data generator and operative to receive the clipped center power data, the center to composite power ratio data and the distortion data and in response to produce the double talk activity probability data.
a center power clipped data generator operative to receive the pre-echo canceler uplink data and in response to produce center power pre-clipped data and clipped center power data;
a center to composite power ratio data generator operative to receive the pre-echo canceler uplink data and the center power pre-clipped data and in response to produce center to composite power ratio data;
a distortion data generator operative to receive the pre-echo canceler uplink data and in response to produce distortion data; and double talk soft decision logic operatively coupled to the center power clipped data generator, the center to composite power ratio data generator and the distortion data generator and operative to receive the clipped center power data, the center to composite power ratio data and the distortion data and in response to produce the double talk activity probability data.
5. The echo canceler circuit of claim 4 wherein the center power clipped data generator further includes:
a center band pass filter operative to receive the pre-echo canceler uplink data and in response to produce center band pass data;
center clipper logic operatively coupled to the center band pass filter and operative to receive the center band pass data and in response to produce center clipped band pass data;
pre-clipping power estimate logic operatively coupled to the center band pass filter and operative to receive the center band pass data and in response to produce the center power pre-clipped data; and post-clipping power estimate logic operatively coupled to the center clipper logic and operative to receive the center clipped band pass data and in response to produce the clipped center power data.
a center band pass filter operative to receive the pre-echo canceler uplink data and in response to produce center band pass data;
center clipper logic operatively coupled to the center band pass filter and operative to receive the center band pass data and in response to produce center clipped band pass data;
pre-clipping power estimate logic operatively coupled to the center band pass filter and operative to receive the center band pass data and in response to produce the center power pre-clipped data; and post-clipping power estimate logic operatively coupled to the center clipper logic and operative to receive the center clipped band pass data and in response to produce the clipped center power data.
6. The echo canceler circuit of claim 5 wherein the center to composite power ratio data generator further includes:
a lower band pass filter operative to receive the pre-echo canceler uplink data and in response to produce lower band data;
an upper band pass filter operative to receive the pre-echo canceler uplink data and in response to produce upper band data;
adder logic operatively coupled to the lower band pass filter and to the upper band pass filter and operative to receive the lower band data and the upper band data and in response to produce composite band data;
composite power estimate logic operatively coupled to the adder logic and operative to receive the composite band data and in response to produce composite power data; and a center to composite power ratio data generator operatively coupled to the composite power estimate logic and to the pre-clipping power estimate logic and operative to receive the composite power data and the center power pre-clipped data and in response to produce the center to composite power ratio data.
a lower band pass filter operative to receive the pre-echo canceler uplink data and in response to produce lower band data;
an upper band pass filter operative to receive the pre-echo canceler uplink data and in response to produce upper band data;
adder logic operatively coupled to the lower band pass filter and to the upper band pass filter and operative to receive the lower band data and the upper band data and in response to produce composite band data;
composite power estimate logic operatively coupled to the adder logic and operative to receive the composite band data and in response to produce composite power data; and a center to composite power ratio data generator operatively coupled to the composite power estimate logic and to the pre-clipping power estimate logic and operative to receive the composite power data and the center power pre-clipped data and in response to produce the center to composite power ratio data.
7. A method for detecting double talk activity comprising:
generating double talk activity probability data in response to pre-echo canceler uplink data; and echo canceling the pre-echo canceler uplink data in response to the double talk activity probability data to produce attenuated uplink data.
generating double talk activity probability data in response to pre-echo canceler uplink data; and echo canceling the pre-echo canceler uplink data in response to the double talk activity probability data to produce attenuated uplink data.
8. The method of claim 7 including:
attenuating downlink data in response to the double talk activity probability data to produce attenuated downlink data.
attenuating downlink data in response to the double talk activity probability data to produce attenuated downlink data.
9. The method of claim 7 including reducing a rate of echo cancellation adaptation in response to the double talk activity probability data.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US10/735,300 | 2003-12-12 | ||
| US10/735,300 US7046794B2 (en) | 2003-12-12 | 2003-12-12 | Double talk activity detector and method for an echo canceler circuit |
| PCT/US2004/040807 WO2005060583A2 (en) | 2003-12-12 | 2004-12-07 | A double talk activity detector and method for an echo canceler circuit |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2546535A1 CA2546535A1 (en) | 2005-07-07 |
| CA2546535C true CA2546535C (en) | 2009-09-15 |
Family
ID=34653580
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002546535A Expired - Fee Related CA2546535C (en) | 2003-12-12 | 2004-12-07 | A double talk activity detector and method for an echo canceler circuit |
Country Status (8)
| Country | Link |
|---|---|
| US (1) | US7046794B2 (en) |
| EP (1) | EP1697192A4 (en) |
| JP (1) | JP2007519316A (en) |
| KR (1) | KR100790770B1 (en) |
| CN (1) | CN1890948A (en) |
| CA (1) | CA2546535C (en) |
| MX (1) | MXPA06006639A (en) |
| WO (1) | WO2005060583A2 (en) |
Families Citing this family (61)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080207197A1 (en) | 1997-07-30 | 2008-08-28 | Steven Tischer | Apparatus, method, and computer-readable medium for interfacing devices with communications networks |
| US7149514B1 (en) | 1997-07-30 | 2006-12-12 | Bellsouth Intellectual Property Corp. | Cellular docking station |
| US6411802B1 (en) * | 1999-03-15 | 2002-06-25 | Bellsouth Intellectual Property Management Corporation | Wireless backup telephone device |
| US7120454B1 (en) * | 2001-12-26 | 2006-10-10 | Bellsouth Intellectual Property Corp. | Auto sensing home base station for mobile telephone with remote answering capabilites |
| US8416804B2 (en) | 2002-07-15 | 2013-04-09 | At&T Intellectual Property I, L.P. | Apparatus and method for providing a user interface for facilitating communications between devices |
| US8526466B2 (en) | 2002-07-15 | 2013-09-03 | At&T Intellectual Property I, L.P. | Apparatus and method for prioritizing communications between devices |
| US8000682B2 (en) | 2002-07-15 | 2011-08-16 | At&T Intellectual Property I, L.P. | Apparatus and method for restricting access to data |
| US8554187B2 (en) | 2002-07-15 | 2013-10-08 | At&T Intellectual Property I, L.P. | Apparatus and method for routing communications between networks and devices |
| US8543098B2 (en) | 2002-07-15 | 2013-09-24 | At&T Intellectual Property I, L.P. | Apparatus and method for securely providing communications between devices and networks |
| US7200424B2 (en) | 2002-07-15 | 2007-04-03 | Bellsouth Intelectual Property Corporation | Systems and methods for restricting the use and movement of telephony devices |
| US8275371B2 (en) | 2002-07-15 | 2012-09-25 | At&T Intellectual Property I, L.P. | Apparatus and method for providing communications and connection-oriented services to devices |
| US7680265B2 (en) * | 2003-12-12 | 2010-03-16 | Continental Automotive Systems, Inc. | Echo canceler circuit and method |
| US7599483B2 (en) * | 2003-12-12 | 2009-10-06 | Temic Automotive Of North America, Inc. | Echo canceler circuit and method |
| JP4562402B2 (en) * | 2004-02-20 | 2010-10-13 | アルパイン株式会社 | Asynchronous communication system for voice data and communication method therefor |
| US7433463B2 (en) * | 2004-08-10 | 2008-10-07 | Clarity Technologies, Inc. | Echo cancellation and noise reduction method |
| US8457614B2 (en) | 2005-04-07 | 2013-06-04 | Clearone Communications, Inc. | Wireless multi-unit conference phone |
| JP4438720B2 (en) * | 2005-08-17 | 2010-03-24 | ソニー株式会社 | Echo canceller and microphone device |
| KR100737404B1 (en) * | 2005-12-30 | 2007-07-09 | 한국표준과학연구원 | Multi-purpose terminal device for communicating under noise surroundings |
| US7912211B1 (en) | 2007-03-14 | 2011-03-22 | Clearone Communications, Inc. | Portable speakerphone device and subsystem |
| US8077857B1 (en) | 2007-03-14 | 2011-12-13 | Clearone Communications, Inc. | Portable speakerphone device with selective mixing |
| US8654955B1 (en) | 2007-03-14 | 2014-02-18 | Clearone Communications, Inc. | Portable conferencing device with videoconferencing option |
| US8406415B1 (en) | 2007-03-14 | 2013-03-26 | Clearone Communications, Inc. | Privacy modes in an open-air multi-port conferencing device |
| US8019076B1 (en) | 2007-03-14 | 2011-09-13 | Clearone Communications, Inc. | Portable speakerphone device and subsystem utilizing false doubletalk detection |
| US7983428B2 (en) * | 2007-05-09 | 2011-07-19 | Motorola Mobility, Inc. | Noise reduction on wireless headset input via dual channel calibration within mobile phone |
| US8391472B2 (en) * | 2007-06-06 | 2013-03-05 | Dreamworks Animation Llc | Acoustic echo cancellation solution for video conferencing |
| US7881459B2 (en) * | 2007-08-15 | 2011-02-01 | Motorola, Inc. | Acoustic echo canceller using multi-band nonlinear processing |
| JP5071480B2 (en) * | 2007-08-24 | 2012-11-14 | 富士通株式会社 | Echo suppression device, echo suppression system, echo suppression method, and computer program |
| US20090067616A1 (en) * | 2007-09-07 | 2009-03-12 | Kerby William Suhre | CAN echo cancellation level shifter |
| US8199927B1 (en) | 2007-10-31 | 2012-06-12 | ClearOnce Communications, Inc. | Conferencing system implementing echo cancellation and push-to-talk microphone detection using two-stage frequency filter |
| US8050398B1 (en) | 2007-10-31 | 2011-11-01 | Clearone Communications, Inc. | Adaptive conferencing pod sidetone compensator connecting to a telephonic device having intermittent sidetone |
| US8290142B1 (en) | 2007-11-12 | 2012-10-16 | Clearone Communications, Inc. | Echo cancellation in a portable conferencing device with externally-produced audio |
| US8238548B2 (en) * | 2008-02-08 | 2012-08-07 | Cisco Technology, Inc. | Controlling echo during double-talk in a voice conference |
| KR20100039622A (en) * | 2008-10-08 | 2010-04-16 | 삼성전자주식회사 | Apparatus and method for providing digital broadcasting service information in portable communication system |
| US8498407B2 (en) * | 2008-12-02 | 2013-07-30 | Qualcomm Incorporated | Systems and methods for double-talk detection in acoustically harsh environments |
| CN102137194B (en) * | 2010-01-21 | 2014-01-01 | 华为终端有限公司 | Call detection method and device |
| US8811601B2 (en) | 2011-04-04 | 2014-08-19 | Qualcomm Incorporated | Integrated echo cancellation and noise suppression |
| EP2632141B1 (en) * | 2012-02-22 | 2014-10-15 | Dialog Semiconductor B.V. | Postfilter for Spectral Domain Echo Cancellers to handle Non-linear Echo Components |
| CN103533193B (en) * | 2012-07-04 | 2016-07-06 | 中兴通讯股份有限公司 | Residual echo elimination method and device |
| US9269368B2 (en) * | 2013-03-15 | 2016-02-23 | Broadcom Corporation | Speaker-identification-assisted uplink speech processing systems and methods |
| JP6435613B2 (en) * | 2014-03-04 | 2018-12-12 | 沖電気工業株式会社 | Talk state detector, talk state detection method, echo canceller and echo suppressor, and talk state detection program |
| US10291597B2 (en) | 2014-08-14 | 2019-05-14 | Cisco Technology, Inc. | Sharing resources across multiple devices in online meetings |
| US10542126B2 (en) | 2014-12-22 | 2020-01-21 | Cisco Technology, Inc. | Offline virtual participation in an online conference meeting |
| US9712866B2 (en) | 2015-04-16 | 2017-07-18 | Comigo Ltd. | Cancelling TV audio disturbance by set-top boxes in conferences |
| US9948786B2 (en) | 2015-04-17 | 2018-04-17 | Cisco Technology, Inc. | Handling conferences using highly-distributed agents |
| US10123141B2 (en) | 2015-11-13 | 2018-11-06 | Bose Corporation | Double-talk detection for acoustic echo cancellation |
| US10129408B1 (en) * | 2016-10-11 | 2018-11-13 | Google Llc | Residual echo detection based on non-causality |
| US10592867B2 (en) | 2016-11-11 | 2020-03-17 | Cisco Technology, Inc. | In-meeting graphical user interface display using calendar information and system |
| US10516707B2 (en) | 2016-12-15 | 2019-12-24 | Cisco Technology, Inc. | Initiating a conferencing meeting using a conference room device |
| US10440073B2 (en) | 2017-04-11 | 2019-10-08 | Cisco Technology, Inc. | User interface for proximity based teleconference transfer |
| US10375125B2 (en) | 2017-04-27 | 2019-08-06 | Cisco Technology, Inc. | Automatically joining devices to a video conference |
| US10388298B1 (en) * | 2017-05-03 | 2019-08-20 | Amazon Technologies, Inc. | Methods for detecting double talk |
| US10375474B2 (en) | 2017-06-12 | 2019-08-06 | Cisco Technology, Inc. | Hybrid horn microphone |
| US10477148B2 (en) | 2017-06-23 | 2019-11-12 | Cisco Technology, Inc. | Speaker anticipation |
| US10516709B2 (en) | 2017-06-29 | 2019-12-24 | Cisco Technology, Inc. | Files automatically shared at conference initiation |
| US10706391B2 (en) | 2017-07-13 | 2020-07-07 | Cisco Technology, Inc. | Protecting scheduled meeting in physical room |
| US10091348B1 (en) | 2017-07-25 | 2018-10-02 | Cisco Technology, Inc. | Predictive model for voice/video over IP calls |
| US10771621B2 (en) | 2017-10-31 | 2020-09-08 | Cisco Technology, Inc. | Acoustic echo cancellation based sub band domain active speaker detection for audio and video conferencing applications |
| US10602270B1 (en) * | 2018-11-30 | 2020-03-24 | Microsoft Technology Licensing, Llc | Similarity measure assisted adaptation control |
| CN109862200B (en) * | 2019-02-22 | 2021-02-12 | 北京达佳互联信息技术有限公司 | Voice processing method and device, electronic equipment and storage medium |
| KR102266780B1 (en) | 2019-07-04 | 2021-06-18 | 한양대학교 산학협력단 | Method and apparatus for reducing speech distortion by mitigating clipping phenomenon and using correlation between microphone input signal, error signal, and far end signal occurring in a voice communication environment |
| KR20220017080A (en) * | 2020-08-04 | 2022-02-11 | 삼성전자주식회사 | Method for processing voice signal and apparatus using the same |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07121027B2 (en) * | 1988-02-03 | 1995-12-20 | 株式会社日立製作所 | Loud phone |
| JPH03179931A (en) * | 1989-12-08 | 1991-08-05 | Nec Corp | Bidirectional speech state judging system |
| JPH04271622A (en) * | 1991-02-27 | 1992-09-28 | Nec Corp | Echo canceller |
| JP2836277B2 (en) * | 1991-03-14 | 1998-12-14 | 国際電信電話株式会社 | Echo cancellation device |
| US5268834A (en) | 1991-06-24 | 1993-12-07 | Massachusetts Institute Of Technology | Stable adaptive neural network controller |
| US5274705A (en) * | 1991-09-24 | 1993-12-28 | Tellabs Inc. | Nonlinear processor for an echo canceller and method |
| JPH0766756A (en) * | 1993-08-30 | 1995-03-10 | Kyocera Corp | Acoustic echo canceler |
| FR2748184B1 (en) * | 1996-04-26 | 1998-07-17 | France Telecom | ECHO CANCELLATION METHOD AND DEVICE |
| FR2738695B1 (en) * | 1995-09-13 | 1997-11-14 | France Telecom | ADAPTIVE IDENTIFICATION METHOD AND DEVICE AND ADAPTIVE ECHO CANCELER INCLUDING SUCH A DEVICE |
| US5734715A (en) * | 1995-09-13 | 1998-03-31 | France Telecom | Process and device for adaptive identification and adaptive echo canceller relating thereto |
| SE505692C2 (en) | 1995-12-18 | 1997-09-29 | Ericsson Telefon Ab L M | Method and apparatus for echo extinguishing by estimating residual signal power |
| US6240180B1 (en) * | 1997-11-14 | 2001-05-29 | Tellabs Operations, Inc. | Echo canceller employing dual-H architecture having split adaptive gain settings |
| US6148078A (en) * | 1998-01-09 | 2000-11-14 | Ericsson Inc. | Methods and apparatus for controlling echo suppression in communications systems |
| US6532454B1 (en) | 1998-09-24 | 2003-03-11 | Paul J. Werbos | Stable adaptive control using critic designs |
| CN1320782C (en) * | 2001-05-22 | 2007-06-06 | 三菱电机株式会社 | Echo processing appts. |
| JP3979169B2 (en) * | 2002-04-26 | 2007-09-19 | 松下電工株式会社 | Echo canceller |
-
2003
- 2003-12-12 US US10/735,300 patent/US7046794B2/en not_active Expired - Lifetime
-
2004
- 2004-12-07 JP JP2006543915A patent/JP2007519316A/en active Pending
- 2004-12-07 KR KR1020067011514A patent/KR100790770B1/en not_active IP Right Cessation
- 2004-12-07 CA CA002546535A patent/CA2546535C/en not_active Expired - Fee Related
- 2004-12-07 CN CNA2004800368681A patent/CN1890948A/en active Pending
- 2004-12-07 MX MXPA06006639A patent/MXPA06006639A/en active IP Right Grant
- 2004-12-07 EP EP04813167A patent/EP1697192A4/en not_active Withdrawn
- 2004-12-07 WO PCT/US2004/040807 patent/WO2005060583A2/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| KR100790770B1 (en) | 2008-01-03 |
| EP1697192A4 (en) | 2008-08-06 |
| EP1697192A2 (en) | 2006-09-06 |
| US7046794B2 (en) | 2006-05-16 |
| CA2546535A1 (en) | 2005-07-07 |
| US20050129225A1 (en) | 2005-06-16 |
| KR20060100464A (en) | 2006-09-20 |
| CN1890948A (en) | 2007-01-03 |
| WO2005060583A2 (en) | 2005-07-07 |
| WO2005060583A3 (en) | 2006-01-05 |
| JP2007519316A (en) | 2007-07-12 |
| MXPA06006639A (en) | 2006-08-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2546535C (en) | A double talk activity detector and method for an echo canceler circuit | |
| US7099458B2 (en) | Downlink activity and double talk probability detector and method for an echo canceler circuit | |
| US8811603B2 (en) | Echo canceler circuit and method | |
| US7680265B2 (en) | Echo canceler circuit and method | |
| US7787613B2 (en) | Method and apparatus for double-talk detection in a hands-free communication system | |
| US6192126B1 (en) | Double talk detector, method for double talk detection and device incorporating such a detector | |
| EP1044558B1 (en) | Methods and apparatus for controlling echo suppression in communications systems | |
| US7212841B2 (en) | Telephone apparatus and a communication method using such apparatus | |
| US20040076288A1 (en) | Integrated noise cancellation and residual echo suppression | |
| US7711108B2 (en) | Fast echo canceller reconvergence after TDM slips and echo level changes | |
| KR19980086461A (en) | Hand-free phone |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed |
Effective date: 20141208 |