# Speech enhancement based on Bayesian decision and spectral amplitude estimation

- 1.2k Downloads
- 1 Citations

## Abstract

In this paper, a single-channel speech enhancement method based on Bayesian decision and spectral amplitude estimation is proposed, in which the speech detection module and spectral amplitude estimation module are included, and the two modules are strongly coupled. First, under the decisions of speech presence and speech absence, the optimal speech amplitude estimators are obtained by minimizing a combined Bayesian risk function, respectively. Second, using the obtained spectral amplitude estimators, the optimal speech detector is achieved by further minimizing the combined Bayesian risk function. Finally, according to the detection results of speech detector, the optimal decision rule is made and the optimal spectral amplitude estimator is chosen for enhancing noisy speech. Furthermore, by considering both detection and estimation errors, we propose a combined cost function which incorporates two general weighted distortion measures for the speech presence and speech absence of the spectral amplitudes, respectively. The cost parameters in the cost function are employed to balance the speech distortion and residual noise caused by missed detection and false alarm, respectively. In addition, we propose two adaptive calculation methods for the perceptual weighted order *p* and the spectral amplitude order *β* concerned in the proposed cost function, respectively. The objective and subjective test results indicate that the proposed method can achieve a more significant segmental signal-noise ratio (SNR) improvement, a lower log-spectral distortion, and a better speech quality than the reference methods.

### Keywords

Speech enhancement Bayesian decision Spectral amplitude estimation Combined Bayesian risk function General weighted cost function## 1 Introduction

Speech enhancement could improve the quality of noisy speech, which results in a broad range of applications, such as mobile speech communication, robust speech recognition, aids for the hearing impaired, and so on. Therefore, speech enhancement has widely attracted research, and a large number of speech enhancement algorithms, for example, spectral subtraction (SS) method [1], wavelet de-noising method [2], subspace method [3], speech enhancement based on human auditory perceptual model [4], the minimum mean square error (MMSE) estimator of Ephraim-Malah [5], log-spectral amplitude (LSA) estimator [6], and speech enhancement based on speech presence uncertainty [7], have been proposed. Some speech enhancement methods [1, 4, 5, 6, 7] are often operated in the discrete Fourier transform (DFT) domain, that is, the enhanced speech is obtained by estimating DFT coefficients of clean speech from the noisy speech.

As we all know, speech signal is present only in some frames based on short-time analysis, and only some frequency bins contain significant energy in each frame. This means that the spectral amplitude of speech signal is generally sparse. However, the existing speech enhancement methods do not take the sparse characteristics into consideration and often only focus on estimating the spectral amplitude rather than detecting the speech presence or speech absence. Although the SS method [1] could detect the existence of speech by signal power in the frequency domain, it is so simple that SS method often randomly produces ‘music noise’ caused by falsely detecting noise peaks as speech. Under the assumption of speech presence uncertainty, Ephraim and Malah derived a short-time spectral amplitude (STSA) estimator [5] by applying speech presence uncertainty to the MMSE method, which can improve the enhancement performance of the MMSE method [5]. Furthermore, combining the speech presence uncertainty with the LSA estimator [6], the optimal modified log-spectral amplitude (OM-LSA) estimator [8] was proposed. These speech estimators based on the speech presence uncertainty can yield reasonable enhancement results for the stationary noise environments. However, under the non-stationary noise conditions, the performance of these estimators may be degraded since the time-varying noise energy results in a false calculation about speech presence probability. In addition, some speech enhancement methods employed voice activity detection (VAD) [9, 10] to detect the existence of speech, but with the decrease of the signal-noise ratio (SNR) and the increases of non-stationary characteristics of the noise, the performance of the VAD methods often become worse. Consequently, the performance of speech enhancement is decreased. Moreover, the VAD methods are usually carried out frame by frame, and therefore, they cannot detect the existence of speech in frequency bins. Considering the significance of speech detection and estimation for speech enhancement, a simultaneous detection and estimation approach (SDEA) for speech enhancement was presented [11], which includes the detection and estimation operations simultaneously. However, the quadratic spectral amplitude (QSA) error was used as its cost function, which limits the ability of noise reduction and affects the enhancement performance of the method.

In order to solve the aforementioned problems, we propose a single-channel speech enhancement method based on Bayesian decision and spectral amplitude estimation (BDSAE), in which the importance of the speech detection and estimation for speech enhancement are jointly considered. The speech detection module and spectral amplitude estimation module are included in this method, and the two modules are strongly coupled. First, the optimal speech amplitude estimators under each of the decisions (i.e., speech presence or speech absence) are obtained by minimizing a combined Bayesian risk function. Second, using the obtained spectral amplitude estimators, the optimal speech detector for the existence of speech signal in spectral amplitudes is achieved by further minimizing the combined Bayesian risk function. Finally, according to the results of speech detector, the decision rule is made, and thus the final optimal spectral amplitude estimator is selected for enhancing noisy speech. Furthermore, by taking into account both detection and estimation errors, we propose a combined cost function, in which the cost parameters are used to balance the speech distortion and residual noise caused by missed detection and false alarm, respectively. Moreover, the combined cost function consists of two general weighted distortion measures under the speech presence or speech absence of spectral amplitudes, in which the perceptual weighted order *p* [12, 13, 14] and the spectral amplitude order *β* [15, 16] are jointly used. In order to obtain more flexible and effective gain functions, the parameters *p* and *β* are adaptively estimated, that is, the parameter *p* is made to be a frequency-dependent value, and the value of *β* is calculated according to the posterior SNR. To summarize, the BDSAE method not only considers the sparse characteristics of spectral amplitudes of speech signal (i.e., speech detection) but also takes the full advantages of both the traditional perceptual weighted estimators [12, 14] and *β*-order spectral amplitude estimators [15, 16] (i.e., speech estimation), which can obtain more flexible and effective gain functions for speech enhancement. The experiment results indicate that the proposed BDSAE method can improve the quality of enhanced speech both in terms of subjective and objective measures.

The remainder of this paper is organized as follows. In Section 2, the proposed BDSAE speech enhancement method is described. In Section 3, we present the adaptive calculation methods for the perceptual weighted order *p* and the spectral amplitude order *β*, respectively. In Section 4, we describe the implementation of the proposed BDSAE method. The performance evaluation is presented in Section 5, and Section 6 gives the conclusions.

## 2 The proposed BDSAE speech enhancement method

In this section, we first present conventional spectral amplitude estimation scheme for speech enhancement. Then, the proposed speech enhancement scheme based on Bayesian decision and spectral amplitude estimation is described. Finally, we derive the optimal decision rule and spectral amplitude estimator by introducing general weighted cost functions.

### 2.1 Conventional spectral amplitude estimation scheme

*x*(

*n*) is contaminated by an uncorrelated additive noise

*d*(

*n*), then the noisy speech signal

*y*(

*n*) can be expressed as:

*y*(

*n*) =

*x*(

*n*) +

*d*(

*n*). By taking a DFT of

*y*(

*n*), we can obtain the following expression about

*y*(

*n*) in frequency domain:

*n*is the time domain index of the speech signal.

*Y*(

*ω*

_{ k }),

*X*(

*ω*

_{ k }), and

*D*(

*ω*

_{ k }) denote the

*k*th DFT coefficients of noisy speech, clean speech, and noise signal, respectively.

*ω*

_{ k }= 2π

*k*/

*N*,

*k*is the index of frequency bins, and

*N*is the frame length.

*Y*

_{ k },

*X*

_{ k }, and

*D*

_{ k }denote the

*k*th spectral magnitudes of the noisy speech, clean speech, and noise signal, respectively.

*θ*

_{ y }(

*k*),

*θ*

_{ x }(

*k*), and

*θ*

_{ d }(

*k*) are the phases corresponding to the frequency bin

*k*of the noisy speech, clean speech, and noise signal, respectively.

From (2), we can obtain *Y* _{ k } = *X* _{ k } + *D* _{ k }. That is to say, we can ignore the phases of clean speech and noise signal and mainly focus on estimating the spectral magnitude of clean speech from the noisy speech signal.

*E*{.} denotes the statistical expectation. The \( C\left({X}_k,{\widehat{X}}_k\right) \) is the cost function.

However, these methods do not take the sparse characteristics of spectral amplitudes of speech signal into consideration, and thus, they just focus on estimating the spectral amplitudes of speech signal rather than speech detection and spectral amplitude estimation simultaneously. That is, for the speech presence or speech absence of spectral amplitudes in each frequency bin, the cost function \( C\left({X}_k,{\widehat{X}}_k\right) \) of the conventional methods is the same, which limits the performance of speech enhancement. Therefore, by taking into account both speech detection and estimation, we propose a new speech enhancement method based on Bayesian decision and spectral amplitude estimation.

### 2.2 Bayesian decision and spectral amplitude estimation scheme

In this section, we reformulate the speech enhancement as a Bayesian decision and estimation problem under two hypotheses with the framework of statistical decision theory [17, 18].

*k*th spectral magnitude of the noisy speech

*Y*

_{ k }, we let

*Hk*0 and

*Hk*1 denote, respectively, speech absence and speech presence hypotheses in the frequency bin

*k*[11, 13]:

Then, the Bayesian decision is employed to detect the two hypotheses, so we define two decision spaces *ηk j* (*j* = 0, 1) for detecting the speech presence or speech absence in the frequency bin *k*. In this way, if the decision *ηk* 0 is made, the speech hypothesis *Hk* 0 is accepted, which means speech is absent in the frequency bin *k*, and thus the corresponding enhanced speech \( {\widehat{X}}_k \) = \( {\widehat{X}}_{k,0} \) is obtained. Similarly, if the decision *ηk* 1 is made, the speech hypothesis *Hk* 1 is detected, which means speech is present in the frequency bin *k*, and then the corresponding speech estimation \( {\widehat{X}}_k \) = \( {\widehat{X}}_{k,1} \) is achieved.

Finally, using the speech presence or not hypotheses *Hk i*(*i* = 0, 1) and decision spaces *ηk j*(*j* = 0, 1), we can reformulate the speech enhancement as the Bayesian decision and spectral amplitude estimation problem, which is presented as follows:

*ηk j*(and choosing the speech estimator \( {\widehat{X}}_{k,j} \)), and we can consider the detection decision

*η*(

*ηk*0 or

*ηk*1) as the function of

*Y*(

*ω*

_{ k }), i.e.,

*η*=

*ψ*(

*Y*(

*ω*

_{ k })). Therefore, for making a decision

*η*=

*ψ*(

*Y*(

*ω*

_{ k })), the combined cost function \( \tilde{C}\left({X}_k,{\widehat{X}}_k\right|\psi \left(Y\left({\omega}_k\right)\right) \) can be presented as follows:

*p*(

*ηk j|Y*(

*ω*

_{ k })) is a conditional decision probability. For notation simplification, we omit the frequency bin indices later.

*R*can be defined by the following:

_{ x }and Ω

_{ y }denote the spaces of clean speech and noisy speech, respectively.

*p*(

*X*) is the priori probability of spectral magnitude which can be defined as follows [11, 13]:

*q*=

*p*(

*H*

_{1}) denotes the priori speech presence probability, and

*p*(

*X*|

*H*

_{0}) =

*δ*(

*X*) is the Dirac delta function [11].

*H*

_{0}and hypothesis

*H*

_{1}, we let \( {C}_{ij}\left(X,\widehat{X}\right)={C}_j\left(X,\widehat{X}\Big|{H}_i\right) \) denote the cost that is conditioned on the true

*H*

_{ i }and the decision

*η*

_{ j }. Namely, the cost function relies on both the true speech

*X*under

*H*

_{ i }and the estimated speech \( \widehat{X} \) under decision

*η*

_{ j }. Thus, the cost function couples the two modules of speech detection and spectral amplitude estimation. By substituting (7) into (6), we can get

*H*

_{ i },

*η*

_{ j }}, we define the risk

*r*

_{ ij }(

*Y*(

*ω*)) as follows [11]:

*R*in (8) can be rewritten as:

*p*(

*η*

_{ j }|

*Y*(

*ω*)) ∈ {0, 1} is binary, for minimizing the combined Bayesian risk function

*R*, we first estimate the optimal spectral amplitude \( {\widehat{X}}_j \) under each of the decisions

*η*

_{ j }. Second, using the obtained \( {\widehat{X}}_j \), the optimal speech presence decision

*η*

_{ j }can be derived by further minimizing the combined Bayesian risk function

*R*. Namely, according to the two-stage minimization process of (10), the optimal speech decision rule can be given by:

*η*

_{ j }, the spectral amplitude estimation \( {\widehat{X}}_j \) can be obtained from (10) by:

Figure 1b is the proposed speech detection and estimation scheme, where the estimator is obtained by (12) and the interrelated decision rule of (11) is used to choose the appropriate estimator, \( {\widehat{X}}_0 \) or \( {\widehat{X}}_1 \), for minimizing the combined Bayesian risk *R*. Since the risk *r* _{ ij }(*Y*(*ω*)) existing both in (11) and (12) is a function of the speech estimation \( {\widehat{X}}_j \), the decision rule of (11) requires information of the speech estimator under each of its own decisions, which we can see the arrows between speech detection block and speech estimation block in Fig. 1b. That is, the speech detection and speech estimation are strongly coupled in the proposed scheme. In this way, if the decision *η* _{0} is made, the speech hypothesis *H* _{0} is accepted, which means speech is absent in noisy speech spectral coefficients, and thus the corresponding enhanced speech \( \widehat{X}={\widehat{X}}_0 \) is obtained. Similarly, if the decision *η* _{1} is made, the speech hypothesis *H* _{1} is detected, which means speech is present in noisy speech spectral coefficients, therefore, the corresponding speech estimation \( \widehat{X}={\widehat{X}}_1 \) is achieved.

### 2.3 The derivation of BDSAE based on the general weighted cost functions

In this section, based on a general weighted cost functions, we first derive the optimal speech existence decision rule of (11) and spectral amplitude estimators of (12) for the BDSAE system by minimizing the combined Bayesian risk function *R*. Then the gain’s change process of the BDSAE system is analyzed. Next, we discuss the influences of cost parameters in weighted cost functions for the BDSAE system. Finally, the influences of *p* and *β* parameters for the BDSAE system are demonstrated.

*r*

_{ ij }(

*Y*(

*ω*)) which depends on the cost function

*C*

_{ ij }(

*X*, \( \widehat{X} \)). The cost function plays a significant role in the Bayesian spectral amplitude estimator. For different cost function, we can derive various kinds of spectral amplitude estimators and obtain different speech enhancement performance. In this paper, not only the speech estimation error need to be considered but also the speech detection error should be taken into account. Therefore, we present the cost function associated with the hypothesis-decision pair {

*H*

_{ i },

*η*

_{ j }} [11, 13]:

*i*and

*j*are the indices of speech hypothesis and decision space, respectively; \( {d}_{ij}\left(X,\widehat{X}\right) \) is the distortion measure which is defined in (14); and

*c*

_{ ij }is the cost parameter which is used to balance the costs associated with the hypothesis-decision pair {

*H*

_{ i },

*η*

_{ j }}. The cost parameters

*c*

_{00}and

*c*

_{11}indicate the decision is correct, namely, there is no cost need to balance, so their values are equal to 1 here;

*c*

_{01}is used to balance the cost of false alarm (i.e., the speech absence is detected as speech presence), which can avoid too much noise residual in the enhanced speech; and

*c*

_{10}is used to balance the cost of miss detection (i.e., the speech presence is detected as speech absence), which can control speech distortion in the enhanced speech.

*H*

_{ i }(

*i*= 0, 1), the general weighted distortion measure \( {d}_{ij}\left(X,\widehat{X}\right) \) is defined as follows:

*i*and

*j*are the indices of speech hypothesis and decision space;

*G*

_{ f }denotes gain floor factor,

*p*is the perceptual weighted order, and

*β*is the spectral amplitude order.

*H*

_{1}, the perceptual weighted order

*p*[12, 13, 14] and the spectral amplitude order

*β*[15, 16] are jointly incorporated into the distortion measure. For speech hypothesis

*H*

_{0}, the gain floor factor

*G*

_{ f }is employed to the distortion measure which allows some comfort background noise level in the enhanced speech.

*q*)

*p*(

*Y*(

*ω*)|

*H*

_{0}) on both sides of (17), we can obtain

*μ*denotes the spectral amplitude order. Г(∙) is the gamma function, and Ф(∙) denotes the confluent hyper-geometric function. For

*ϕ*

^{ μ/2}of (20), we can simplify it as follows:

*λ*

_{ x }=

*E*{

*X*

^{2}} and

*λ*

_{ d }=

*E*{

*D*

^{2}} are the speech and noise variances, respectively.

*ξ*is a priori SNR,

*γ*is a posteriori SNR, and

*ν*is the function of

*ξ*and

*γ*. Here,

*ξ*,

*γ*, and

*ν*are defined as follows [12]:

*η*

_{ j }(

*j*= 0, 1):

*G*

_{ j }(

*ξ*,

*γ*,

*p*,

*β*) is the gain function of BDSAE method under the speech decision

*η*

_{ j }.

- 2.
*Speech detector*: From (11), we can find that, in order to obtain an optimal speech presence decision rule, the risk*r*_{ ij }(*Y*(*ω*)) requires to be calculated, so for speech hypothesis*H*_{1}, we have

*ξ*is a priori SNR,

*γ*is a posteriori SNR, and

*ν*is the function of

*ξ*and

*γ*, which have been defined in (22).

*ϕ*=

*λ*

_{ x }

*λ*

_{ d }/(

*λ*

_{ x }+

*λ*

_{ d }), the variances of speech and noise

*λ*

_{ x }and

*λ*

_{ d }can be expressed as

*λ*

_{ x }=

*E*{

*X*

^{2}},

*λ*

_{ d }=

*E*{

*D*

^{2}}, respectively. The detailed procedure for deriving risk

*r*

_{1j }(

*Y*(

*ω*)) is given in Appendix 1.

*H*

_{0}, we can obtain

*γ*is a posteriori SNR and

*λ*

_{ d }is the variance of the noise. The derivation details of risk

*r*

_{0j }(

*Y*(

*ω*)) is given in Appendix 2. Therefore, by substituting

*r*

_{1j }(

*Y*(

*ω*))and

*r*

_{0j }(

*Y*(

*ω*)) into (11), we can obtain the optimal speech presence decision rule.

- (a)
Calculating the gain function under each of the speech decisions

*η*_{ j }by (23); - (b)
Finding the optimal decision

*η*_{ j }by (11) according to (24) and (25), then the optimal gain function associated with the optimal decision*η*_{ j }is achieved. Therefore, the corresponding speech estimation is obtained by applying the gain to the noisy speech.

- 3.
*Gains analysis*: Figure 2 demonstrates the gain’s change process of BDSAE system versus the value of (*γ*− 1) that referred to as the instantaneous SNR, where the parameters*c*_{01}= 1.5,*c*_{10}= 5,*q*= 0.8, and*G*_{ f }= −15 dB, respectively. Here, we just call the gain function*G*_{ j }(*ξ*,*γ*,*p*,*β*) as*G*_{ j }for convenience. The*G*_{0}(blue dashed line) and*G*_{1}(blue dotted line) are the gains under the decision*η*_{0}and*η*_{1}, respectively. The*G*(red solid line) denotes the gain of BDSAE system.

*ξ*= 5 dB, as long as the instantaneous SNR is higher than about 3 dB, the speech decision changes from

*η*

_{0}to

*η*

_{1}, thus the optimal system gain

*G*changes from

*G*

_{0}to

*G*

_{1}. Similarly, as shown in Fig. 2b, for a priori SNR of

*ξ*= −5 dB, as long as the instantaneous SNR is higher than about −1 dB, the speech decision changes from

*η*

_{1}to

*η*

_{0}, thus the optimal system gain

*G*changes from

*G*

_{1}to

*G*

_{0}. Note that if there is an ideal speech detector, a more significantly non-continuous gain would be obtained. However, in the proposed BDSAE scheme, although the speech detector is not ideal, it is optimized to minimize the combined Bayesian risk function

*R*, that is, the non-continuous system gain

*G*of the proposed BDSAE is optimal, which could obtain good enhancement performance shown in Section 5.

- 4.
*Influence of cost parameters*: In addition, from (23) we can see that, in the proposed BDSAE method, the non-continuous system gain*G*depends on the cost parameters*c*_{ ij }as well as parameters*p*and*β*. If the cost parameter*c*_{01}associated with false alarm is much less than the generalized likelihood ratio Λ(*Y*(*ω*)), that is, the speech is definitely present in the spectral amplitude, the BDSAE gain function*G*_{1}(*ξ*,*γ*,*p*,*β*) under the decision*η*_{1}can be approximated as follows:

*G*

_{1}(

*ξ*,

*γ*,

*p*,

*β*) is equal to

*G*

_{appr}(

*ξ*,

*γ*), which means a good enhancement effect can be obtained under correct decision

*η*

_{1}. However, if the cost parameter

*c*

_{01}is much larger than the generalized likelihood ratio Λ(

*Y*(

*ω*)), the speech is absent in the spectral amplitude. In this case, the BDSAE gain function

*G*

_{1}(

*ξ*,

*γ*,

*p*,

*β*) under the decision

*η*

_{1}(i.e., false alarm) is equal to

*G*

_{ f }approximately (i.e.,

*G*

_{1}(

*ξ*,

*γ*,

*p*,

*β*) ≈

*G*

_{ f }), and thus the cost of false alarm is compensated and the residual noise in the enhanced speech signals can be reduced effectively. On the other hand, if the cost parameter

*c*

_{10}associated with missed detection is much smaller than the inverse of generalized likelihood ratio Λ(

*Y*(

*ω*)), the BDSAE gain function

*G*

_{0}(

*ξ*,

*γ*,

*p*,

*β*) under the decision

*η*

_{0}is equal to

*G*

_{ f }approximately (i.e.,

*G*

_{0}(

*ξ*,

*γ*,

*p*,

*β*) ≈

*G*

_{ f }). Therefore, it can remove noise greatly when speech is definitely absent. On the contrary, if the cost parameter

*c*

_{10}is much greater than the inverse of Λ(

*Y*(

*ω*)), the BDSAE gain function

*G*

_{0}(

*ξ*,

*γ*,

*p*,

*β*) under the decision

*η*

_{0}(i.e., miss decision) is equivalent to the gain function

*G*

_{appr}(

*ξ*,

*γ*) of (26) (i.e.,

*G*

_{0}(

*ξ*,

*γ*,

*p*,

*β*) ≈

*G*

_{ appr }(

*ξ*,

*γ*)), so the cost of miss decision can be compensated and the speech distortion can be reduced as well. Here, in order to obtain a better trade-off between speech distortion and noise reduction, the empirical values of cost parameters

*c*

_{01}and

*c*

_{10}are chosen the same as 1.5.

- 5.
*Influence of p and β parameters*: Furthermore, the*p*and*β*parameters are also more important to system gain*G*of the BDSAE method. Figure 3 shows their influences on gain function*G*_{ j }(*ξ*,*γ*,*p*,*β*) for different*p*and*β*values, where the parameters*c*_{01}= 1.5,*c*_{10}= 5,*q*= 0.8, and*G*_{ f }= −15 dB, respectively. Here, the value of (*γ*− 1) is referred to as the instantaneous SNR.

As shown in Fig. 3a, given a fixed parameter *β* = 0.5 and the a priori SNR *ξ* = *−*5 dB, the gain *G* _{0} and *G* _{1} of BDSAE estimator always increase with the increasing of parameter *p* when instantaneous SNR (*γ −* 1) varies from *−*20 to 15 dB. That is, for different *p* values, we can obtain different system gain *G* values, and the corresponding noise reductions can be achieved.

From Fig. 3b, we can see that the gain *G* _{0} and *G* _{1} of BDSAE estimator also always increase with the increasing of parameter *β* for a fixed *p* = 2 and the a priori SNR *ξ* = *−*5 dB when instantaneous SNR (*γ −* 1) varies from *−*20 to 15 dB. Namely, for the different *β* values, the system gain *G* values are different, and the noise reduction obtained is also different. In this way, we can obtain the appropriate system gain *G* values by adaptively choosing the right *p* and *β* values, which can yield effective noise reduction and good speech enhancement performance. The adaptive calculation methods of *p* and *β* parameters will be presented in Section 3.

## 3 Adaptive calculation of *p and β* parameters

From the aforementioned analysis, we can see that the perceptually weighted order *p* and the spectral amplitude order *β* play an important role in speech enhancement, which can result in a better enhancement performance by choosing appropriate values for *p* and *β*. Therefore, in this section, we will present an adaptive calculation method for *p* and *β*, respectively.

### 3.1 Adaptive calculation of parameter *p*

For the calculation of parameter *p*, in [12], the method did not consider the variability of *p*, and just a fixed *p* value was chosen for the trade-off between noise reduction and speech distortion. Since no flexible gain was introduced, the enhancement performance of the estimator was limited. In [14], the variability of parameter *p* was considered, and an adaptive calculation method of *p* was presented, in which the parameter *p* was considered as a polynomial of the sub-band SNR and auditory perceptual parameter. In this way, for a larger STSA and a smaller STSA, the speech estimation errors can be penalized differently. However, the method shown in [14] needs to calculate the masking thresholds, and thus the pre-enhancement process is required, which increases the computational complexity greatly.

Since most of the speech energy is located at the lower frequencies (i.e., larger STSA) and at the higher frequencies, the speech energy is weakened (i.e., smaller STSA) [19], for the lower frequencies, the value of parameter *p* should be high and vice versa for the higher frequencies. That is, the estimation error at the higher frequencies is penalized more heavily than that at the lower frequencies. In this way, the residual noise can be suppressed effectively at the higher frequencies, and the speech distortion at the lower frequencies can be reduced at the same time. Therefore, on the basis of such idea, we propose a new adaptive calculation method for parameter *p.*

First, the appropriate lower bound and higher bound of parameter *p* for high frequency and low frequency require to be chosen, respectively. As discussed in [12], the *p* value with more negative produced more noise reduction but the greater speech distortion was introduced as well. Moreover, the *p* = *−*1 was suggested as a good trade-off between the noise reduction and speech distortion in [12]. Therefore, we choose *p* _{min}
*= −*1 as the lower bound of parameter *p* for high frequency. According to [14], in order to reduce the speech distortion at lower frequencies, *p* _{max} is set up to 4.0 as the upper bound of parameter *p* for low frequency in this paper.

*p*value at the intermediate frequencies, the linear decreasing of

*p*is proposed as a function of the frequency, i.e.,

*k*is the index of frequency bins,

*N*is the frame length, and

*p*(

*k*) denotes the

*p*value of the

*k*th frequency bin.

*p*. First, the 21 critical sub-bands [20] are divided for each frame of noisy observation. Then the variable \( \tilde{p} \) is assumed to be a linear function of the critical sub-band SNR Ξ(

*b*,

*k*), where

*b*is the index of the critical bands. Finally, the range of \( \tilde{p} \) is limited as [\( {\tilde{p}}_{\min } \), \( {\tilde{p}}_{\max } \)] to obtain a trade-off between the noise reduction and speech distortion [16]. In this way, the value of \( \tilde{p} \) can be calculated by the following:

*b*denotes the index of the critical bands and

*k*is the index of frequency bins. Ξ(

*b*,

*k*) denotes the

*k*th sub-band SNR that belongs to the

*b*th band. The constants

*μ*and

*υ*are set to 0.45 and 1.5, respectively, and the minimum and maximum values of \( \tilde{p} \) are set to 0.4 and 4.0, respectively, i.e., \( {\tilde{p}}_{\min } \) = 0.4 and \( {\tilde{p}}_{\max } \) = 4.0.

*p*is obtained by weighting

*p*and \( \tilde{p} \):

*ε*is related to the sub-band SNR Ξ(

*b*,

*k*), which is defined by the following:

_{0}is a constant. Here, Ξ

_{0}= 3.22 and Ξ(

*b*,

*k*) is defined as follows:

in which *b* denotes the index of the critical bands, *k* is the index of frequency bins. *B* _{up}(*b*) and *B* _{low}(*b*) denote the upper and lower frequency bound of the *b*th critical band, respectively. *Y*(*b*, *k*) denotes the *k*th spectral amplitude of noisy speech that belongs to the *b*th band, and *λ* _{ d }(*b*, *k*) is the *k*th noise variances that belongs to the *b*th band.

### 3.2 Adaptive calculation of parameter *β*

For the calculation of *β*, in [15] and [16], the calculation methods of parameter *β* are based on overall SNR of each frame, and a linear relationship between *β* and frame SNR was applied. The *β* only monotonically increases or decreases with the frame SNR increases or decreases. That is, the value of *β* is fixed and does not vary with the frequency bins in each frame, so it cannot obtain flexible gain, the enhancement performance is limited. For this problem, a solution was proposed in [14], in which the parameter *β* was interpreted as the compression rate of the spectral amplitude and calculated based on the critical band. That is, the *β* value is different for different critical band, which can result in a more flexible gain. However, there is no consensus on the degree of compressive nonlinearity at the lower and intermediate frequencies, which might influence the accuracy of *β* value. Therefore, in this paper, we propose a new calculation method for the parameter *β* that varies with the frequency bins.

As we know, the higher the a posterior SNR *γ*(*k*) of (12), the larger the speech presence probability, so *β* should be larger for reducing speech distortion and vice versa. Therefore, according to *γ*(*k*), we can employ a monotonically increasing sigmoid function [21] to calculate the value of *β*.

*γ*(

*k*),

*h*is a normalized hamming window with length 2

*L*

_{ h }+ 1 and

*L*

_{ h }= 5.

*β*value is often limited to the range of [0.001, 4.0] for the trade-off between noise reduction and speech distortion [14, 15, 16]. Therefore, the sigmoid function is employed to map the \( \tilde{\gamma}(k) \) into (0,

*β*

_{max}) for parameter

*β*, then we have

*α*is used to control the steepness of the sigmoid function,

*γ*

_{0}is the position of the inflection point, and

*β*

_{max}is a constant. They are set to 0.42, 3.5, and 4.0, respectively. And

*β*(

*k*) denotes the

*β*value of the

*k*th frequency bin.

*β*to 0.001, that is, the final

*β*is obtained by:

*k*is the index of frequency bins,

*β*

_{min}= 0.001. Figure 4 gives the variation of

*β*values versus a posterior SNR

*γ*(

*k*).

As shown in Fig. 4, the *β* value of the proposed method is a monotonically increasing function with respect to *γ*(*k*). Namely, the larger noise reduction can be yielded as *γ*(*k*) decreases, and the lower speech distortion can be achieved when *γ*(*k*) increases.

## 4 Implementation of the proposed method

*p*and

*β*are adaptively calculated according to the critical sub-band SNRs and a posteriori SNRs. Finally, combining a posteriori SNR and a priori SNR obtained by a decision-directed (DD) method [5], the optimal spectral amplitude estimator and decision rule of the BDSAE method are derived by further minimizing the combined Bayesian risk function

*R*, which are used to enhance DFT coefficients of the noisy speech. Then the inverse Fourier transform and the overlap-adding algorithm are performed to obtain the enhanced speech signal in the time domain.

## 5 Performance evaluation

In this section, we discuss the performance evaluation of the proposed BDSAE method. First, the experimental setup of the proposed method is described. Then, we compare the objective and subjective experimental results between the proposed method and the reference methods.

### 5.1 Experimental setup

In order to evaluate the performance of the proposed BDSAE method for speech enhancement, white Gaussian noise, street noise, and interior Volvo car noise from ITU-T noise database and babble noise, factory noise, and Fl6 cockpit noise from NOISEX-92 [23] database were used in the test experiments. Twenty-four speech sentences were taken from the Chinese sub-database of NTT speech database, where 12 sentences produced by two female speakers (i.e., six sentences for each female speaker) and another 12 sentences produced by two male speakers (i.e., six sentences for each male speaker). All these speech signals and noises are re-sampled at 16 kHz, and all the signals were 8 s in duration. Frame size *N* is 512 samples, and the samples are sine windowed with 50 % overlap between adjacent frames. The noisy speech signals were produced according to ITU-T P.56 standard [24], and the input SNRs of noisy speech are 0, 5, 10, and 15 dB, respectively.

In the experiments, the MMSE STSA estimator [5], the SDEA estimator [11], the weighted Euclidean distortion measure (WEDM) estimator [12], and the *β-*STSA estimator [16] are chosen as the reference methods for comparing with the proposed BDSAE method. The DD method [5] is applied to all these reference methods and the BDSAE method. The MCRA algorithm [22] is used for these methods to estimate noise power spectrum from noisy speech signals. All the reference methods we used were implemented according to the referenced papers, and the corresponding parameters of the methods were not tuned as well.

For the performance evaluation of the speech enhancement methods, the segmental SNR (SNR_{seg}) measure [25], the log-spectral distortion (LSD) measure [11], and the perceptual evaluation of speech quality (PESQ) [26] were used as objective quality evaluation methods. Furthermore, the Multiple Stimuli with Hidden Reference and Anchor (MUSHRA) listening test [27] was employed to evaluate the subjective quality.

### 5.2 Objective quality tests

- 1.
- 2.
*Segmental SNR*: The SNR_{seg}[25] measure can be employed to evaluate the objective quality of enhanced speech signals of different speech enhancement methods. The SNR_{seg}is measured by calculating the SNR for each frame of speech and averaging these SNRs over all test speech sequences, which can be defined by the following:

*n*denotes the index of signal samples,

*N*is the frame length.

*l*is frame index, and

*L*is the total number of frames.

*x*(

*n*) denotes the clean speech signal, and \( \widehat{x}(n) \) denotes the enhanced speech signal.

_{seg}improvement for different enhancement methods under White Gaussian noise. Figure 8 gives the comparison of SNR

_{seg}improvement for different enhancement methods under factory noise.

From Figs. 7 and 8, we can see that, in the case of white Gaussian noise and Factory noise, the SNR_{seg} improvement of the WEDM method is much better than the other reference methods, but a little worse than the proposed BDSAE method. The SNR_{seg} improvements of the BDSAE method are nearly 5.0 and 3.0 dB larger than the WEDM method in the white Gaussian noise and factory noise conditions, respectively.

_{seg}improvement of various enhancement methods for six types of noise are presented in Table 1 .

Test results of SNRseg improvement

Enhancement methods | SNRseg improvement | |||
---|---|---|---|---|

0 dB | 5 dB | 10 dB | 15 dB | |

MMSE | 11.22 | 10.23 | 9.25 | 8.13 |

WEDM | 14.15 | 13.22 | 12.16 | 10.85 |

| 11.97 | 11.13 | 10.31 | 9.44 |

SDEA | 13.99 | 12.86 | 11.78 | 10.54 |

BDSAE | 17.45 | 16.53 | 15.64 | 14.48 |

_{seg}improvement than the reference methods. Furthermore, for each input SNR, in comparison with the WEDM method whose performance is better than the other reference methods, the average SNR

_{seg}improvement of the BDSAE method is increased about 3.3 dB for all test noise signals. Therefore, according to the experimental results of Figs. 7 and 8 and Table 1 , it is obvious that the BDSAE method performs better than the reference methods.

- 3.
*LSD*: The LSD measure [11] is also used to evaluate the objective quality of the enhanced speech, which measures the similarity between the clean speech spectrum and the estimated speech spectrum. The definition of LSD is given as:

*l*is the frame index,

*k*is the index of frequency bins,

*L*is the total frames, and

*N*is the frame length.

*X*(

*l*,

*k*) denotes the DFT coefficient of the clean speech signal and \( \widehat{X}\left(l,k\right) \) denotes the DFT coefficient of the enhanced speech signal.

Test results of LSD

Enhancement methods | LSD | |||
---|---|---|---|---|

0 dB | 5 dB | 10 dB | 15 dB | |

Noisy speech | 19.62 | 16.14 | 12.95 | 10.11 |

MMSE | 11.07 | 8.89 | 7.04 | 5.50 |

WEDM | 9.45 | 7.51 | 5.84 | 4.46 |

| 10.73 | 8.52 | 6.56 | 4.89 |

SDEA | 9.68 | 7.90 | 6.37 | 5.09 |

BDSAE | 7.49 | 6.08 | 4.85 | 3.86 |

From Figs. 9 and 10 , we can see that, in the white Gaussian noise and Factory noise conditions, all speech enhancement methods can obviously reduce the LSD comparing with the noisy speech, where the BDSAE method can obtain much lower LSD than the other reference methods for four SNR conditions. By comparing with the WEDM method whose LSD is lower than the other reference methods, the average LSDs of the BDSAE method are decreased about 3.0 and 1.5 dB for different input SNRs in the white Gaussian noise and factory noise conditions, respectively.

- 4.
*PESQ*: The PESQ [26] is widely used to assess the objective quality of speech signals, and a higher PESQ score corresponds to a better speech quality. For the case of white Gaussian noise and factory noise, the PESQ test results are compared in Figs. 11 and 12, respectively. The total average PESQ scores of six types of noise are given in Table 3 for four kinds of input SNRs.Table 3Test results of PESQ

Enhancement methods

PESQ scores

0 dB

5 dB

10 dB

15 dB

Noisy speech

1.615

1.945

2.316

2.686

MMSE

2.013

2.403

2.716

2.973

WEDM

2.239

2.558

2.828

3.089

*β-*STSA2.160

2.482

2.774

3.042

SDEA

2.105

2.451

2.752

3.025

BDSAE

2.340

2.651

2.926

3.189

From Figs. 11 and 12, we can see that, for the case of white Gaussian noise and Factory noise, in comparison with the reference methods, the BDSAE method yields higher average PESQ scores for various input SNR conditions.

From Table 3 , we can find that the average PESQ scores of the enhanced speech signals are all higher than noisy speech signals, which illustrates that the quality of enhanced speech signals produced by all kinds of enhancement methods are improved obviously. In addition, by comparing with the reference methods, the BDSAE method produces higher average PESQ scores for various input SNR conditions. Therefore, it is further confirmed that the proposed BDSAE method is superior to the reference algorithms.

### 5.3 Subjective quality tests

The quality of enhanced speech is generally assessed by subjective perception, such as speech intelligibility, naturalness, and articulation. The MUSHRA listening test [27] is a commonly used method for the subjective evaluation of audio quality. It requires fewer participants to obtain a statistically significant result [27] reference. Therefore, we employed the MUSHRA listening test to evaluate the subjective quality of enhanced speech. In the MUSHRA test, the subjects are provided with the signals under test as well as one reference and a hidden anchor. The subjects are asked to grade the different signals on a quality scale between 0 and 100, 100 being the best score. As the hidden anchor, we used a speech signal having an SNR of 5 dB less than the noisy speech to be enhanced [20]. The listeners were allowed to listen to each test speech several times and always had access to the clean speech reference.

From Fig. 13, we can find that, for four input SNR conditions, the WEDM method yields higher average MUSHRA scores than the other reference methods but lower than the BDSAE method. That is, the proposed BDSAE method performs better than the state-of-the-art reference methods for the subjective quality.

### 5.4 Discussion

From the aforementioned experimental results, we can see that the proposed BDSAE approach performs better than the reference methods. Herein, we discuss its advantages to the reference methods.

As we know, the spectral amplitudes of speech signal are generally sparse since only some frequency bins contain significant energy in each speech frame. However, the reference methods do not take the sparse characteristics into consideration and often only focus on estimating the speech spectral amplitude rather than detecting their existence in the frequency bins. In this way, for the speech presence or speech absence in the frequency bins, they only use the same gain function to estimate clean speech from noisy speech, which limits their enhancement performance.

For the proposed BDSAE approach, the sparse characteristics of spectral amplitudes of speech signal are considered. That is, under speech presence or speech absence in frequency bins, the cost functions are different which result in different gain functions. Then the speech detector is derived to choose the optimal gain function to estimate clean speech. In this way, for speech presence or speech absence in frequency bins, the gain functions are different and optimal, respectively, which can yield better speech enhancement performance. Moreover, the speech distortion and residual noise resulted from the detector error (i.e., missed detection and false alarm) can be compensated by cost parameters *c* _{ ij }, which is discussed in Section 2.3 (i.e., (4) *Influence of cost parameters*).

In addition, the *p* and *β* parameters are induced to cost functions of the BDSAE approach, and the values of *p* and *β* are adaptive calculation as the frequency bins. Therefore, we can obtain more flexible and effective gain functions under speech presence and speech absence in frequency bin, which can yield effective noise reduction and good speech enhancement performance.

As can be seen from (23), the proposed BDSAE approach requires the calculation of two gain functions, *G* _{0} and *G* _{1}, and the decision rule, in which the mainly computational complexity is focus on calculating the gamma function Г(∙) and the confluent hyper-geometric function Ф(∙). However, for the four reference methods (i.e., MMSE, WEDM, *β-*STSA, and SDEA) listed in Section 5.1, they also require to calculate the two functions of Г(∙) and Ф(∙). Therefore, the computational complexity of the proposed BDSAE approach is at the same level compared to the four reference methods. In addition, the proposed BDSAE approach is implemented frame by frame, and thus, there is no any delay existed.

*G*

_{ j }(

*ξ*,

*γ*,

*p*,

*β*) of (23). For the numerator and the denominator of (23), the algebraic product of the gamma function Γ(.) and the confluent hyper-geometric function Φ(.) can be considered as the function of variables

*φ*and

*ν*, namely, Ψ(

*φ*,

*ν*) = Γ(

*φ*+ 1)Φ(−

*φ*, 1;

*ν*). The variable

*φ*is the function of parameters

*p*and

*β*in the BDSAE estimator, i.e.,

*φ*

_{1}= (

*p*+

*β*)/2,

*φ*

_{2}=

*p*/2. In this way, the gain function

*G*

_{ j }(

*ξ*,

*γ*,

*p*,

*β*) of Eq. (23) can be simplified as follows:

Therefore, according to [14] and [16], the Ψ(*φ*, *ν*) is designed for looking up a table which relies on variables *φ* and *ν*. The computational complexity of the proposed method is reduced greatly by the above simplification.

## 6 Conclusions

We present a single-channel speech enhancement method based on BDSAE. The optimal speech decision rule and spectral amplitude estimator are derived by jointly minimizing the combined Bayesian risk function which considers both detection and estimation errors. Under presence and absence of spectral amplitude, the general weighted cost function is proposed, in which the perceptually weighted order *p* and the spectral amplitude order *β* are jointly used. In order to obtain flexible gain values for the BDSAE method, the adaptive estimation methods for the *p* and *β* parameters are presented, respectively. Furthermore, the cost parameters in the cost function are employed to balance the speech distortion and residual noise caused by missed detection and false alarm, respectively. Therefore, the BDSAE method not only considers the sparse characteristics of the spectral amplitudes of speech signal but also takes the full advantages of both the traditional perceptual weighted estimators and *β*-order spectral amplitude estimators, which can obtain more flexible and effective gain functions. Finally, we took the objective and subjective quality tests for the enhanced speech based on SNR_{seg}, LSD, PESQ, and MUSHRA listening tests, respectively. The test results indicate that the proposed BDSAE method can achieve a more significant performance improvement than the reference methods.

## Notes

### Acknowledgements

This work was supported by the National Natural Science Foundation of China (Grant No. 61471014).

### References

- 1.SF Boll, Suppression of acoustic noise in speech using spectral subtraction [J]. IEEE Trans. Acoust., Speech Signal Process
**27**(2), 113–120 (1979)CrossRefGoogle Scholar - 2.DL Donoho, De-noising by soft-thresholding [J]. IEEE Trans. Inf. Theory
**41**, 613–627 (1995)MATHMathSciNetCrossRefGoogle Scholar - 3.Y Ephraim, HL Van Trees, A signal subspace approach for speech enhancement [J]. IEEE Trans. Speech Audio Process.
**3**(4), 251–266 (1995)CrossRefGoogle Scholar - 4.N Virag, Single channel speech enhancement based on masking properties of the human auditory system [J]. IEEE Trans. Speech Audio Process.
**7**(2), 126–137 (1999)CrossRefGoogle Scholar - 5.Y Ephraim, D Malah, Speech enhancement using a minimum mean-square error short-time spectral amplitude estimator [J]. IEEE Trans. Acoust. Speech Signal Process
**32**, 1109–1121 (1984)CrossRefGoogle Scholar - 6.Y Ephraim, D Malah, Speech enhancement using a minimum mean-square error log-spectral amplitude estimator [J]. IEEE Trans. Acoust. Speech Signal Process
**33**, 443–445 (1985)CrossRefGoogle Scholar - 7.Malah, D., Cox, R. V., Accardi, A. J., Tracking speech-presence uncertainty to improve speech enhancement in non-stationary noise environments [A]. In Proc. 24th IEEE Int. Conf. Acoust., Speech, Signal Process., ICASSP’99 [C], Phoenix, AZ, 1999: 789–792.Google Scholar
- 8.I Cohen, B Berdugo, Speech enhancement for non-stationary environments [J]. Signal Process.
**81**, 2403–2418 (2001)MATHCrossRefGoogle Scholar - 9.M Fujimoto, S Watanabe, T Nakatani, Frame-wise model re-estimation method based on Gaussian pruning with weight normalization for noise robust voice activity detection [J]. Speech Comm.
**54**(2), 229–244 (2012)CrossRefGoogle Scholar - 10.CH Hsieh, TY Feng, PC Huan, Energy-based VAD with grey magnitude spectral subtraction [J]. Speech Comm.
**51**(9), 810–819 (2009)CrossRefGoogle Scholar - 11.A Abramson, I Cohen, Simultaneous detection and estimation approach for speech enhancement [J]. IEEE Trans. Speech Audio Process.
**15**, 2348–2359 (2007)CrossRefGoogle Scholar - 12.P Loizou, Speech enhancement based on perceptually motivated Bayesian estimators of the speech magnitude spectrum [J]. IEEE Trans. Speech Audio Process.
**13**(5), 857–869 (2005)CrossRefGoogle Scholar - 13.Deng, F., Bao, C. C., Bao, F., A speech enhancement method by coupling speech detection and spectral amplitude estimation [A]. 14th Annual Conference of the International Speech Communication Association, Interspeech [C], Lyon, France, 2013: 3234–3238.Google Scholar
- 14.F Deng, F Bao, CC Bao, Speech enhancement using generalized weighted
*β*-order spectral amplitude estimator [J]. Speech Comm.**59**, 55–68 (2014)CrossRefGoogle Scholar - 15.CH You, SN Koh, S Rahardja, Masking-based
*β*-order MMSE speech enhancement [J]. Speech Comm.**48**(1), 57–70 (2006)CrossRefGoogle Scholar - 16.CH You, SN Koh, S Rahardja,
*β*-order MMSE spectral amplitude estimation for speech enhancement [J]. IEEE Trans. Speech Audio Process.**13**(4), 475–486 (2005)CrossRefGoogle Scholar - 17.A Fredriksen, D Middleton, D Vandelinde, Simultaneous signal detection and estimation under multiple hypotheses [J]. IEEE Trans. Inf. Theory
**18**(5), 607–614 (1968)MathSciNetCrossRefGoogle Scholar - 18.AG Jaffer, SC Gupta, Coupled detection-estimation of Gaussian processes in Gaussian noise [J]. IEEE Trans. Inf. Theory
**18**(1), 106–110 (1972)MATHCrossRefGoogle Scholar - 19.E Plourde, B Champagne, Auditory-based spectral amplitude estimators for speech enhancement [J]. IEEE Trans. Speech Audio Process.
**16**(8), 1614–1623 (2008)CrossRefGoogle Scholar - 20.JD Johnston, Transform coding of audio signal using perceptual noise criteria [J]. IEEE J. Select. Areas Comm.
**6**, 314–323 (1988)CrossRefGoogle Scholar - 21.Fu Z. H., Wang J. F., Speech presence probability estimation based on integrated time-frequency minimum tracking for speech enhancement in adverse environments [A]. IEEE Int. Conf. Acoust., Speech, Signal Process., ICASSP [C], Dallas, Texas, USA, 2010: 4258–4261.Google Scholar
- 22.I Cohen, B Berdugo, Noise estimation by minima controlled recursive averaging for robust speech enhancement [J]. IEEE Signal Processing Letters
**9**(1), 12–15 (2002)CrossRefGoogle Scholar - 23.A Varga, H Steeneken, Assessment for automatic speech recognition: II. NOISEX-92: a database and an experiment to study the effect of additive noise on speech recognition systems [J]. Speech Comm.
**12**(3), 247–251 (1993)CrossRefGoogle Scholar - 24.ITU-T, Recommendation P.56: Objective measurement of active speech level, 1993.Google Scholar
- 25.SR Quackenbush, TP Barnwell, MA Clements,
*Objective measures of speech quality [J]*(Englewood Cliffs, NJ, Prentice Hall, 1988)Google Scholar - 26.ITU-T, Recommendation P.862: Perceptual evaluation of speech quality (PESQ), an objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs, 2001.Google Scholar
- 27.E. Vincent, 2005. MUSHRAM: a MATLAB interface for MUSHRA listening tests. [Online] http://www.elec.qmul.ac.uk/people/emmanuelv/mushram.
- 28.Loizou PC, Speech enhancement: theory and practice [M]. Boca Raton: CRC Press; 2007. 213–225.Google Scholar
- 29.IS Gradshteyn, IM Ryzhik,
*Table of integrals, series, and products [M]*, 6th edn. (Academic, New York, 2000)Google Scholar

## Copyright information

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.