Skip to content Skip to navigation

Connexions

You are here: Home » Content » Additive Colored Gaussian Noise Channels

Navigation

Content Actions

  • Download module PDF
  • Add to ...
    Add the module to:
    • My Favorites
    • A lens
    • An external social bookmarking service
    • My Favorites (What is 'My Favorites'?)
      'My Favorites' is a special kind of lens which you can use to bookmark modules and collections directly in Connexions. 'My Favorites' can only be seen by you, and collections saved in 'My Favorites' can remember the last module you were on. You need a Connexions account to use 'My Favorites'.
    • A lens (What is a lens?)

      Definition of a lens

      Lenses

      A lens is a custom view of Connexions content. You can think of it as a fancy kind of list that will let you see Connexions through the eyes of organizations and people you trust.

      What is in a lens?

      Lens makers point to Connexions materials (modules and collections), creating a guide that includes their own comments and descriptive tags about the content.

      Who can create a lens?

      Any individual Connexions member, a community, or a respected organization.

    • External bookmarks
  • E-mail the author

Recently Viewed

This feature requires Javascript to be enabled.

Additive Colored Gaussian Noise Channels

Module by: Don Johnson

Another important channel model occurs when the signal is uncorrupted save for the addition of Gaussian noise that is not necessarily white or stationary. We presume that correlation function of the noise is known. In particular we model the production of nt n t by passing white, Gaussian noise ωt ω t through a linear filter. (Figure 1)

Figure 1
Figure 1 (colormodel.png)

We can convert this detection problem to one we have solved. Namely assume the existence of a whitening filter h ω tτ h ω t τ that changes nt n t into a white process. Consider passing rt r t through this whitening filter. (Figure 2)

Figure 2
Figure 2 (whiten.png)
This procedure does not remove signal information as the whitening filter is reversible. We assume that R ω tu=δt-u R ω t u δ t u . We then have the detection of a known signal in white, Gaussian noise. We have solved this problem previously and know the minimum P e P e receiver computes the quantity ln π i +< Q n ,r>-si Q n 22 π i Q n r s i Q n s i 2 2 where < Q n ,r>=rt s i u Q n tudtdu Q n r s i u t r t s i u Q n t u and Q n tu= h ω αt h ω αudα Q n t u α h ω α t h ω α u . Consequently, all of the issues and solutions involved with the dispersive channel problem arise here. For example, antipodal signals are optimum. However, we shall see that there is a possibility of having communication over a noisy channel with no error!

Note:

The inner product term < Q n ,r> Q n r s i can be written as a matched filter.

rt s i u Q n tudtdu=rt g i tdt u t r t s i u Q n t u t r t g i t where we define g i t g i t as s i u Q n tudu u s i u Q n t u . To find g i t g i t more directly, we note that the correlation function of the output of the whitening filter is given by h ω tα h ω uβ K n αβdαdβ=δt-u β α h ω t α h ω u β K n α β δ t u Convolving both sides of this equation with h ω tv h ω t v , we have h ω tvdt h ω tα h ω uβ K n αβdαdβ= h ω uv t h ω t v β α h ω t α h ω u β K n α β h ω u v Interchanging the order of integration results in h ω uβ Q n αv K n αβdαdβ= h ω uv Q n αv K n αβdα=δv-β β h ω u β α Q n α v K n α β h ω u v α Q n α v K n α β δ v β Because of this property, we can have that for any choice of φ i t φ i t φ i β Q n αv K n αβdαdβ= φ i v β φ i β α Q n α v K n α β φ i v Let φ i t φ i t denote the eigenfunctions of K n αβ K n α β . In this case, by interchanging integration order, we find that Q n αv φ i αdα=1 λ i φ i v α Q n α v φ i α 1 λ i φ i v Consequently, eigenfunctions of K n K n are also eigenfunctions of Q n Q n , and the eigenvalues are reciprocals of each other. Q n Q n is thus termed the inverse kernel of K n K n . Using Mercer's Theorem, K n tu= λ i φ i t φ i u K n t u λ i φ i t φ i u Q n tu=1 λ i φ i t φ i u Q n t u 1 λ i φ i t φ i u Recalling the defining equation for g i t g i t , multiplying by K n tβ K n t β and integrating

K n tβ g i βdβ= s i u Q n βu K n tβdudβ= s i udu Q n βu K n tβdβ β K n t β g i β β u s i u Q n β u K n t β u s i u β Q n β u K n t β (1)
As Q n ·· Q n · · is the inverse kernel of K n ·· K n · · the last integral equals an impulse, and the impulse response g i t g i t of the optimum receiver's matched filter is the solution of the integral equation K n tβ g i βdβ= s i t β K n t β g i β s i t Despite the fact that this is an implicit equation for g i t g i t , it is easier to solve than the explicit equation given above. The reason is that one is usually given the noise covariance function rather than its inverse kernel.

Generally, one assumes the covariance function of the noise to be K n tu= N 0 2δt-u+ K c tu K n t u N 0 2 δ t u K c t u where K c tu K c t u denotes the colored noise component of K n tu K n t u [ K c tu K c t u has no impulses]. The equation for g i t g i t becomes

N 0 2 g i t+ K c tu g i udu= s i t N 0 2 g i t u K c t u g i u s i t (2)
This expression is the Fredholm integral equation of the second kind. If N 0 =0 N 0 0 (no white noise), we have the Fredholm integral of the first kind. Assume that nt n t is stationary; this situation implies that its covariance function has the form K n tu= K n t-u= N 0 2δt-u+ K c t-u K n t u K n t u N 0 2 δ t u K c t u As we shall see, the absence or presence of the white noise term (i.e., does 𝒮 n f0 𝒮 n f 0 as f f or not) has a pronounced effect on the nature of g i t g i t . In general, if N 0 =0 N 0 0 , the solution will contain impulses, and, furthermore, the performance of the receiver will be very sensitive to assumptions one makes about the noise. If N 0 0 N 0 0 , the character of g i t g i t changes completely: Answers make more sense, and the results are "nicer."

To make these considerations more precise, we consider the important special case where 𝒮 n f 𝒮 n f is a rational function. 𝒮 n f=N2πf2D2πf2 𝒮 n f N 2 f 2 D 2 f 2 where N· N · and D· D · are polynomials. Because 2πf 2 f is associated with the derivative in the time domain, we see that K n τ K n τ satisfies the differential equation:

D-p2 K n τ=N-p2δτ D p 2 K n τ N p 2 δ τ where pddτ p τ , p2d2dτ2 p 2 τ 2 , p3d3dτ3 p 3 τ 3 , etc. Now, we wish to solve s i t=0T K n t-u g i udu s i t u 0 T K n t u g i u Multiplying by D-p2 D p 2 , with pp representing taking a derivative with respect to tt, D-p2 s i t=0TD-p2 K n t-u g i udu D p 2 s i t u 0 T D p 2 K n t u g i u Using the differential equation given previously that the noise covariance function must satisfy, we find that,

t,0tT:D-p2 s i t=0TN-p2δt-u g i udu=N-p2 g i t t 0 t T D p 2 s i t u 0 T N p 2 δ t u g i u N p 2 g i t (3)
Consequently, the solution to our integral equation can be found by solving this differential equation. The solution consists of the particular solution g i P t g i P t and the homogeneous solution of N-p2 g i t=0 N p 2 g i t 0 .

Note:

When the observation interval is finite, the solution may also contain impulses at the boundaries.
Letting nn denote the order of the numerator polynomial and mm the order of the denominator, the solution has the form gt= g P t+i=12n a i g i h t+k=0m-n-1 b k δ k t- T i + c k δ k t- T f g t g P t i 1 2 n a i g i h t k 0 m n 1 b k δ k t T i c k δ k t T f If the impulses are not included, the original integral equation may not be satisfied; this situation occurs when N 0 =0 N 0 0 . When N 0 0 N 0 0 , the impulses are no longer necessary.

Additional "funny things" happen when N 0 =0 N 0 0 . If, for example, an antipodal signal set is used, s0-s1Q2=4s0Q2=j=1 s 0 j 2 λ j c + N 0 2 Q s 0 s 1 2 4 Q s 0 2 j 1 s 0 j 2 λ j c N 0 2 where λ j c λ j c is an eigenvalue of K c tu K c t u . When N 0 0 N 0 0 , s 0 j 2 λ j c + N 0 2 s 0 j 2 N 0 2 s 0 j 2 λ j c N 0 2 s 0 j 2 N 0 2 , which means that this distance will always be finite. On the other hand, if N 0 =0 N 0 0 , s 0 j 2 λ j c s 0 j 2 λ j c may not converge. In such cases, the signals are infinitely far apart with respect to the distance measure induced by the inverse kernel, and the probability of error is zero! Generally speaking, such behavior is not obtained in actuality. White noise is usually present in the front end of a receiver.

Example 1

The colored noise component has power density spectrum and covariance function given by 𝒮 c f=2αββ2+2πf2 𝒮 c f 2 α β β 2 2 f 2 K c τ=α-β|τ| K c τ α β τ The differential equation to solve when N 0 =0 N 0 0 becomes -d2dt2 s i t+β2 s i t=2αβgt t 2 s i t β 2 s i t 2 α β g t Obviously, we have an explicit equation for gt g t , meaning that g h t=0 g h t 0 . Adding in the impulses and substituting back into the integral equation, the total solution is gt=12αββs0-s0δt+βsT-sTδt-T+β2st-st g t 1 2 α β β s 0 s 0 δ t β s T s T δ t T β 2 s t 2 s t Note that if st s t is discontinuous, we have doublets in the signal gt g t ! If, however, N 0 0 N 0 0 , the differential equation becomes N 0 2-d2dt2g+γ2gt=-d2dt2s+β2st N 0 2 t 2 g γ 2 g t t 2 s β 2 s t where γ2=β2+4αβ N 0 γ 2 β 2 4 α β N 0 . Therefore, g h t= a 1 -γt+ a 2 γt g h t a 1 γ t a 2 γ t and there are no impulses! Consequently, one usually assumes the presence of some white noise to refrain from obtaining rather bizarre answers.

Comments, questions, feedback, criticisms?

Send feedback