Roundof F-Noise Analysis Fixed-Point Digital Filters Realized in Cascade or Parallel
Roundof F-Noise Analysis Fixed-Point Digital Filters Realized in Cascade or Parallel
Roundof F-Noise Analysis Fixed-Point Digital Filters Realized in Cascade or Parallel
I[ 1
for p 2 1 are then derived, where F([ is the L, norm of
the response Fil(w) defined by
-
this scaling should reduce the magnitude of Fi’(w) no more
than is required (orincrease it as much as possible, as the
case maybe). In otherwords, Fi’(w) should actually
satisfy u In)
IlFi’Ilp = 1. (5)
This condition willbe satisfied if the scaling factors si,
defined by
Fi’(U) = SiFi(U), (6%)
are given by
si = 1/llFil\p* (6b) Fig. 1. Generaldigital-filter model.
The sealing for parallel from2P is shown in Fig. 3. The in the multipliers. In particular, scaling may be restricted
transfer function H*(z) for this formis also given by (lo), t o powers of 2 in a binary system, in which case the over-
except that thescaling multipliers pli are replaced by all transfer function can be maintained exactly and no
extramultiplicationhardware is required (just shifting
pzi = 1/2PSi = / j P P F i / j p (134
operations). In this case, ( 5 ) is not satisfied generally, but
and now, of course, we can ensurethat
2yki‘ ZYki/P2i k = 0, 1. (13b) 3 < j/Fi’llP I 1. (15)
Thetransfer responses to theform-2Pbranchnodes Since such finite-accuracy considerations arenot expected
marked by (*) are to influence significantly the noise comparisons to follow,
wewill assume forthepurpose of analysis that ideal
scaling is performed as indicated in (1 1) and (13), and thus
that ( 5 ) is indeed satisfied.
The roundoff-noise output fromeach of the two paral-
where
lel forms is readily analyzed, as one would expect, be-
Yi”’(2) = yli’x-’ + yoit cause this output noise is simply the sum of the noise pro-
duced by the individual second-order sections comprising
and thus Z ~ F i ’ (indeed
~) satisfies ( 9 , as required. the filter. Referring to Fig. 2, the transfer responses
Note that in form 1P the scaling is accomplished via the Gj’(w) for form lP, corresponding to the roundoff-noise
pli multipliers and is then compensated for in the ykil inputs e&), are easily seen to be
multipliers; whereas in form 2P, the scaling is performed
in the Y k i ’ multipliers and is then compensated for in the
pzi mutlipliers. Note also that scaling has increased the
required number of constant multipliers in these parallel
IPGM+~’(w) = 1.
forms to 2N+M+ 1 from 2N+ 1, in the general case. We
will find that this applies to the cascade forms as well. Assuming that the coefficients P k j , lykjl, and plj for all
Practically speaking, however, it is assumed that in most k and j are nonintegers, the weights kj’ corresponding to
cases scaling will be performed with only a few (extra) bits the Gj’(w) are simply
i (25)
Using the fact that M = [(N+1)/2], (17) is readily shown
to satisfy (18).
We next note that N = M+ [N/2] and hence that
The effect of scaling on the transfer responses l p G i / ( ~ )
is seen by substituting (1 1) into (16) to yield
(26)
Therefore, defining
or, from (12), X l ( W ) = uo2
j = I, 2 , . . . , M. (22a) whereas
j=1
4
JP~
Ii-'12.
I ! -1yj
11
1
2'I
P I ~j
1,
1 2
(30b)
response for the input e.,l+l(n) is, of course, just
Hence, letting
2pG.~+{ (w) 1 (22b)
as in (16). (31)
The noise weights kj' for form 2P are
2PlCj' = 4 j = 1 2 ' . ,Jl- 1
, l ' we have the followingsimpleresult forthe case p =q = 2:
2pk.v' = 4 - 2 [ 2 x - N ] (23) < [ N / 2 ]* form 2 P
(32)
*pk.,;+I = x+1
and again (23) is readily shown to satisfy (18). The total Note, however, that for p =2, the output noise variances
roundoff noise in the output of form 2Pis then IINylilfor these two forms candiffer at most by a factor of
I
Because of the very peaked nature of l/Pj (a) relative to 1
1y j ( w ) / , we maythenapproxi.mate the L, norm of
y j ( w > / P ~(a)by
However, in the scaled versions of forms ID, I= 1,2,
H*(z) is realizedas
(34)
1010’ = lDsl
Hence, in this case
1Dsi+l
pnej wej (35b)
lCYyi*’(Z) = -a;*(z) i = 1,2, * * * ,M ;
lDsi
1
actually compare bounds on IN,lloofor forms 1P and 2P, 2DSM
ratherthanexpressionsorapproximations
itself. Although comparisons based on bounds
do not, of course, necessarily hold for
for
l~lV,~lc0
l Nvllm
for Nv , The correspondingtransfer responses to the branchnodes
itself, experi- marked by (*) are then
mental results supporting the application of these com-
parisons to llN,ll ,are presented in a latersection.
Again employing Nl(w) as defined by (27) in (20) and
(24), the following bounds on the L, norms of N,(w) for
forms 1P and 2P are readily obtained: Z D F i ’ ( a ) = ZDSi
Cxj(W)
__ n
j=1 P j ( w )
i = 1,2, * ’ * ,&I
I U I
I
II F((w1- I +Gk(U+---q
The transfer responses (?/(a)for form 1D are given by ,&’,’(u) i s seen by substituting the expressions for laal(u)
in (38) into (40), which yields
j=1,2,.*-,M.
The transfer response for the input eM+l(n)is, of course,
just
ZDGM+~’(W) == 1. (45b)
(49)
The noise weights kj’ for form 2 0 are
2Dkjl=5 j=1,2,.-.,M-l
where we have employed the fact that
2DkM’ =5 - 2[2M - N ] (46)
2DkM+< = 1. 2Dt kM-Z+; = 2Dkl’ 1 = 1, 2, * * ‘ , fl!f.
The variance, or total average power, of the output Comparing ]lNu]llfor form 1D as given in (47a) with
roundoff noise from forms 1D and 2 0 is derived from that for form2 0 , in (49), we see that these twoexpressions
(1) and (42) through (46) to be differ in only two respects: first, the functions appearing
in the Lp and Lz norms are reversed; and second, the kj’
M
correspond to forms 1 D and2 0 , respectively. From (41)
11 lDNvII1 = 60’ { l D k M + l ) f a0 lDk/
and (46), the kj’ for these two forms are related in the
following way:
1Dkl’ = 2Dk< -2
1Dkj‘ = z~kj’ j = 2, 3, * * , l%f - 1
1DkM’ = ZDkM’ + [2hf - N ] (50)
sections of the cascade forms, we may here compare the In particular, then,
noise output from form 1D with that from form 2 0 or
2Dt. We will find it most convenient to consider form 2 0 ,
in the case of p = 2. Denoting the numerator and denom-
inator factors of the Dt forms by ait(.) and pit(#), respec-
for p = co and q=2.
tively, we then note that
Although it wasespecially convenient to compare form
pit((.) = PM-~+~(w) i = 1, 2, * * * ,M 1D with form 2 0 , in the case of p-2, another useful
ROUNDOFF-NOISE
JACKSON: FOR ANALYSIS FIXED-POINT DIGITAL FILTERS 113
comparisoncan be made using form 2 0 when p = 03. IlNYll,
Noting that r=l r - m
JACKSON:ANALYSIS
ROUNDOFF-NOISE DIGITAL
FOR FIXED-POINT FILTERS 115
Having considered the sequential orderingof the section t‘”‘”
responses ai(w)/pi(w), we now addressthe question of how
best to pair the numerator factors ai(w) with the denom-
inator factorsp(i.) to produce theseresponses. There are,
of course, many cases where this question does not arise
including, for example, the cases of Butterworthor
Chebyshev (type-1) low-pass or high-pass filters, where all
zeros occur at z= 1 or z= - 1 (assuming that the bilinear
z transform has been employed). In these cases the ~ ( w ) Fig. 9. Proper
pairing
of
poles
and
zeros
in cascade
form
for
sixth-order
are equal for all i (except for one first-order factor when
band-rejectionfilter.
N is odd), and there is no choice to be madein pairing the
a i ( w ) and pi(.) (assuming that the first-order factors, if
present, are paired together).
When the second-order factors a,(w) are notequal, how-
Fig. 10. Properpairing of polesandzerosincascadeformfor
ever, there is almostalwaysa significant effect on the sixth-order bandpars filter.
roundoff-noise output due to the pairing of these factors
t
with the pi(.). The reason i s apparent from (54) and ( 5 9 , Irn(z1
ao=0.76091619;
yo=1.3142206
Section
1 1‘ 2’
0,75829007 P0.84506679
li 0.90352914
Pli .7636952 - 1
-1.5334490
-1.4427789 - 1.7636952
-1,4427789
01% 1 .o 1 .o 1 .o 1 .o 1 .o
aii -1.8118373 - 1.6545862 -1
.7442502 - 1.6545862 - 1.8118373
7 cci/Pi j m
1.65
Ilai/fiAi* 1.280
1 ,056 .602 1.076 1 1 ,066
7 Pi 1.56 2.11
Yli 0.09494903 0.17123073 - -
Yoi -0.28023324
-0.10898306 -0.16408810 - -
-.
-10.00
p= m p =2 p= m p =2
-3 -20.00
F1 F2
....................................
Parallel
F1 F2
F2
1
Ft F1 F2
2
[ -30.00
(P)Forms 24.1*
25.2
13.8**
14.3 35.6*
37.0
23.0%
24.4
-400
.0 ( D ) Forms
(123)
(321)
34.2
23.5** 22.1
21.0
2320413..42.86*
22.7**
34.8
34.8 31.2
32533.367.50. 0. 0
(213) 33.6
23.5”
21.3
22.4 32333.357.63. 0. 0
-50.00
0. looo. 2000. 3000. 4000. 5000. (312) 21.7
(231)
22.0
23.8
34.0
20.3*
24.5
23.8
31.6 36.0
23.3
3 5 . 0 32.5
37.0
35.0
23.1
35.5
( B)
2 w . 0 , , , 1 , 1 1 1 1 , ,
v
5 22.00
20.00
g 18.03
2 166.00
B 14.03
I *-Oo
2 10.00
8.00
0. 1ooO. 2ooO. 3003. 4ooo. 5000.
FREQUENCY ( H Z )
( 4
28.03
2 24.03
1i 20*00
@ 120.0
16*00
3 8.00
E l I / / ' I I I
4 . 0 3
c3003.
. 2000.1003.
t ~ ~ ~ 4ooo.
1 ~ 5000.I I
FREQUENCY (Hz) FREQURiCX ( H z )
(W (B)
Fig. 12. Predicted
roundoff-noise densities for sixth-order Fig. 13. Predicted
roundoff-noise densities for sixth-
BRF in parallel forms 1P (A) and 2P (B) with p = m . order BRF in parallel forms 1 P (A) and 2P (B) with p = 2.
[A)
400.0 ( 4
5
v
E 30.00
z 20.00
B
k
, I
I 1 1 I ,
0.00
0.
/ 1o/oO. / ! / 3000./ I 4000.I /
2000. 5000.
mqmm ( H z )
(B)
(1’2’3)
(32’1’)
3226283.0.5.3.96
27.7*
29.619.9*
37.7*
24.9
28.1
40.4
1 39.4
37.7*
26.7*
29.0
37.6
(2’1’3) 27.6*
23.8
30.7
20.4 35.8
28.0
39.8
38.2
(31’2’) 20.9
23.5
28.235.8 30.6
27.1
38.4
39.5
(2’31’) 28.4
21.6
32.932.5 4462. 0. 1 31.2 41.6
(1’32’) 2237. 401. 91. 3. 1 32.9
32.6
42.1
45.8
Section 1 is last, in agreement with the general rules in 1 D,however, the Fi(w)are not wide-band, and the nois-,
Fig. 7. This relative insensitivity to ordering is explained densities are, therefore, muchless for p = 2 than for p = co
by the relatively small variationin Pi for Sections1,2, and due to scaling.
3, as given in TableI. As an example ofthe effect ofproper pole-zero pairing,
The largest differences in the predicted N,llT for the 11 we now consider the corresponding results for the BRF
BRF occur between forms 1D and 2D when p # r+ 1 and when the pairings of the ai(@) and pi(w) for Sections 1 and
between the P and D forms when p = r+ 1 = 2. Note from 2 are reversed to form Sections 1’ and 2’. The resulting
Table I1 that these differences are of the order of 7 to 12 11 1
Nu/ are given in Table I11 for all orderingsof the cascade
dB. In agreement with Fig. 6, form 2 0 is superior for forms. As before, the ordering (1’2’3) corresponds to
r # p = 00,while form 1D is best when p # r = co . Parallel decreasing Pi,but now the variationin Piis much greater.
form 1P is comparableto the best cascade form for each Note that the results in Table I11 are in complete agree-
p , r pair except p = r+ 1=2, where it (1P) is definitely ment with the general rules in Figs. 6 and 7 concerning
superior. form and ordering.
The above differences in [lNul],are readily apparent Our main point is, however, that the lowest llN,I[,. for
from the predicted densities in Figs. 12 through 15. Figs. each p , r pair in Table 111 is significantly greater (3 to 4
12 and 13 showthe predicted N,(w) for the parallel forms, dB) than that for the cascade forms in Table I1 in every
and Figs. 14 and 15 givethe predicted N,(w) for the (123)- case except for p = r+ 1=2. And in the latter case, the
ordered cascade forms.Note that theshapes of the form- results are comparable. Hence, proper pole-zero pairing
2 0 densities are very similar to those for the P forms. In is indeed important in the synthesis of this digital filter,
particular, the densities for form I D resemble the wide- as expected.
band response of the BRF itself, whereas those for forms The results of four representative FSP simulations of
20, lP,and 2P are narrow-bandin character and achieve the sixth-order BRF are presented in Table IV and Figs.
their peak values in the BRF stopband. 16 through 19. The cascade-form results correspond to
WithLI scaling ( p = co) the peak values llN,/lm are the (123) ordering (with proper pole-zero pairing). The
comparable in every case, but because of the wide-band scaling appropriate to the input signal is employed (i.e.,
character of I~Ny(w), the total power I] Null for form 1 D p = 00 for sinusoidal inputs and p = 2 for white noise).
is much greater than for the other forms. For L2 scaling The inputsignal amplitudes, peakoutput roundoff errors,
( p = 2), however, the peak density for form D1 is much less estimated error means, and peak signal levels at overflow-
than for form 2 0 although their total noise powers are constrained branch nodes arelisted in Table IV in quanti-
very comparable. The peak density for parallel form 1P zation-step units (assuming rounding to the nearest inte-
is almost the sameas for form 1D when p = 2, but because ger). The estimated and predictederror variances are
of its narrow-band character the total noise power for the given in decibels relative to No. Parzen lag windows have
parallel form ismuch less in this case. been employed in each case.
Another implication of the wide-band response of the Note first of all the excellent agreement between the
BRF is that theform-2D noise densities are notmuch less estimated noise densities in Figs. 16 through 19 and the
for p = 2 than forp = cc , in contrast with otherexamples correspondingpredictions in Figs. 12(A), 13(A), 14(B),
presented in [l]. The reason for this is that the transfer and 15(A), respectively. For example, note that the peak
responses F2(w)are all wide-band in this case, and hence densities and those at dc and 5000 Hz agree quite closely
the scaling for wide-band inputs( p = 2) is not muchdiffer- with their predictedvalues, The estimated error variances,
ent from that for narrow-band inputs ( p = a). For form or average noise powers, in these cases are all within 0.9
JACKSON: ANALYSIS
ROUNDOFF-NOISE DIGITAL
FOR FIXED-POINT FILTERS 119
(4
0
0.
.
1000.
0
2000.
0
3000. 4ooo.
1 ~
5000.
~ ~ ~ ~ ~ ~ ~ ~
FREQUENCY (Hz)
(B) (B)
TABLE 1V
Simulation Sixth-Order
of Chebyshev-2 Band-Rejection
Filter (2048
Samples)
___ _____
Pre-
Syl- Form Input
Ing
Am- Fre-
pli- quency
tude or PF
Peak Error
Error ance
Mean
F:ri $$!
Peak
ante Data
(PI (**) (dB)
LI 1P 1024
sine 1369Hz
15.54
-0,0253
24.16
24.1 372
L2 1P 1024
noise 1076
0.0218
4.545
13.8
13.45
4.0
LI 20 1024
sine 1369Hz
17.99
-0.284
24.42
23.5 1025
L2 1D noise 1024 11.88
0.0707
22.05
22.1
4.0 909
..___
dB of their predicted values. This agreement is perhaps at overflow-constrained branchnodesare close to the
surprising in the first and third cases because the input input signal amplitude (1024). The one case (form 2 0 ,
signal is a single sinusoid (at 1369 Hz) and significant LI) where the peak data exceeded1024 (plus the peak
correlation might be expected in theoutput roundoff error) resulted from the residual transient remaining in the
error as a result. However, the correlation in the indi- data after the 200-sample initialization period.Otherwise,
vidual roundoff-error inputs seems to average out in the the overflow constraints appear to have been satisfied i,n
total output from thefilter. Cases can, of course, be gen- all cases.
erated with significant correlation being apparent in the
form of harmonics of the sinusoid [I], but these cases are
Summary
the exception, not the rule.
There is also good agreementbetween our analytical The roundoff-noise outputs from two transpose con-
results andother measured data.The estimated error figurations each for the cascade and parallel forms of a
means are very close to zero in all cases, and the peak data digital filter have been analyzed and compared using the
120 ELECTROACOUSTICS
AND AUDIO IEEEON
TRANSACTIONS JUNE 1970
(6) (6)
40.00 28.00
-8
2 30.00 h
8 24.00
v
8 20.00
8
20.00
16.00
i
s8
E
10.00
O*O0 1 1 1
I
BE
l2.00
8.00
4.00
-10.00 o. 1000. 2000. 3000. 4000. 5000. 0.00
0. 1000. 2000. 3000. 4000. 5000.
FREQUENCY (Hz) FREQuEir’CY (Hz)
Fig. 18. Estimateddensities offilter output and roundoff Fig. 19. Estimateddensities of filter output androundoff
noise from simulation of sixth-order BRF in cascade form 2 0 noise from simulation of sixth-order BRF in cascade form 10
with 1 3 6 9 - H z input, p = m. (A) Actuol filter output including with white-noise input, p = 2. (A) Actuol niter output including
roundoff error. (6) Roundoff errror in actual fllter output. roundoff error. (6) Roundoff error in octuol niter output.
techniques developed in [2]. The spectrum of the output sons based on the bounds in (60), rather than on lINylIw
roundoff noise from these four configurations has been itself, have been justified by the excellent experimental
shown to be of the form agreement reported here and in [ 11. A heuristic discus-
sion of the sequential ordering and pole-zero pairing of
the cascade-form sections has also been presented on the
basis of (59) and (60). From these results, the following
general “rules of thumb” may be stated.
1) Parallel form 1P is generally preferable to form 2P,
where Fi(w) is the (unscaled) transfer response from the
although the maximum difference in l/NullTfor these two
input to the ith branch node, G j ( w ) is the (unscaled) trans-
forms (for a given p ) is only of the order of 4/3, or 1.25
fer response from thejth summation node to the output,
dB.
kj’ is the number of noise sources inputting (directly) to 2) For p = r+ 1 there is little difference in IINy/i, be-
thejth summation node,M is the numberof second-order
tween any given form-1Dconfiguration andthecor-
sections comprising the cascade or parallel form, and go2
responding transpose configuration (form 2Dt).
is the varianceof the noise from each rounding operation.
3) For p # r + l , however, cascade form2 0 is generally
Hence, the variance, or total average power,of the output
superior to form 1D for p = M , and vice versa for r = c4 ;
roundoff noise is simply
and the difference can be quitesignificant.
4) Good(butnot necessarily optimum) sequential
orderings forthe M sections of the cascade form areindi-
cated in the chartsof Figs. 7 and 8, where they are stated
in terms of the variation in
11 1
while the peakspectral density Nu]oo is bounded by
= l;w/ l;
with increasing i.
Correspondingtransposeconfigurationshave been 5) Thenumeratorfactors ai(w) and
denominator
compared on the basis of (59) and (60), and the compari- factors pi(.) of the cascade D forms should be paired so
ANALYSIS
ROUNDOFF-NOISE
JACKSON: FILTERS DIGITAL
FOR FIXED-POINT 121
as to minimize the individual liai/pi!i a, insofar as this is period T and/or is of insufficientmagnitude 111. The gen-
possible. eral rules concerning circuit configuration have also been
The analytical results obtained do not provide ageneral found to be very helpful and effective.
rule relating to the choice between parallel form 1P and
one of the cascade D forms. The experimental results do
References
indicate, however, that form 1P is usually comparable to
or somewhat better than the best D form(s). Therefore, 111 L. B. Jackson, “An analysis of roundoff noise in digital filters,”
Sc.D. dissertation, Dept. of Elec. Engrg., Stevens Institute of
from the viewpoint of roundoff noise alone, the simplest Technology, Hoboken, N. J., 1969.
and most reliable choice of a digital-filter configuration [2] ---, “On the interaction of roundoff noise and dynamic range
would seem to be parallel form 1P. However, the cascade in digital filters,” Bell Sys. Tech. J., vol. 49, no. 2, February
1970.
D forms often have other advantages which make them [3] R. Edwards, J. Bradley, and J. B. Knowles, “Comparison of
most desirable [SI, especially when the zeros of H*(z) lie noise performance of programming methods in the realization
on the unit circle (1 zI = 1). In these cases, the D-form of digital filters,” Proc. Symp. on Conzputer Processing in Com-
nzunicatiorzs, PIB-MRI SymposiaSer.,vol. 19, 1969.
options of form, sequential ordering, and pole-zero pair- [4]C. Weinstein and A. V. Oppenheim, “Acomparisonof roundoff
ing contained in (2) through (5) must be considered. noise in floating point and fixed point digital filter realizations,”
Finally, two computer programs written to implement Proc. E E E (Letters), vol. 57, pp. 1181-1 183, June 1969.
[5] J. R. Rice, TheApproximation of Functions. Reading, Mass.:
and test the analytical results have been briefly described. Addison-Wesley, 1964, pp. 4-10.
A representative example has been included to illustrate [6] C. M.Rader and B. Gold, Digital Processtng of Signals. New
the operation of these programs and, more importantly, York: McGraw-Hill, 1969.
[ 7 ] J. F. Kaiser,“Digital filters,” in SystemAnalysis by Digital
to demonstrate the effectiveness of the analysis and syn- Computer, F. F. Kuoand J. F. Kaiser, Eds. New York:
thesis procedures upon which they are based. These ex- Wiley, 1966, ch. 7 , pp, 218-285.
perimental results indicate thatthe uncorrelated-error [8] L. B. Jackson, J. F. Kaiser,and H. S. McDonald,“Anap-
proach to the implementation of digital filters,” ZEEE T r a m
analysis is quiteaccurate, even for sinusoidal inputs, Audio and Electroacoustics, vol. AU-16: pp. 413-421, September
unless the input is periodic in a multiple of the sampling 1968.
€3.
Leland Jackson (S162-M’65) wasborn in Atlanta, Ga.,on July 23, 1940. He received
the S.B. and S.M. degrees in 1963 from the Massachusetts Institute of Technology,
Cambridge, and the Sc.D.degree in 1970 from Stevens Institute of Technology, Hobo-
ken, N. J., all in electrical engineering.
In 1961 and 1962 he was associated with BellTelephone Laboratories, Inc., under the
M.I.T. cooperative program in electrical engineering. From. 1964 to 1966 he was em-
ployed by Sylvania Electronic Systems, Inc., Mountain View, Calif., where he studied
and developed signal processing techniques for ionospheric research. From 1966 to
1970 he was a member of the technical staffofBell Telephone Laboratories, Inc.,
Murray Hill, N. S.,where he was primarily concerned with the analysis and synthesis
of digital filters. In 1970 hejoinedRockland Systems Corp., Blauvelt, N. Y.,as
Vice President for Engineering.
Dr. Jackson is a member of Tau Beta Pi, Eta Kappa Nu, andSigma Xi.