11
IEEE TRANSACTIONS ON CIRCUITS ANDSYSTEMS—I: REGULAR PAPERS, VOL. 53, NO. 5, MAY 2006 1119 Matrix Decomposition and Butterfly Diagrams for Mutual Relations Between Hadamard–Haar and Arithmetic Spectra Bogdan J. Falkowski, Senior Member, IEEE, and Shixing Yan, Student Member, IEEE Abstract—The mutual relationships between Hadamard–Haar and Arithmetic transforms and their corresponding spectra in the form of matrix decomposition as layered vertical and horizontal Kronecker matrices are discussed here together with their proofs, fast algorithms, and computational costs. The new relations apply to an arbitrary dimension of the transform matrices and allow performing direct conversions between Arithmetic and Hadamard–Haar functions and their corresponding spectra. In addition, analysis of butterfly diagrams for these new relations is also introduced and it is shown that they are more efficient than the matrix decomposition method. Index Terms—Arithmetic transform, discrete transforms, fast transforms, Hadamard–Haar transform, spectral techniques. I. INTRODUCTION D URING THE LAST decade there has been increasing interest in applications of different transforms used in dig- ital signal processing for spectral analysis, synthesis and testing of discrete functions [1]–[16]. The recent interest in application of various transforms in electronic design automation (EDA) is also caused by development of efficient methods of their calcu- lation [1]–[19]. Discrete orthogonal Walsh-like transforms such as Walsh transform, Haar transform, Hadamard–Haar trans- form, and others like the discrete transform, slant transform and Fourier transform, have been used in data transmission, multiplexing, filtering, speech processing, image enhancement, pattern recognition, control theory, communication systems, statistical analysis, solving differential equations, and the analysis, synthesis, classification and testing of logical circuits [1]–[16], [20]–[23]. Discrete Haar transform is the simplest example of wavelet expansion and attracts much attention in engineering practice for its peculiar properties [4], [10]–[12], [15]–[19]. Due to its low computing requirements, the Haar transform has been mainly used for pattern recognition and image processing [16]. For real time applications, hardware-based fast Haar chips have been developed [16]. A brief discussion of various other applications, where the use of Haar and Walsh functions offers some advantages compared to the Fourier transform, is given in [16]. The authors of [22], presented a set of EDA tools to perform a switch-level fault detection and diagnosis of physical Manuscript received December 6, 2004; revised May 6, 2005, and August 14, 2005. This paper was recommended by Associate Editor M. Chakraborty. The authors are with the School of Electrical and Electronic Engi- neering, Nanyang Technological University, Singapore 639798 (e-mail: [email protected]; [email protected]). Digital Object Identifier 10.1109/TCSI.2006.869899 faults for practical MOS digital circuits using a reduced Haar spectrum analysis. The advantage of using Haar functions instead of Walsh functions in EDA system based on spectral methods for some classes of Boolean functions was shown in [4], [16]. In [13], a method for probabilistically determining the equivalence of two switching functions through Haar spectral coefficients has been developed. The method is reported as an alternative for equivalence checking of function that are difficult to represent completely and is based on binary decision diagrams and Haar spectral diagrams [19]. The Arithmetic transform has the sets of basis functions that can be obtained from its inverse transform while the details of ap- plication of Arithmetic transform were shown in [1], [6]. Detailed relations between Arithmetic and Haar functions were given in [24]. Heidtman proposed an approach to derive the signatures for stuck-at faults in irredundant combinational networks by using Arithmetic coefficients of the Arithmetic polynomial expansion [2]. Rahardja and Falkowski [25] have shown that Arithmetic polynomial logic is advantageous over the standard zero polarity Arithmetic transform used by Heidtman in testing. In particular, it was shown in [25] that the number of spectral tests is significantly reduced for both stuck-at and bridging faults for the majority of the classes of digital circuits. The Hadamard–Haar transform is based on a hybrid version of the Haar and Walsh transforms [20]. This transform is de- rived from different linear combinations of the basis Haar func- tions with an appropriate scaling factor. Such a combination of basis functions have been found advantageous for feature selec- tion and pattern recognition. Another version of this transform named ‘Rationalized Hadamard–Haar transform’ has also been introduced [21]. Walsh transforms in Gray code ordering was in- troduced in [26] and different and efficient ways of generating such Walsh transforms have been presented. While majority of research has been done using Walsh transform [3], [4], [11], [15], [16], dependent on a case some transforms are better suited than others. Many authors have considered the mutual relationships between Haar and Walsh functions. The relations between normalized and nonnor- malized Haar and Arithmetic transforms were given without proofs in [24]. The equations for Haar transform and cor- responding butterfly diagrams were given in [19] while the relations between Hadamard and natural order Haar transform were presented in [14], [15]. Frequently it is advantageous to apply more than one transform in a given task based on the local properties of a data function [3], [4], [8]–[13], [15], [16], [19]. For example, if the logic function has many zeros 1057-7122/$20.00 © 2006 IEEE

Matrix decomposition and butterfly diagrams for mutual relations between Hadamard-Haar and arithmetic spectra

Embed Size (px)

Citation preview

Page 1: Matrix decomposition and butterfly diagrams for mutual relations between Hadamard-Haar and arithmetic spectra

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: REGULAR PAPERS, VOL. 53, NO. 5, MAY 2006 1119

Matrix Decomposition and Butterfly Diagrams forMutual Relations Between Hadamard–Haar and

Arithmetic SpectraBogdan J. Falkowski, Senior Member, IEEE, and Shixing Yan, Student Member, IEEE

Abstract—The mutual relationships between Hadamard–Haarand Arithmetic transforms and their corresponding spectra in theform of matrix decomposition as layered vertical and horizontalKronecker matrices are discussed here together with their proofs,fast algorithms, and computational costs. The new relationsapply to an arbitrary dimension of the transform matrices andallow performing direct conversions between Arithmetic andHadamard–Haar functions and their corresponding spectra. Inaddition, analysis of butterfly diagrams for these new relations isalso introduced and it is shown that they are more efficient thanthe matrix decomposition method.

Index Terms—Arithmetic transform, discrete transforms, fasttransforms, Hadamard–Haar transform, spectral techniques.

I. INTRODUCTION

DURING THE LAST decade there has been increasinginterest in applications of different transforms used in dig-

ital signal processing for spectral analysis, synthesis and testingof discrete functions [1]–[16]. The recent interest in applicationof various transforms in electronic design automation (EDA) isalso caused by development of efficient methods of their calcu-lation [1]–[19]. Discrete orthogonal Walsh-like transforms suchas Walsh transform, Haar transform, Hadamard–Haar trans-form, and others like the discrete transform, slant transformand Fourier transform, have been used in data transmission,multiplexing, filtering, speech processing, image enhancement,pattern recognition, control theory, communication systems,statistical analysis, solving differential equations, and theanalysis, synthesis, classification and testing of logical circuits[1]–[16], [20]–[23].

Discrete Haar transform is the simplest example of waveletexpansion and attracts much attention in engineering practicefor its peculiar properties [4], [10]–[12], [15]–[19]. Due toits low computing requirements, the Haar transform has beenmainly used for pattern recognition and image processing [16].For real time applications, hardware-based fast Haar chipshave been developed [16]. A brief discussion of various otherapplications, where the use of Haar and Walsh functions offerssome advantages compared to the Fourier transform, is givenin [16]. The authors of [22], presented a set of EDA tools toperform a switch-level fault detection and diagnosis of physical

Manuscript received December 6, 2004; revised May 6, 2005, and August 14,2005. This paper was recommended by Associate Editor M. Chakraborty.

The authors are with the School of Electrical and Electronic Engi-neering, Nanyang Technological University, Singapore 639798 (e-mail:[email protected]; [email protected]).

Digital Object Identifier 10.1109/TCSI.2006.869899

faults for practical MOS digital circuits using a reduced Haarspectrum analysis. The advantage of using Haar functionsinstead of Walsh functions in EDA system based on spectralmethods for some classes of Boolean functions was shown in[4], [16]. In [13], a method for probabilistically determining theequivalence of two switching functions through Haar spectralcoefficients has been developed. The method is reported asan alternative for equivalence checking of function that aredifficult to represent completely and is based on binary decisiondiagrams and Haar spectral diagrams [19].

The Arithmetic transform has the sets of basis functions thatcan be obtained from its inverse transform while the details of ap-plication ofArithmetic transformwere shown in [1], [6]. Detailedrelations between Arithmetic and Haar functions were given in[24]. Heidtman proposed an approach to derive the signatures forstuck-at faults in irredundant combinational networks by usingArithmetic coefficients of the Arithmetic polynomial expansion[2]. Rahardja and Falkowski [25] have shown that Arithmeticpolynomial logic is advantageous over the standard zero polarityArithmetic transformusedbyHeidtman in testing. Inparticular, itwas shown in [25] that the number of spectral tests is significantlyreduced for both stuck-at and bridging faults for the majority ofthe classes of digital circuits.

The Hadamard–Haar transform is based on a hybrid versionof the Haar and Walsh transforms [20]. This transform is de-rived from different linear combinations of the basis Haar func-tions with an appropriate scaling factor. Such a combination ofbasis functions have been found advantageous for feature selec-tion and pattern recognition. Another version of this transformnamed ‘Rationalized Hadamard–Haar transform’ has also beenintroduced [21]. Walsh transforms in Gray code ordering was in-troduced in [26] and different and efficient ways of generatingsuch Walsh transforms have been presented.

While majority of research has been done using Walshtransform [3], [4], [11], [15], [16], dependent on a case sometransforms are better suited than others. Many authors haveconsidered the mutual relationships between Haar and Walshfunctions. The relations between normalized and nonnor-malized Haar and Arithmetic transforms were given withoutproofs in [24]. The equations for Haar transform and cor-responding butterfly diagrams were given in [19] while therelations between Hadamard and natural order Haar transformwere presented in [14], [15]. Frequently it is advantageousto apply more than one transform in a given task based onthe local properties of a data function [3], [4], [8]–[13], [15],[16], [19]. For example, if the logic function has many zeros

1057-7122/$20.00 © 2006 IEEE

Page 2: Matrix decomposition and butterfly diagrams for mutual relations between Hadamard-Haar and arithmetic spectra

1120 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: REGULAR PAPERS, VOL. 53, NO. 5, MAY 2006

in its truth vector, it is better to apply local transform that hasnonzero entries in its own transformation matrix that almostoverlap with nonzero elements in the truth vector. In the lattercase, it is also of interest to investigate mutual relations be-tween various local discrete transforms such as, for example,Hadamard–Haar and Arithmetic transform. Therefore, it is notonly interesting theoretically, but also practically to state theirmutual relations. In this work, we extended our previous resultsfrom [27] by showing mutual relations between Arithmeticand Hadamard–Haar transforms, their proofs, fast algorithmsand computational costs for arbitrary transform size in theform of matrix decomposition and as layered vertical andhorizontal Kronecker product based matrices for an arbitrarytransform matrix order size. From the detailed references forall related transforms as given here, it is very clear that onlyfor the first time such mutual relations between Arithmetic andHadamard–Haar transforms are given in our article. In addition,due to the fact that the Hadamard–Haar transform covers bothWalsh and Haar transforms, our results and computational costscan be also used as proofs for relations between Walsh, Haarand Arithmetic transforms.

II. BASIC DEFINITIONS

In all equations inside this paper, the symbols and rep-

resent the Kronecker product [3], [4], [10], [11], [16] of andtwo matrices, respectively.

Definition 1: The Walsh transform matrix of order is de-fined as

(1)

Also (2)

Definition 2: The normalized Haar transform matrix of orderis defined as

(3)

where is identify matrix.The nonnormalized Haar transform is obtained from re-

placing the nonzero entries of normalized Haar matrix withtheir arithmetic signs. The nonnormalized Haar transformpreserves all the properties of the normalized Haar transform.Its matrix of order is defined as

(4)

Definition 3: The matrix of order for the Arithmetic trans-form is defined as

(5)

Also (6)

Definition 4: The th-order normalized Hadamard–Haartransform and its inverse are defined as [20]

and (7)

where is the Walsh transform matrix,is the normalized Haar transform matrix. The hy-brid transform of the Haar and Walsh transform is also orthog-onal.

Similar to Haar transform, the nonnormalizedHadamard–Haar transform can be obtained from re-placing the nonzero entries of normalized Hadamard–Haarmatrix with their arithmetic signs. Its matrix is defined as [21]

and (8)

III. RELATIONSHIP BETWEEN HADAMARD-HAAR AND

ARITHMETIC TRANSFORM

The following relations will be given only forHadamard–Haar and Arithmetic transforms. SinceHadamard–Haar transform is the hybrid of Walsh andHaar transform, the relations between Hadamard–Haar andArithmetic transforms can be derived from their definitions.

Property 1: Let and represent the Arith-metic and normalized Hadamard–Haar spectra. The mutual rela-tions between th-order normalized Hadamard–Haar and Arith-metic transforms for the general case of arbitrary are as fol-lows:

(9)

(10)

where (11) and (12), shown at the bottom of the next page aretrue, where , and .

In the above equations, and are matrices,the vertical dotted lines denote the layered vertical Kroneckermatrices, and the horizontal dashed lines denote the layered hor-izontal Kronecker matrices, respectively. A layered horizontalKronecker matrix is defined as the horizontal sum of Kroneckermatrices while a layered Kronecker vertical matrix is definedas the vertical sum of Kronecker matrices [24]. When the Kro-necker direct product of matrices is carried out for the above

equations for then the term disappears from the

above equations. The meaning of the symbols and the restric-

tion on the term is the same as above also for the following

equations.Proof: Let the vector in function domain be represented

by , we have: and. Hence

From (7), we can get the Arithmetic spectrum from normalizedHadamard–Haar spectrum as follows:

Page 3: Matrix decomposition and butterfly diagrams for mutual relations between Hadamard-Haar and arithmetic spectra

FALKOWSKI AND YAN: MATRIX DECOMPOSITION AND BUTTERFLY DIAGRAMS 1121

The inverse Walsh transform is known as:, and the inverse normalized Haar transform is

known as: where the superscriptis the matrix transpose operator. Using (2), (6), and the

inverse transforms, we have

According to the properties of Kronecker product, we have

(13)

...

...

...

...

...

...

...

(11)

(12)

Page 4: Matrix decomposition and butterfly diagrams for mutual relations between Hadamard-Haar and arithmetic spectra

1122 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: REGULAR PAPERS, VOL. 53, NO. 5, MAY 2006

where and

. Comparing (9), (11), and (13), we need to prove

for the proof of (9) whereand

............

............

The argument will be proved byinduction.

Basis: From (3), we have...

Hence, , then

Induction Step: Assume . From (6),we have

...

...

...

...

...

...

...

...

...

...

...

...

...

...

As is proved by induction, theproof of (9) is completed.

Similarly, we can prove (10). From the inverse Arithmetic

transform known as: where

, we can get the normalized Hadamard–Haar spectrum

from Arithmetic spectrum as follows:

(14)

where and

. Comparing (10), (12), and (14), we need to prove

for the proof of (10) whereand

The argument will be proved byinduction.

Basis: From (3), we have: , thus

Page 5: Matrix decomposition and butterfly diagrams for mutual relations between Hadamard-Haar and arithmetic spectra

FALKOWSKI AND YAN: MATRIX DECOMPOSITION AND BUTTERFLY DIAGRAMS 1123

Induction Step: Assume . We have

This completes the proof of (10).Example 1: For and , the relationships between

the normalized Hadamard–Haar and Arithmetic transforms canbe described by using Property 1. The corresponding and

are

...

and

Hence, the transformations between the normalizedHadamard–Haar spectrum where andArithmetic spectrum can be described by usingand as follows:

and

The relationships between nonnormalized Hadamard–Haarand Arithmetic transforms are shown in Property 2. The rela-tionships between nonnormalized Hadamard–Haar and Arith-metic transforms can also be derived similarly as the nonnormal-ized Hadamard–Haar transform is obtained from the normalizedversion by using signs only.

Property 2: Let represent the nonnormalizedHadamard–Haar spectra. The mutual relations betweenth-order nonnormalized Hadamard–Haar and Arithmetic

transforms for the general case of arbitrary are as follows:

(15)

and (16)

where (17) and (18) at the bottom of the next page, hold, where, and .

Proof: Similar to the proof of Property 1.

Since Walsh and Haar transforms can be seen as the spe-cial cases (when and ) of Hadamard–Haartransform, the Walsh and Haar domains are subdomainsof Hadamard–Haar domain. Hence, the relationshipsshown in Property 1 and Property 2 can be applied forWalsh, Haar and Arithmetic transforms as well. Forexample, the relationships between Walsh and Arith-metic transforms can be derived from (9) as follows:

andwhere is

the corresponding Walsh spectrum. The relationships betweennormalized Haar and Arithmetic transforms can be also derivedfrom (9) as follows:

and .Example 2: For and , the relationships between

the nonnormalized Hadamard–Haar and Arithmetic transformscan be described by using Property 2 as follows:

and

where the corresponding and are

...

and

IV. FAST ALGORITHMS

The fast algorithms for different discrete transforms havebeen developed to reduce the computational costs, such as fastFourier transform, fast Walsh transform, fast Haar transform,fast Arithmetic transform, fast Hadamard–Haar transform [3],[4], [10]–[12], [14]–[16], [20], [21]. The matrix transformationmethods between Hadamard–Haar and Arithmetic domainshave been shown in Section III. The fast algorithms for thetransformations between Hadamard–Haar and Arithmetic do-mains will be shown in this section.

Property 3: For the relations between th-order normalizedHadamard–Haar and Arithmetic transforms, andin Property 1 can be expressed by the products of factorizedmatrices as follows:

(19)

and (20)

where and are defined in (21) and (22), respec-tively, ,

, and are the same as in the proof

Page 6: Matrix decomposition and butterfly diagrams for mutual relations between Hadamard-Haar and arithmetic spectra

1124 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: REGULAR PAPERS, VOL. 53, NO. 5, MAY 2006

of Property 1, [see (21) and (22), shown at the bottom of thepage].

Proof: For , we have

Since where

...

we need to prove by inductive method for

...

...

...

...

...

...

...

(17)

(18)

for

... for

(21)for

for(22)

Page 7: Matrix decomposition and butterfly diagrams for mutual relations between Hadamard-Haar and arithmetic spectra

FALKOWSKI AND YAN: MATRIX DECOMPOSITION AND BUTTERFLY DIAGRAMS 1125

the proof of (19) where .

Basis: .

Induction Step: Assume . From the struc-

ture of , it can be noticed that

Therefore

...

...

This completes the proof of (19).Similarly, for , we have

Then we need to prove by induction for

the proof of (20) where

Basis: .

Induction Step: Assume .

Since , we have

This completes the proof of (20).Property 4: For the relations between th-order nonnormal-

ized Hadamard–Haar and Arithmetic transforms, the andin Property 2 can be expressed by the products of factor-

ized matrices as follows:

(23)

and (24)

where and are defined in (25) and (26), respec-tively, shown at the bottom of the page.

Proof: Similar to the proof of Property 3.The fast algorithms shown in Property 3 and Property 4 can

also be used for Walsh or Haar transform when is set to forthe first transform or 0 for the second transform.

Example 3: We can use the fast algorithms to factorizein Example 2 as follows:

for

... for

(25)for

for(26)

Page 8: Matrix decomposition and butterfly diagrams for mutual relations between Hadamard-Haar and arithmetic spectra

1126 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: REGULAR PAPERS, VOL. 53, NO. 5, MAY 2006

Fig. 1. The fast flow diagrams for the transformation from nonnormalizedHadamard–Haar spectrum to Arithmetic spectrum using proposed methodwhere r = 1 and n = 3.

Since

, the butterfly diagram for the transformation betweenthe nonnormalized Hadamard–Haar and Arithmetic spectra canbe constructed based on the factorized matrices as shown inFig. 1, where corresponds to the rightmost stage,corresponds to the middle stage, and corresponds to theleftmost stage of the butterfly diagram.

The same transformation using conventional method is alsogiven here for the comparison. Conventionally, the transfor-mation from the nonnormalized Hadamard–Haar spectrumto Arithmetic spectrum is calculated by using fast inverseHadamard–Haar transform and fast Arithmetic transform. Weneed to transform the nonnormalized Hadamard–Haar spectrumto the functional domain using fast inverse Hadamard–Haartransform, then the corresponding Arithmetic spectrum can becalculated from the functional domain using fast Arithmetictransform. The corresponding fast butterfly diagram usingconventional methods is shown in Fig. 2, where the left threestages in the butterfly diagram correspond to the fast inverseHadamard–Haar transform which transforms the nonnormal-ized Hadamard–Haar spectrum to the functionaldomain, and the right three stages correspond to the fast Arith-metic spectrum which transforms the data in functional domainto the corresponding Arithmetic spectrum .

As shown in the butterfly diagrams in Figs. 1 and 2, the trans-formation is processed from the left side to the right side whenthe calculations in the same stage are parallel processed. Sincethe calculations in every stage require the output results of its leftstage as the inputs, it can be noted the number of the stages inthe butterfly diagram determines the processing time of the but-terfly diagram. We can notice that there are three stages of cal-culations in the butterfly diagrams shown in Fig. 1, while thereare six stages of calculations in Fig. 2. Therefore, the transfor-mation using proposed method is much efficient than the onethat is using conventional method. The more detailed analysisfor the comparison of the proposed and conventional methodsis shown in Section V.

V. ANALYSIS OF RUNNING TIME OF THE ALGORITHMS

The running time of the algorithms depends on the com-putational costs required by the calculations which includesadditions, subtractions, and multiplications. The running timeof the conventional methods and proposed methods for thetransformations between Hadamard–Haar and Arithmetic trans-forms when using fast algorithms will be compared in thissection.

It has been known that there are arithmetic operations(additions and subtractions) required for the computation of

-point Walsh transform. The computation of -point nor-malized Haar transform requires arithmetic operationsand multiplications, and the computation of -pointnonnormalized Haar transform does not require multiplica-tions. Since Hadamard–Haar transform includes Walsh andHaar parts, we can develop the computational costs for thecomputations of two versions of Hadamard–Haar transforms.

The number of arithmetic operations required by the calcu-lation of forward or inverse Hadamard–Haar transform can becalculated as follows: .The numbers of multiplications required by calculating for-ward and inverse normalized Hadamard–Haar transform are:

and ,respectively. There are multiplications required by the cal-culation of inverse nonnormalized Hadamard–Haar transform.

It is also known that there are arithmetic operationsrequired by the calculation of forward or inverse Arithmetictransform. So we can derive the computational costs for thetransformations between Hadamard–Haar and Arithmeticspectra using conventional methods based on the computa-tional costs of forward (inverse) Hadamard–Haar and inverse(forward) Arithmetic transforms. The computational costs ofnew proposed methods can be obtained from (19)–(26) and areshown in Table I for different cases. The numbers of arithmeticoperations when using proposed methods are always less thanthe numbers when using conventional methods. It should benoticed that there are additional multiplications while usingproposed methods than conventional methods in two cases forthe normalized version, but the numerical value of the multi-pliers in the additional multiplications are all powers-of-two,i.e., the multiplier is . The multiplications in the compu-tations when using conventional and proposed methods forthe nonnormalized version are also . Such multiplicationscan be easily implemented in hardware by bit-shift operations(plus invertion of sign digit), so this kind of multiplicationsare even more efficient than the arithmetic operations. Forthe convenience of comparing the computational costs whenusing conventional and proposed methods, we consider onlythe cases for the nonnormalized versions and combine thearithmetic operations and multiplications, i.e., the sum ofthe arithmetic operations and multiplications. The proposedmethods show computational advantages over the traditionalmethod due to less computational costs. For example, thecomputational costs for the transformation from nonnormalizedHadamard–Haar spectrum to Arithmetic spectrum using con-ventional and proposed methods are:and , respectively. Therefore, the

Page 9: Matrix decomposition and butterfly diagrams for mutual relations between Hadamard-Haar and arithmetic spectra

FALKOWSKI AND YAN: MATRIX DECOMPOSITION AND BUTTERFLY DIAGRAMS 1127

Fig. 2. The fast flow diagrams for the transformation from nonnormalized Hadamard–Haar spectrum to Arithmetic spectrum using conventional method wherer = 1 and n = 3.

TABLE ICOMPARISON OF COMPUTATIONAL COSTS USING CONVENTIONAL AND PROPOSED METHODS

Fig. 3. The reduction in running time when using proposed method for thetransformation from nonnormalized Hadamard–Haar spectrum to Arithmeticspectrum for some cases.

reduction in computational costs when using proposed methodis

From the reductions for several casesshown in Fig. 3, we can notice that most reductions in Fig. 3are larger than 20%. The reductions in computational costs,which can also be seen as the reductions in running time, when

Fig. 4. The reduction in running time when using proposed method for thetransformation from nonnormalized Hadamard–Haar spectrum to Arithmeticspectrum.

using proposed method for the transformations between non-normalized Hadamard–Haar spectrum and Arithmetic spectrumfor general cases (all ) where are shown in Fig. 4 andFig. 5, respectively.

We will now show the significant savings in the time com-plexity when using proposed methods. Generally, there are(or ) stages required in the fast diagrams for the compu-tations when using conventional methods, while there are only

(or ) stages required when using proposed methods.Hence, the proposed methods carry about 50% saving in timecomplexity compared with the conventional methods.

Page 10: Matrix decomposition and butterfly diagrams for mutual relations between Hadamard-Haar and arithmetic spectra

1128 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: REGULAR PAPERS, VOL. 53, NO. 5, MAY 2006

Fig. 5. The reduction in running time when using proposed method for thetransformation from Arithmetic spectrum to nonnormalized Hadamard–Haarspectrum.

The efficiency of proposed methods in the running time of thealgorithms has been shown, which also means the simplicity ofthe design and the reduction of hardware costs, especially whenall the operations are performed in sign complement arithmetic.

VI. CONCLUSION

In this article, the mutual conversions betweenHadamard–Haar and Arithmetic transforms for an arbitrarytransform size using matrix decomposition methods andbutterfly diagrams as well as their computational costs havebeen developed. The relations between both transforms areintroduced through recursive equations in the form of layeredvertical and horizontal Kronecker products. The presentedrelations allow transferring known results of spectral logicdesign in Arithmetic domain to Hadamard–Haar domainand vice verse and compare efficiency of both approachesin different applications for large discrete functions. Finallyit should be also noticed that presented derivations based onlayered matrices and corresponding butterfly diagrams can beefficiently implemented in the form of operations on spectraldecision diagrams [11], [13], [15], [17]–[19], using softwareor as hardware operations using look-up table cascades ina manner similar to Walsh transform [28]. Hence, all thepresented results are not only very interesting theoretically butalso are very important for the practical applications of Haar,Walsh, Hadamard–Haar and Arithmetic transforms in manyresearch areas.

REFERENCES

[1] B. J. Falkowski, “A note on the polynomial form of Boolean functionsand related topics,” IEEE Trans. Comput., vol. 48, no. 8, pp. 860–864,Aug. 1999.

[2] K. D. Heidtmann, “Arithmetic spectrum applied to fault detection forcombinational networks,” IEEE Trans. Comput., vol. 40, no. 3, pp.320–324, Mar. 1991.

[3] S. L. Hurst, D. M. Miller, and J. C. Muzio, Spectral Techniques in DigitalLogic. London, U.K.: Academic Press, 1985.

[4] M. G. Karpovsky, Finite Orthogonal Series in the Design of Digital De-vices. New York: Wiley, 1976.

[5] S. K. Kumar and M. A. Breuer, “Probabilistic aspects of Booleanswitching functions via a new transform,” J. ACM, vol. 28, no. 3, pp.502–520, Jul. 1981.

[6] V. D. Malyugin, Parallel Logic Calculations Using Arithmetic Polyno-mials. Moscow, Russia: Russian Academy of Sciences, 1997.

[7] K. P. Parker and E. J. McCluskey, “Probabilistic treatment of generalcombinational networks,” IEEE Trans. Comput., vol. C-24, no. 6, pp.668–670, 1975.

[8] K. Radecka and Z. Zilic, “Relating Arithmetic and Walsh spectra forverification by implicit error modeling,” in Proc. 5th Int. Workshop Ap-plications of the Reed-Muller Expansion in Circuit Design, Aug. 2001,pp. 205–214.

[9] , “Design verification by test vectors and Arithmetic transform uni-versal test set,” IEEE Trans. Comput., vol. 53, no. 5, pp. 628–640, May2004.

[10] T. Sasao and M. Fujita, Eds., Representation of Discrete Func-tions. Boston: Kluwer Academic, 1996.

[11] R. S. Stankovic and J. T. Astola, Spectral Interpretation of Decision Di-agrams. New York: Springer-Verlag, 2003.

[12] M. A. Thornton, “Modified Haar transform calculation using digitalcircuit output probabilities,” in Proc. 1st IEEE Int. Conf. Inform.Commun. Signal Process., vol. 1, Singapore, Sep. 1997, pp. 52–58.

[13] , “Probabilistic equivalence checking using partial Haar spectraldiagrams,” in Proc. 4th Int. Workshop Applications of the Reed-MullerExpansion in Circuit Design, Victoria, Canada, Aug. 1999, pp.123–132.

[14] M. A. Thornton, D. M. Miller, and R. Drechsler, “Transformationsamongst the Walsh, Haar, Arithmetic and Reed-Muller spectraldomains,” in Proc. 5th Int. Workshop Applications of the Reed-MullerExpansion in Circuit Design, Aug. 2001, pp. 215–225.

[15] M. A. Thornton, R. Drechsler, and D. M. Miller, Spectral Techniques inVLSI CAD. Boston, MA: Kluwer Academic, 2001.

[16] L. A. Zalmanzon, Fourier, Walsh, and Haar Transforms and TheirApplications in Control, Communication and Other Fields. Moscow,Russia: Nauka, 1989.

[17] B. J. Falkowski and C. H. Chang, “Forward and inverse transformationsbetween Haar spectra and ordered binary decision diagrams of Booleanfunctions,” IEEE Trans. Comput., vol. 46, no. 11, pp. 1272–1279, Nov.1997.

[18] , “Mutual conversions between generalized Arithmetic expansionsand free binary decision diagrams,” Proc. IEE Circuits Devices Syst.,vol. 145, no. 4, pp. 219–228, Aug. 1998.

[19] J. P. Hansen and M. Sekine, “Decision diagrams based techniques for theHaar wavelet transform,” in Proc. 1st IEEE Int. Conf. Inform. Commun.Signal Process., vol. 1, Singapore, Sep. 1997, pp. 59–63.

[20] K. R. Rao, M. A. Narasimhan, and K. Revuluri, “Image data processingby Hadamard–Haar transform,” IEEE Trans. Comput., vol. C-24, no. 9,pp. 888–896, 1975.

[21] K. R. Rao, A. Jalali, and P. Yip, “Rationalized Hadamard–Haar trans-form,” in Proc. 11st Ann. Asilomar Conf. Signals Syst. Comput., PacificGrove, CA, Nov. 1977, pp. 194–203.

[22] G. Ruiz, J. A. Michell, and A. Buron, “Fault detection and diagnosis forMOS circuits from Haar and Walsh spectrum analysis: On the fault cov-erage of Haar reduced analysis,” in Theory and Application of SpectralTechniques, C. Moraga, Ed. Dortmund, Germany: University Dort-mund Press, 1988, pp. 97–106.

[23] T. Sasao, Ed., Logic Synthesis and Optimization. Boston: Kluwer Aca-demic, 1993.

[24] B. J. Falkowski, “General relations between Arithmetic and Haar trans-forms in the form of layered Kronecker matrices,” in Proc. 2nd Int. Work-shop Transforms and Filter Banks, Brandenburg, Germany, Mar. 1999,pp. 9–14.

[25] S. Rahardja and B. J. Falkowski, “Application of linearly independentArithmetic transform in testing of digital circuits,” Electron. Lett., vol.35, no. 5, pp. 363–364, Mar. 1999.

[26] B. J. Falkowski, “Recursive relationships, fast transforms, generaliza-tions and VLSI iterative architecture for Gray code ordered Walsh func-tions,” Proc. IEE Comp. Digit. Tech., vol. 142, no. 5, pp. 325–331, Sep.1995.

[27] B. J. Falkowski and S. Yan, “Relationship between Hadamard–Haarand Arithmetic transforms,” in Proc. 47th IEEE Midwest Symp. CircuitsSyst., vol. 1, Hiroshima, Japan, Jul. 2004, pp. 505–508.

[28] B. J. Falkowski and T. Sasao, “Unified algorithm to generate Walsh func-tions in four different orderings and its programmable hardware imple-mentations,” Proc. IEE Vis. Image Signal Process., vol. 152, no. 6, pp.819–826, Dec. 2005.

Page 11: Matrix decomposition and butterfly diagrams for mutual relations between Hadamard-Haar and arithmetic spectra

FALKOWSKI AND YAN: MATRIX DECOMPOSITION AND BUTTERFLY DIAGRAMS 1129

Bogdan J. Falkowski (S’88–M’90–SM’94) receivedthe M.S.E.E. degree and the Ph.D. degree in electricaland computer engineering from the Warsaw Univer-sity of Technology, Warsaw, Poland, and the PortlandState University, Portland, OR, in 1978 and 1991, re-spectively.

His industrial experience includes research and de-velopment positions at several companies. He thenjoined the Electrical and Computer Engineering De-partment, Portland State University. Since 1992, hehas been with the School of Electrical and Electronic

Engineering, Nanyang Technological University, Singapore, where he is cur-rently an Associate Professor. His research interests include very large-scale in-tegrated systems and design, switching circuits, testing, digital signal and imageprocessing, and design of algorithms. He specializes in the design of digital cir-cuits with the use of spectral methods and has published three book chaptersand over 270 refereed journal and conference papers in this area.

Dr. Falkowski received the Hartree Premium Award that recognizes the out-standing paper published in 2001 in IEE Proceedings on Computers and Dig-ital Techniques in 2002. He was a Guest Editor of the VLSI Design Journal, andTechnical Chair for IEEE International Conference on Information, Communi-cation and Signal Processing, Singapore, in 1999. He is listed in Marquis Whois Who in Science and Engineering as well as in the International BiographicalCentre, Cambridge, UK. He was elected an Executive Member of IEEE Com-puter Society Technical Committee in Multiple-Valued Logic for 2004–2006.

Shixing Yan (S’03) received the B.Eng. degree in in-formation engineering from Xi’an Jiaotong Univer-sity, Xi’an, China, in 2001. He is currently workingtoward the Ph.D. degree at Nanyang TechnologicalUniversity, Singapore.

From 2001 to 2002, he was an R&D Engineerin the Department of Information Technology, In-dustrial and Commercial Bank of China, Shenzhen,China. His research interests include logic synthesis,digital signal and image processing, and spectralmethods in VLSI design.