Identification of Frequency-Domain Volterra Model Using Neural Networks Georgina Stegmayer1 and Omar Chiotti2 1

Politecnico di Torino, Electronics Deptment, Cso. Duca degli Abruzzi 24, 10129 Turin, Italy [email protected] http://www.eln.polito.it 2 G.I.D.S.A.T.D., Universidad Tecnológica Nacional, Lavaise 610, 3000 Santa Fe, Argentina [email protected] http://www.frsf.utn.edu.ar/investigacion/grupos/gidsatd/

Abstract. In this paper, a new method is introduced for the identification of a Volterra model for the representation of a nonlinear electronic device in the frequency domain. The Volterra model is a numerical series with some particular terms named kernels. Our proposal is the use of feedforward neural networks (FNN) for the modeling of the nonlinearities in the device behavior, and a special procedure which uses the neural networks parameters for the kernels identification. The proposed procedure has been tested with simulation data from a class “A” Power Amplifier (PA) which validate our approach.

1 Introduction The classical modeling of electronic devices consists in building empirical models, which are electrical circuits schematics containing capacitors, resistors, transmission lines, among other electronic components representations. The elements with nonlinear behavior are typically defined though analytical functions, and when microwave applications are considered, they are more conveniently defined in the frequency domain. The main problem with this approach is that the model can have hundred of parameters to be tuned to make it work properly. On the other hand, behavioral models propose to characterize a nonlinear system in terms of in/out scattered waves, using relatively simple mathematical expressions. The modeled device is considered as a “black-box”, no knowledge of the internal structure is required. The modeling information about its behavior is completely contained in the external response (measurement data) of the device, which help estimating the model parameters [1]. A truncated Volterra series has been successfully used to derive some behavioral models for PA in recent years. It has been traditionally the most general and rigorous modeling approach for systems characterized by nonlinear dynamic phenomena [2]. Black-box models relying on the Volterra series and on directly measured data enable to forget the circuit topology [3]. Concerning a single port (or single in/out) device, the terms “nonlinear” and “dynamic” imply that the output, i.e. the current in the case of a PA, at any time instant, is nonlinearly dependent not only on the applied input at the same instant, but also on its past values, that represent the “memory” effect associated with dynamic phenomena in the device (i.e. charge-storage effects) [4]. This W. Duch et al. (Eds.): ICANN 2005, LNCS 3697, pp. 465 – 471, 2005. © Springer-Verlag Berlin Heidelberg 2005

466

G. Stegmayer and O. Chiotti

makes the modeling of such a system a difficult task. Furthermore, the high computational complexity of the standard methods for Volterra modeling [5][6] are limited in many practical situations. In this paper we present a new method for the identification of the terms of the Volterra series model using a FNN. With the proposed procedure they can be obtained using standard device measurements in the frequency domain in a simple and straightforward way, saving time to the design engineer at the moment of modeling and simulating a nonlinear device. We have tested our approach with simulation data from a class “A” PA with 3rd order nonlinearities and memory effects, which validate our proposal. The organization of the paper is the following: in the next Section, the nonlinear behavior of electronic devices, in particular in the frequency domain, is introduced. Section 3 presents the Volterra modeling of a nonlinear electronic device. The new procedure to obtain the Volterra kernels from a neural network appears in Section 4. Section 5 shows some results obtained from simulations. Finally, the conclusions can be found on Section 6.

2 Electronic Device Nonlinear Behavior Typically, a black-box representation of a device consists in an abstract block. In general, the incident and reflected power waves are related to the inputs (voltages) and outputs (currents) of the device (i.e. PA) as shows Fig. 1. Here a typical 2-port device (two inputs/outputs) is presented together with its scattering matrix parameters [S], which are a widely known set of parameters that characterize the device and that relate its inputs (a1 and a2) and outputs (b1 and b2) in a linear way. The Sij parameter describes the influence of the incident wave at port j on the resulting wave at port i.

Fig. 1. Representation of a nonlinear two-port device, with the scattering matrix parameters [S]. I represents current, V represents driving voltage and a and b are the incident and reflected power waves, respectively.

Let us first consider a 2-port device with linear behavior. If both ports are excited by incident waves (a1, a2) at frequency f0 (also named the fundamental) the reflected waves (b1, b2) will contain a component at that frequency, specified by the Sparameters according to Eqs. (1) and (2). b1( f0 ) = S11( f0 )a1( f0 ) + S12 ( f0 )a2 ( f0 ) b2 ( f0 ) = S 21 ( f0 )a1( f0 ) + S 22 ( f0 )a2 ( f0 )

(1)

(2) Linear systems do not generate new frequencies (the frequency content at the output is identical to that of the input, although it can be modified in amplitude and phase). This is represented in Fig. 2. On the left side, the input/output of a linear device is shown, in both time and frequency domain, where can be clearly seen that the input and output frequency is the same and new frequency components are not cre-

Identification of Frequency-Domain Volterra Model Using Neural Networks

467

ated. However, on the right side, a nonlinear behavior is shown, where some frequency components apart from f0 (i.e. f1, f2, f3) may interact nonlinearly to produce frequency components in the output that may not be present in the input signal. This interaction may produce some nonlinear phenomena, such as intermodulation (f1 ± f2 ± f3) and 3rd harmonic terms (3f1, 3f2, 3f3), which are of particular interest to the electronic engineer, because they allow to obtain some parameters that describe the device performance [7].

Fig. 2. Left side: representation of a device with linear behavior. Input and output frequencies are the same, no additional frequencies are created. The output frequency may only change in amplitude and phase. Right side: representation of a nonlinear device. Output frequency may suffer a frequency shift and additional frequencies can be created.

3 Volterra Series Model of a Nonlinear Device The Volterra approach characterizes a system as a mapping between two function spaces, the input and output spaces of that system. The Volterra model is an extension of the Taylor series representation to cover dynamic systems [8]. The series can be described in the time-domain or in the frequency-domain. In the discrete-frequency domain, the series takes the form of Eq. (3), where X(f) is the Fourier transform of the input signal x(t) at the frequency f. The term Hn is the “kernel” which describes the contribution of the nth degree of nonlinearity to the system. This way, H1 represents the linear transfer function and H2 and H3 are the quadratic and cubic transfer functions of the system [9]. ∞



Y ( f ) = H 1 ( f ) X ( f ) + ∑ ∑ H 2 ( f1 , f 2 ) X ( f1 ) X ( f 2 ) +

(3)

f1 f 2 f1 + f 2 = f







∑∑∑

f1 f 2 f3 f1 + f 2 + f 3 = f





H 3 ( f1 , f 2 , f 3 ) X ( f1 ) X ( f 2 ) X ( f 3 ) + ... + ∑ ...∑ H n ( f1 ,..., f n ) X ( f1 )... X ( f n ) f1 fn f 1 + ... + f n = f

An example of this model for a nonlinear device is shown below. Eq. (4) shows the linear part of the generated signal at port 1 (b1) and Eq. (5) models the cubic component that appears in this port as a consequence of the device nonlinear behavior (combination of the input signals). Equivalent equations are valid for port 2 (b2). b1 ( f 0 ) = H 1 ( f 0 )a1 ( f 0 ) + H 1 ( f 0 )a2 ( f 0 )

(4)

468

G. Stegmayer and O. Chiotti b1 ( 3 f 0 ) = H 3 ( f 0 , f 0 , f 0 )a1 ( f 0 )a1 ( f 0 )a1 ( f 0 ) + 3 H 3 ( f 0 , f 0 , f 0 )a1 ( f 0 )a1 ( f 0 )a2 ( f 0 ) + 3 H 3 ( f 0 , f 0 , f 0 )a1 ( f 0 )a2 ( f 0 )a2 ( f 0 ) + H 3 ( f 0 , f 0 , f 0 )a2 ( f 0 )a2 ( f 0 )a2 ( f 0 )

(5)

Application of Volterra system theory has an important role in nonlinear system analysis and identification, due in part to the fact that Volterra series a firm mathematical foundation and nonlinear behavior can be described with reasonably accuracy by a truncated version of the series, which reduces the complexity of the problem and requires a limited amount of knowledge of higher order statistics or higher order spectra [10]. In nonlinear microwave analysis the tool for excellence has been the Volterra-series analysis. The kernels allow the calculation of device parameters of great concern for the microwave designer, i.e. in the case of a PA, among others, nonlinear gain, 3rd order harmonics and intermodulation. However, kernels calculation, analytical expression or measurement can be a very complex and timeconsuming task [11]. There have been some approaches to help the calculation of the kernels, in particular in the frequency domain. For example in [7][12] special fitting functions are proposed, using then optimization procedures to find the kernels values in a global manner. Our proposal is a modular approach, simpler and more straightforward, and it is an adaptation of a previous work performed for the kernels identification in the time domain [13]. We use FNNs to do the fitting of standard frequency domain measurements, one for each nonlinear part of the system, and after that, a simple procedure permits obtaining the kernels values directly from the network parameters, just combining its weights and bias values. This procedure is explained in the next Section.

4 Identification Procedure Using Neural Networks The proposed approach involves the use of FNNs like the one presented in Fig. 3, having H hidden neurons with a generic activation function (af) and bias values. The choice of the function will depend on the type of nonlinearity that will be modeled by the network. The inputs to the model are the inputs to the device, i.e. a1 and a2, measured at the fundamental frequency f0, and the output is the output value b1 measured also at f0. The output neuron is lineal. The training set is built with these measurements performed in all the frequency range or work interval of the device, where the S-parameters have the same value as long as the device bias point does not change [11].

Fig. 3. Feedforward Neural Network model used in the Volterra kernels identification procedure. The inputs/output of the network are the inputs/output measured at the fundamental frequency f0, in port 1.

Identification of Frequency-Domain Volterra Model Using Neural Networks

469

First of all we focus our attention on port 1 of the 2-port device of Fig. 1 (equivalent reasoning applies for port 2). Several FNNs like Fig. 3 will be used to model the 1st and 3rd order nonlinearities of output b1. In general, the network output is Eq. (6).

(

H

b1 ( f 0 ) = ∑ wh2 af wh1,1 a1 ( f 0 ) + wh1,2 a 2 ( f 0 ) + bh h =1

)

(6)

If the network output is developed as a Taylor series around the bias values of the hidden neurons, and the terms are re-ordered according to derivative order and common terms, Eq. (7) yields, where due to space restrictions only the 1st order terms have been included. The Volterra kernels for b1 are easily identified as the terms between brackets. Actually this is the general procedure, but for the linear behavior in particular, the activation functions of the hidden neurons are linear and the bias values take zero values. Taking this into account, Eq. (8) and Eq. (9) are obtained for the 1st order kernels at port 1. Comparing Eq. (7) with the in/out relationship of this port (Eq. (1)), becomes clear the fact that the 1st order kernels H1 happen to be the lineal scattering parameters. The simulations presented in the next Section validate our proposed approach, and therefore we use it for the 3rd order nonlinearity. ⎡H ⎛ ⎞⎤ ⎟⎥ a1 ( f 0 ) + ⎢∑ wh2 wh1 ,2 ⎜ ∂af ⎜ ∂x ⎟ h =1 ⎢ x =bh ⎠ ⎥ ⎝ ⎣ ⎦

H ⎡H ⎛ ∂af b1 ( f 0 ) = b0 + ∑ wh2 af ( bh ) + ⎢∑ wh2 wh1 ,1 ⎜ ⎜ ∂x h =1 ⎢⎣ h =1 ⎝

⎞⎤ (7) ⎟ ⎥ a 2 ( f 0 ) + ... ⎟ x = bh ⎠ ⎥ ⎦

H

H 1 ( a1 ) = ∑ wh2 wh1 ,1

(8)

h =1

H

H 1( a2 ) = ∑ wh2 wh1 ,2

(9)

h =1

We apply the same procedure to the identification of higher order kernels, in particular the 3rd order Volterra kernels. But now the FNN used includes bias values in the neurons and cubic (af = x3) in the hidden neurons, and it is trained with the same inputs, but with the output response generated at the 3rd harmonic (b1(3f0)). The procedure is applied and the formulas obtained this time for the 3rd order Volterra kernels are Eq. (10) to Eq. (13). H

∑w H 3 ( a1 , a 1 , a1 ) =

h =1

2 h

H

∑w H 3 ( a1 , a1 , a 2 ) =

h =1

2 h

H

∑w H 3 ( a 2 , a 2 , a1 ) =

2 h

h =1

H

∑w H 3 ( a2 ,a2 ,a2 ) =

h =1

2 h

⎛ ∂ 3( x3 ) wh1,1 wh1 ,1 wh1 ,1 ⎜ ⎜ ∂x 3 x = bh ⎝ 3!

⎞ ⎟ ⎟ ⎠

(10)

⎛ ∂3( x3 ) wh1,1 wh1,1 wh1,2 ⎜ ⎜ ∂x 3 ⎝ 3!

x =bh

⎞ ⎟ ⎟ ⎠

(11)

x = bh

⎞ ⎟ ⎟ ⎠

(12)

⎞ ⎟ ⎟ ⎠

(13)

⎛ ∂3( x3 ) wh1 ,2 wh1 ,2 wh1 ,1 ⎜ ⎜ ∂x 3 ⎝ 3!

⎛ ∂3( x3 ) wh1 ,2 wh1 ,2 wh1 ,2 ⎜ ⎜ ∂x 3 x = bh ⎝ 3!

470

G. Stegmayer and O. Chiotti

5 Case of Study and Simulation Results The simulation data used for the network training were obtained from a class A PA at 1 Ghz. The absolute errors between its scattering parameters the corresponding 1st order Volterra kernels obtained from the FNN at the port 1 are: [Re{S11}=0.99999, H1(a1)] = 4e-07 and [Re{S12}=0.00001, H1(a2)] = 3e-07. Concerning port 2, the errors are: [Re{S21}=0.00001, H1(a1)] = 2e-07 and [Re{S22}=-0.73351, H1(a2)] = 8e-08. As can be seen, the errors are very low and the procedure is validated. In the case of the 3rd order Volterra kernels estimation, the values are not previously known, so the only way of testing our approach is using the kernels to build a Volterra series model that includes the kernels identified from the network, and compare it with the original nonlinear behavior. The results are shown in Fig. 4, showing an excellent approximation result and validating our proposal once more.

Fig. 4. Simulation results with the 3rd order kernels. Left side: frequency domain plot comparing the original data and the Volterra model. Right side: a1 vs. b1 plot comparing original data (dotted line) and the Volterra model (full line). The mean square error between them is of 0.0099.

6 Conclusions In this work we have presented a new modular method for the identification of the Volterra kernels in the frequency domain. We propose the use of FNNs and a special procedure for the kernels identification, using the neural network parameters. The proposed procedure has been tested with simulation data from a class “A” Power Amplifier (PA), which have validated our approach for the 1st and 3rd order nonlinearities identification.

References 1. Zhu, A., Brazil, T.J.: Behavioral modeling of RF power amplifiers based on pruned Volterra series. IEEE Microwave and Wireless components letters, 14 (2004) 563-565 2. Weiner, D., Naditch, G.: A scattering variable approach to the Volterra analysis of nonlinear systems, IEEE Trans. on Microwave Theory and Techniques 24 (1976), 422–433

Identification of Frequency-Domain Volterra Model Using Neural Networks

471

3. Harkouss, Y., Rousset, J., Chehade, H., Ngoya, E., Barataud, D., Teyssier J.P.: Modeling microwave devices and circuits for telecommunications system design. Proc. IEEE World Congress on Computational Intelligence, 1 (1998) 128-133 4. Filicori, F., Vannini, G., Monaco, V.A.: A Nonlinear Integral Model of Electron Devices for HB Circuit Analysis. IEEE Trans. on Microwave Theory and Techniques, 40 (1992) 1456-1464 5. Kashiwagi, H., Harada, H., Rong, L.: Identification of Volterra kernels of nonlinear systems by separating overlapped kernel slices. Society Instrument Control Engineers of Japan, 2 (2002) 707-712 6. Bauer, A., Schwarz, W.: Circuit analysis and optimization with automatically derived Volterra kernels. IEEE Int. Symposium on Circuits and Systems, (2000) I-491 - I-494 7. Wang, T., Brazil, T.J.: A Volterra-mapping-based S-parameter behavioral model for nonlinear RF and microwave circuits and systems. IEEE Int. Microwave Theory and Techniques, 2 (1999) 783-786 8. Schetzen, M.: The Volterra and Wiener Theories of Nonlinear Systems. Ed. John Wiley & Sons Inc. (1980) 9. Rough, W.: Nonlinear System Theory. The Volterra/Wiener Approach. Ed. Johns Hopkins University Press (1981) 10. Nam, S.W., Powers, E.J.: Application of Higher-Order Spectral Analysis To CubicallyNonlinear System Identification. IEEE Trans. on Signal Processing, 42 (1994) 1746-1765 11. Maas, S.A.: Nonlinear Microwave Circuits. Ed. Artech House (1988) 12. Verbeyst, F., Vanden Bossche, M.: The Volterra input-output map of a high-frequency amplifier as a practical alternative to load-pull measurements. IEEE Trans. on Instrumentation and Measurement, 44 (1995) 662-665 13. Stegmayer, G.: Volterra series and Neural Networks to model an electronic device nonlinear behavior. Proc. IEEE Int. Joint Conference on Neural Networks, 4 (2004) 2907-2910

Identification of Frequency-Domain Volterra Model ... - Springer Link

The classical modeling of electronic devices consists in building empirical models, which are electrical ... a simple and straightforward way, saving time to the design engineer at the moment of modeling and .... Taking this into account, Eq. (8) and Eq. (9) are obtained for the 1st .... Society Instrument Control Engineers of Ja-.

193KB Sizes 2 Downloads 324 Views

Recommend Documents

A Model of Business Ethics - Springer Link
Academic Publishing/Journals, Cause Related Marketing and General .... Robin and Reidenbach (1987) suggest that a 'social contract' exists between .... the media was bemoaning that they had been misled ..... believes it to be the right course of acti

Identification and isolation of lectin nucleotide ... - Springer Link
Identification and isolation of lectin nucleotide sequences and species relationships in the genus Lens (Miller). Received: 14 January 2003 / Accepted: 23 ...

A Niche Width Model of Optimal Specialization - Springer Link
Niche width theory makes the assumption that an organization is at its best for one en- ..... account. Notice that these polymorphs are not the same as polymorph ...

A Rent-Seeking Model of Voluntary Overcompliance - Springer Link
Oct 14, 2015 - small concession beforehand, i.e. by overcomplying voluntary, the firm lowers the stake the environmental group has in the rent seeking contest, which lowers the group's lobbying effort in that contest. Voluntary overcompliance increas

Reconsidering Price's model of scientific growth: An ... - Springer Link
number of scientific journals and abstract journals during the 1665-2000 time interval. As Price .... rejected this model as it was considered too abstract and did not take into account ..... (Spanish translation as Hacia una ciencia de la ciencia.

A Niche Width Model of Optimal Specialization - Springer Link
so that we can predict the optimal degree of specialization. ..... is a member of the Center for Computer Science in Organization and Management Science.

Model reference adaptive control of a nonsmooth ... - Springer Link
Received: 17 May 2005 / Accepted: 14 July 2005 / Published online: 29 June 2006. C Springer Science + Business ... reference control system, is studied using a state space, ...... support of the Dorothy Hodgkin Postgraduate Award scheme.

Calculus of Variations - Springer Link
Jun 27, 2012 - the associated energy functional, allowing a variational treatment of the .... groups of the type U(n1) × ··· × U(nl) × {1} for various splittings of the dimension ...... u, using the Green theorem, the subelliptic Hardy inequali

An animal movement model incorporating home range ... - Springer Link
Received: 1 August 2005 / Revised: 7 July 2006 / Published online: 19 September 2007 ... for nutrition, protection from predation, reproduction, etc. ..... classes are now the nonnegative integers, so using the lowest value as the base (i.e. the ...

A Category-integrated Language Model for Question ... - Springer Link
to develop effective question retrieval models to retrieve historical question-answer ... trieval in CQA archives is distinct from the search of web pages in that ...

An animal movement model incorporating home range ... - Springer Link
Sep 19, 2007 - Springer Science+Business Media, LLC 2007 ... model for telemetry relocation data that accounts for both movement and the use of resources ... the advent of global positioning system (GPS) locators, however, ... uniform distribution ov

A biomimetic, force-field based computational model ... - Springer Link
Aug 11, 2009 - a further development of what was proposed by Tsuji et al. (1995) and Morasso et al. (1997). .... level software development by facilitating modularity, sup- port for simultaneous ...... Adaptive representation of dynamics during ...

A Predictive Collision Avoidance Model for Pedestrian ... - Springer Link
Abstract. We present a new local method for collision avoidance that is based on collision prediction. In our model, each pedestrian predicts pos- sible future collisions with other pedestrians and then makes an efficient move to avoid them. Experime

A Multi-layer Model for Face Aging Simulation - Springer Link
ment cosmetic surgery planning, age-adaptive human computer interaction, etc. ... support vector machines (SVMs) to predict the shape in the future. ... [9] defined both a person-specific and a global aging axis in the shape and texture ...

An operational model to simulate post-accidental ... - Springer Link
Jun 28, 2011 - Abstract As part of its development of post-accident management tools, the French Institute for Radiological. Protection and Nuclear Safety is ...

Structured Sparse Low-Rank Regression Model for ... - Springer Link
3. Computer Science and Engineering,. University of Texas at Arlington, Arlington, USA. Abstract. With the advances of neuroimaging techniques and genome.

The standard model on non-commutative space-time - Springer Link
Jan 25, 2002 - Mills theories on non-commutative space-time has recently been proposed [1–4]. Previously only U(N) gauge theories were under control, and it was thus only possible to con- sider extensions of the standard model. Recently there has b

Rapid Note Anomalous scaling in the Zhang model - Springer Link
We apply the moment analysis technique to analyze large scale simulations of the Zhang sandpile model. We find that .... Here the index k runs over the set of all nearest .... we plot the data collapse analysis for the size distribution. The perfect 

Where does model-driven engineering help ... - Springer Link
Oct 26, 2011 - pean research project with the objective of developing tech- niques and tools for ... scenarios of complex software systems' development. The.

Tinospora crispa - Springer Link
naturally free from side effects are still in use by diabetic patients, especially in Third .... For the perifusion studies, data from rat islets are presented as mean absolute .... treated animals showed signs of recovery in body weight gains, reach

Chloraea alpina - Springer Link
Many floral characters influence not only pollen receipt and seed set but also pollen export and the number of seeds sired in the .... inserted by natural agents were not included in the final data set. Data were analysed with a ..... Ashman, T.L. an

GOODMAN'S - Springer Link
relation (evidential support) in “grue” contexts, not a logical relation (the ...... Fitelson, B.: The paradox of confirmation, Philosophy Compass, in B. Weatherson.

Bubo bubo - Springer Link
a local spatial-scale analysis. Joaquın Ortego Æ Pedro J. Cordero. Received: 16 March 2009 / Accepted: 17 August 2009 / Published online: 4 September 2009. Ó Springer Science+Business Media B.V. 2009. Abstract Knowledge of the factors influencing