Elastic net orthogonal forward regression

[1] C.J. Harris,X.Hong,Q.Gan,AdaptiveModelling,EstimationandFusionfrom Data: ANeurofuzzyApproach,Springer-Verlag,Heidelberg,Germany,2002. [2] M. Brown,C.J.Harris,NeurofuzzyAdaptiveModellingandControl,Prentice Hall, HemelHempstead,1994. [3] A.E.Ruano,IntelligentControlSystemsusingComputationalIntelligence Techniques,IEEPublishing,Stevenage,UK,2005. [4] R. Murray-Smith,T.A.Johansen,MultipleModelApproachestoModellingand Control,TaylorandFrancis,UK,1997. [5] S.G. Fabri,V.Kadirkamanathan,FunctionalAdaptiveControl:AnIntelligent SystemsApproach,Springer,London,2001. [6] S. Chen,S.A.Billings,W.Luo,Orthogonalleastsquaresmethodsandtheir applications tonon-linearsystemidentification, Int.J.Control50(1989) 1873–1896. [7] M.J. Korenberg,Identifyingnonlineardifferenceequationandfunctional expansionrepresentations:thefastorthogonalalgorithm,Ann.Biomed.Eng. 16(1988)123–142. [8] L. Wang,J.M.Mendel,Fuzzybasisfunctions,universalapproximation,and orthogonal least-squareslearning,IEEETrans.NeuralNetw.5(1992)807–814. [9] X. Hong,C.J.Harris,Neurofuzzydesignandmodelconstructionofnonlinear dynamical processesfromdata,IEEProc.ControlTheoryAppl.148(6)(2001) 530–538. [10] Q. Zhang,Usingwaveletsnetworkinnonparametricestimation,IEEETrans. NeuralNetw.8(2)(1993)1997. [11] S.A.Billings,H.L.Wei,Thewavelet-narmaxrepresentation:ahybridmodel structure combiningpolynomialmodelswithmultiresolutionwaveletdecom- positions, Int.J.Syst.Sci.36(3)(2005)137–152. [12] N. Chiras,C.Evans,D.Rees,Nonlineargasturbinemodellingusingnarmax structures, IEEETrans.Instrum.Meas.50(4)(2001)893–898. [13] Y.Gao,M.J.Er,Onlineadaptivefuzzyneuralidentification andcontrolofa class ofMIMOnonliearsystems,IEEETrans.FuzzySyst.11(4)(2003)462–477. [14] K.M. Tsang,W.L.Chan,Adaptivecontrolofpowerfactorcorrectionconverter using nonlinearsystemidentification, IEEProc.Electr.PowerAppl.152(3) (2005)627–633. [15] G.C. Luh,W.C.Cheng,Identification ofimmunemodelsforfaultdetection, Proc. Instn.Mech.Eng.PartI:J.Syst.ControlEng.218(2004)353–367. [16] M. Stone,Crossvalidatorychoiceandassessmentofstatisticalpredictions,J.R. Stat.Soc.Ser.B36(1974)117–147. [17] S. Chen,Y.Wu,B.L.Luk,Combinedgeneticalgorithmoptimizationand regularized orthogonalleastsquareslearningforradialbasisfunctionnet- works,IEEETrans.NeuralNetw.10(1999)1239–1243. [18] M.J.L. Orr,Regularisationintheselectionofradialbasisfunctioncenters, NeuralComput.7(3)(1995)954–975. [19] X. Hong,S.A.Billings,Parameterestimationbasedonstackedregressionand evolutionary algorithms,IEEProc.-ControlTheoryAppl.146(5)(1998) 406–414. [20] L. Ljung,T.Glad,ModellingofDynamicSystems,PrenticeHall,Englewood Cliffs, NJ,1994. [21] S. Chen,X.Hong,C.J.Harris,Particleswarmoptimizationaidedorthogonal forwardregressionforunified datamodelling,IEEETrans.Evol.Comput.14(4) (2010)477–499. X. Hong,S.Chen/Neurocomputing ∎ (∎∎∎∎) ∎∎∎–∎∎∎ 9 Please citethisarticleas:X.Hong,S.Chen,Elasticnetorthogonalforwardregression, [22] J.Kennedy,R.Eberhart,Particleswarmoptimization,in:Proceedingsof1995 IEEE InternationalConferenceonNeuralNetworks,Perth,Australia,November 27–December 1,vol.4,1995,pp.1942–1948. [23] J. Kennedy,R.C.Eberhart,SwarmIntelligence,MorganKaufmann,San Franscisco,USA,2001. [24] D.W.vanderMerwe,A.P.Engelbrecht,Dataclusteringusingparticleswarm optimization, in:ProceedingsofCEC2003,Cabberra,Australia,December8– 12,2003,pp.215–220. [25] A.Ratnaweera,S.K.Halgamuge,H.C.Watson,Self-organizinghierarchical particle swarmoptimizerwithtime-varyingaccelerationcoefficients, IEEE Trans.Evol.Comput.8(June)(2004)240–255. [26] M.G.H.Omran,Particleswarmoptimizationmethodsforpatternrecognition and imageprocessing(Ph.D.thesis),UniversityofPretoria,Pretoria,South Africa, 2005. [27]S.M.Guru,S.K.Halgamuge,S.Fernando,Particleswarmoptimisersforcluster formation inwirelesssensornetworks,in:Proceedingsofthe2005Interna- tional ConferenceIntelligentSensors,SensorNetworksandInformation Processing, Melbourne,Australia,December5–8, 2005,pp.319–324. [28] K.K. Soo,Y.M.Siu,W.S.Chan,L.Yang,R.S.Chen,Particle-swarm-optimization- based multiuserdetectorforCDMAcommunications,IEEETrans.Veh.Technol. 56 (September)(2007)3006–3013. [29] S. Chen,X.Hong,C.J.Harris,Sparsekernelregressionmodellingusing combined locallyregularisedorthogonalleastsquaresandD-optimality experimentaldesign,IEEETrans.Autom.Control48(6)(2003)1029–1036. [30] H. Zou,T.Hastie,Regularizationandvariableselectionviatheelasticnet,J.R. Stast.Soc.B67(2)(2005)301–320. [31]S.Chen,Locallyregularisedorthogonalleastsquaresalgorithmforthe construction ofsparsekernelregressionmodels,in:Proceedingsof6th International ConferenceonSignalProcessing,Beijing,China,2002, pp. 1229–1232. [32] D.J.C.MacKay,Bayesianmethodsforadaptivemodels(Ph.D.thesis),California Institute ofTechnology,USA,1991. [33] S.S. Chen,D.L.Donoho,M.A.Saunders,Atomicdecompositionbybasispursuit, SIAM J.Sci.Comput.20(1)(1998)33–61. [34] R. Tibshirani,Regressionshrinkageandselectionviathelasso,J.R.Stat.Soc. Ser.B58(1)(1996)267–288. [35] B. Efron,I.Johnstone,T.Hastie,R.Tibshirani,Leastangleregression,Ann.Stat. 32 (2004)407–451. [36] S. Chen,Localregularizationassistedorthogonalleastsquaresregression, Neurocomputing69(4–6) (2006)559–585. [37] S. Chen,S.A.Billings,Representationofnonlinearsystems:theNARMAX model, Int.J.Control49(3)(1989)1013–1032. [38] S. Chen,E.S.Chng,K.Alkadhimi,Regularizedorthogonalleastsquares algorithm forconstructingradialbasisfunctionnetworks,Int.J.Control64 (5) (1996)829–837. [39] L. Ljung,SystemIdentification: TheoryfortheUser,PrenticeHall,NewJersey, 1987. [40] J. Shao,Linearmodelselectionbycrossvalidation,J.Am.Stat.Assoc.88(422) (1993)486–494. [41] I. Rivals,L.Personnaz,Oncrossvalidationformodelselection,NeuralComput. 11(4)(1999)863–870. [42] A.M.Molinaro,R.Simon,R.M.Pfeiffer,Predictionerrorestimation:acompar- ison ofresamplingmethods,Bioinformatics21(15)(2005)3301–3307. [43] R.H. Myers,ClassicalandModernRegressionwithApplications,2ndedn., PWS-KENT, Boston,1990. [44] T.Stamey,J.Kabalin,J.McNeal,I.Johnsdtone,F.Freiha,E.Redwine,N.Yang, Prostatespecific antigeninthediagnosisandtreatmentofadenocarcinomaof the prostateii:radicalprostatectomytreatedpatients,J.Urol.16(1989) 1076–1083. [45] S.A.Billings,S.Chen,R.J.Backhouse,Theidentification oflinearandnonlinear models ofaturbochargedautomativedieselengine,Mech.Syst.Signal Process. 3(2)(1989)123–142. [46] S. Chen,X.Hong,C.J.Harris,P.M.Sharkey,Sparsemodellingusingorthogonal forwardregressionwithPRESSstatisticandregularization,IEEETrans.Syst. Man Cybern.PartB:Cybern.34(2)(2004)898–911. [47] G.E.P.Box,G.M.Jenkins,TimeSeriesAnalysis,ForecastingandControl,Holden- Day Inc,SanFranscisco,USA,1976. [48] S. Chen,J.Wigger,Fastorthogonalleastsquaresalgorithmforefficient subset selection, IEEETrans.SignalProcess.43(7)(1995)1713–1715.