Particle swarm optimisation assisted classification using elastic net prefiltering

[1] M. Stone,Cross-validatorychoiceandassessmentofstatisticalpredictions, J. Roy.Stat.Soc.SeriesB36(2)(1974)117–147. [2] H. Akaike,Anewlookatthestatisticalmodelidentification, IEEETrans. Autom.ControlAC-19(December(6))(1974)716–723. [3] D.J.C. MacKay,BayesianMethodsforAdaptiveModels,Ph.D.Thesis,California Institute ofTechnology,USA,1991. [4] V.N. Vapnik,TheNatureofStatisticalLearningTheory,Springer-Verlag NewYork,1995. [5] M.E. Tipping,SparseBayesianlearningandtherelevancevectormachine, J. Mach.Learn.Res.1(June)(2001)211–244. [6] B. Schölkopf,A.J.Smola,LearningwithKernels:SupportVectorMachine, Regularization,OptimizationandBeyond,MITPress,Cambridge,MA,2002. [7] X. Hong,C.J.Harris,Nonlinearmodelstructuredesignandconstructionusing orthogonal leastsquaresandD-optimalitydesign,IEEETrans.NeuralNet- works13(September(5))(2002)1245–1250. [8] S. Chen,S.A.Billings,W.Luo,Orthogonalleastsquaresmethodsandtheir applications tonon-linearsystemidentification, Int.J.Control50(5)(1989) 1873–1896. [9] K.Z. Mao,RBFneuralnetworkcenterselectionbasedon fisher ratioclass separability measure,IEEETrans.NeuralNetworks13(September(5))(2002) 1211–1217. [10] S. Chen,X.X.Wang,X.Hong,C.J.Harris,Kernelclassifier constructionusing orthogonal forwardselectionandboostingwith fisher ratioclassseparability, IEEE Trans.NeuralNetworks17(November(6))(2006)1652–1656. [11] X. Hong,S.Chen,C.J.Harris,Afastkernelclassifier constructionalgorithm using orthogonalforwardselectiontominimizeleave-one-outmisclassification rate,Int.J.Syst.Sci.39(2)(2008)119–125. [12] S. Chen,X.Hong,C.J.Harris,Particleswarmoptimizationaidedorthogonal forwardregressionforunified datamodelling,IEEETrans.Evolution.Comput. 14(August(4))(2010)477–499. [13] M.J.L. Orr,Regularisationintheselectionofradialbasisfunctioncenters, NeuralComput.7(May(3))(1995)954–975. [14] S. Chen,E.S.Chng,K.Alkadhimi,Regularisedorthogonalleastsquaresalgo- rithm forconstructingradialbasisfunctionnetworks,Int.J.Control64(5) (1996)829–837. [15] S. Chen,Y.Wu,B.L.Luk,Combinedgeneticalgorithmoptimizationand regularized orthogonalleastsquareslearningforradialbasisfunctionnet- works,IEEETrans.NeuralNetworks10(September)(1999)1239–1243. [16] S. Chen,X.Hong,C.J.Harris,Sparsekernelregressionmodellingusing combined locallyregularisedorthogonalleastsquaresandD-optimality experimentaldesign,IEEETrans.Autom.Control48(June(6))(2003) 1029–1036. [17] S.S. Chen,D.L.Donoho,M.A.Saunders,Atomicdecompositionbybasispursuit, SIAM Rev.43(March(1))(2001)129–159. [18] R. Tibshirani,Regressionshrinkageandselectionviathelasso,J.Roy.Stat.Soc. Series B58(1)(1996)267–288. [19] B. Efron,I.Johnstone,T.Hastie,R.Tibshirani,Leastangleregression,Ann.Stat. 32 (2)(2004)407–499. [20] X. Hong,M.Brown,S.Chen,C.J.Harris,Sparsemodelidentification using orthogonal forwardregressionwithbasispursuitandD-optimality,IEEProc. Control TheoryAppl.151(4)(2004)491–498. [21] H. Zou,T.Hastie,Regularizationandvariableselectionviatheelasticnet, J. Roy.Stat.Soc.SeriesB67(2)(2005)301–320. [22] Q. Li,N.Lin,TheBayesianelasticnet,BayesianAnal.5(1)(2010)151–170. [23] J. Kennedy,R.Eberhart,Particleswarmoptimization,in:Proceedingsofthe 1995IEEEInternationalConferenceonNeuralNetworks(Perth,Australia),vol. 4, November27–December 1,1995,pp.1942–1948. [24] J. Kennedy,R.C.Eberhart,SwarmIntelligence,MorganKaufmann,SanMateo, CA, 2001. [25] R.T.Rockafellar,ConvexAnalysis,PrincetonUniversityPress,Princeton, NJ, 1997. [26] A.C.Atkinson,A.N.Donev,OptimumExperimentalDesigns,Clarendon,Oxford, UK, 1992. [27] A.Ratnaweera,S.K.Halgamuge,H.C.Watson,Self-organizinghierarchical particle swarmoptimizerwithtime-varyingaccelerationcoefficients, IEEE Trans.Evol.Comput.8(June(3))(2004)240–255. [28] M.G.H. Omran,Particleswarmoptimizationmethodsforpatternrecognition and imageprocessing,Ph.D.Thesis,UniversityofPretoria,Pretoria,South Africa, 2005. [29] S.M. Guru,S.K.Halgamuge,S.Fernando,Particleswarmoptimisersforcluster formation inwirelesssensornetworks,in:Proceedingsofthe2005Interna- tional ConferenceonIntelligentSensors,SensorNetworksandInformation Processing, Melbourne,Australia,December5–8, 2005,pp.319–324. [30] K.K. Soo,Y.M.Siu,W.S.Chan,L.Yang,R.S.Chen,Particle-swarm-optimization- based multiuserdetectorforCDMAcommunications,IEEETrans.Vehicular Technol.56(September)(2007)3006–3013. [31] S. Chen,X.Hong,B.L.Luk,C.J.Harris,Non-linearsystemidentification using particle swarmoptimisationtunedradialbasisfunctionmodels,Int.J. Bio-Inspired Comput.1(4)(2009)246–258. [32] W.Yao,S.Chen,L.Hanzo,ParticleswarmoptimisationaidedMIMOmulti- user transmissiondesigns,J.Comput.Theor.Nanosci.9(2)(2012)266–275, special issueonanewfrontierofcognitiveinformaticsandcognitive computing. [33] G. Rätsch,T.Onoda,K.-R.Müller,SoftmarginsforAdaBoost,Mach.Learn.42 (3) (2001)287–320. [34] X. Hong,S.Chen,C.J.Harris,Elastic-netprefilteringfortwo-classclassification, IEEE Trans.Cybern.43(February(1))(2013)286–295. [35] 〈http://www.fml.tuebingen.mpg.de/members/raetsch/benchmark〉. [36] S. Chen,J.Wigger,Fastorthogonalleastsquaresalgorithmforefficient subset selection, IEEETrans.SignalProcess.43(July(7))(1995)1713–1715. [37] M. Abramowitz,I.A.Stegun(Eds.),HandbookofMathematicalFunctions:with Formulas, Graphs,andMathematicalTables,Dover,Mineola,NY,1965