Proceedings of the 2013 International Conference on Advances in Intelligent Systems in Bioinformatics

CSLMEN: A New Optimized Method for Training Levenberg Marquardt Elman Network Based Cuckoo Search Algorithm

Authors
Nazri Mohd. Nawi, M.Z Rehman, Abdullah Khan
Corresponding Author
Nazri Mohd. Nawi
Available Online January 2014.
Keywords
Back propagation neural network, cuckoo search algorithm, local minima, artificial bee colony algorithm.
Abstract

RNNs have local feedback loops within the network which allows them to shop earlier accessible patterns. This network can be educated with gradient descent back propagation and optimization technique such as second-order methods; conjugate gradient, quasi-Newton, Levenberg- Marquardt have also been used for networks training [14, 15]. But still this algorithm is not definite to find the global minimum of the error function since gradient descent may get stuck in local minima, Nature inspired metaheuristic algorithms provide derivativefree solution to optimize complex problems. This paper proposed a new metaheuristic search algorithm, called cuckoo search (CS), based on cuckoo bird’s behavior to train Levenberg Marquardt Elman network (LMEN) in achieving fast convergence rate and to avoid local minima problem. The proposed Cuckoo Search Levenberg Marquardt Elman network (CSLMEN) results are compared with artificial bee colony using BP algorithm, and other hybrid variants. Specifically OR and XOR datasets are used. The simulation results show that the computational efficiency of BP training process is highly enhanced when coupled with the proposed hybrid method.

Copyright
© 2014, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

Volume Title
Proceedings of the 2013 International Conference on Advances in Intelligent Systems in Bioinformatics
Series
Advances in Intelligent Systems Research
Publication Date
January 2014
ISBN
978-94-6252-000-4
ISSN
1951-6851
Copyright
© 2014, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Cite this article

TY  - CONF
AU  - Nazri Mohd. Nawi
AU  - M.Z Rehman
AU  - Abdullah Khan
PY  - 2014/01
DA  - 2014/01
TI  - CSLMEN: A New Optimized Method for Training Levenberg Marquardt Elman Network Based Cuckoo Search Algorithm
BT  - Proceedings of the 2013 International Conference on Advances in Intelligent Systems in Bioinformatics
PB  - Atlantis Press
SP  - 58
EP  - 63
SN  - 1951-6851
UR  - https://www.atlantis-press.com/article/11358
ID  - Nawi2014/01
ER  -