• Jul 03, 2017 News!Good News! Since 2017, IJMLC has been indexed by Scopus!
  • Aug 15, 2017 News![CFP] 2017 the annual meeting of IJMLC Editorial Board, ACMLC 2017, will be held in Singapore, December 8-10, 2017.   [Click]
  • Sep 09, 2017 News!Vol.7, No.4 has been published with online version.   [Click]
General Information
Dr. Lin Huang
Metropolitan State University of Denver, USA
It's my honor to take on the position of editor in chief of IJMLC. We encourage authors to submit papers concerning any branch of machine learning and computing.
IJMLC 2012 Vol.2(4): 481-486 ISSN: 2010-3700
DOI: 10.7763/IJMLC.2012.V2.172

A Regularized Inverse QR Decomposition Based Recursive Least Squares Algorithm for the CMAC Neural Network

C. W. Laufer and G. Coghill
Abstract—The Cerebellar Model Articulation Controller (CMAC) neural network is an associative memory that is biologically inspired by the cerebellum, which is found in the brains of animals. The standard CMAC uses the least mean squares algorithm (LMS) to train the weights. Recently, the recursive least squares (RLS) algorithm was proposed as a superior algorithm for training the CMAC online as it can converge in one epoch, and does not require tuning of a learning rate. However, the RLS algorithm was found to be very computationally demanding. In this work, the RLS computation time is reduced by using an inverse QR decomposition based RLS (IQR-RLS) algorithm which is also parallelized for multi-core CPUs. Furthermore, this work shows how the IQR-RLS algorithm may be regularized which greatly improves the generalization capabilities of the CMAC.

Index Terms—CMAC, inverse QR-RLS, regularization, recursive least squares.

The authors are with the Department of Electrical and Electronic Engineering, University of Auckland, Auckland, New Zealand (e-mail: clau070@aucklanduni.ac.nz; g.coghill@auckland.ac.nz).


Cite:C. W. Laufer and G. Coghill, "A Regularized Inverse QR Decomposition Based Recursive Least Squares Algorithm for the CMAC Neural Network," International Journal of Machine Learning and Computing vol.2, no. 4, pp. 481-486, 2012.

Copyright © 2008-2015. International Journal of Machine Learning and Computing. All rights reserved.
E-mail: ijmlc@ejournal.net