• Jul 03, 2017 News!Good News! Since 2017, IJMLC has been indexed by Scopus!
  • Nov 14, 2017 News!Vol.7, No.5 has been published with online version.   [Click]
  • Aug 15, 2017 News![CFP] 2017 the annual meeting of IJMLC Editorial Board, ACMLC 2017, will be held in Singapore, December 8-10, 2017   [Click]
Search
General Information
Editor-in-chief
Dr. Lin Huang
Metropolitan State University of Denver, USA
It's my honor to take on the position of editor in chief of IJMLC. We encourage authors to submit papers concerning any branch of machine learning and computing.
IJMLC 2016 Vol.6(1): 27-31 ISSN: 2010-3700
DOI: 10.18178/ijmlc.2016.6.1.566

Whole Layers Transfer Learning of Deep Neural Networks for a Small Scale Dataset

Yoshihide Sawada and Kazuki Kozuka
Abstract—In this article, we propose a transfer learning method for the deep neural network (DNN). Deep learning has been widely used in many applications such as image classification and object detection. However, it is hard to apply deep learning methods when we cannot get a large amount of training data. To tackle this problem, we propose a new method that re-uses all parameters of the DNN trained on source images. Our proposed method first trains the DNN to solve the source task. Second, we evaluate the relation between the source labels and the target ones. To evaluate the relation, we use the output values of the DNN when we input the target images to the DNN trained on the source images. Then, we compute the probabilities of each target label by vetting the output values. After computing the probabilities, we select the output variables of the peaks of each probability as the most related source label. Then, we tune all parameters in such a way that the selected variables respond as the outputs variables of the target labels. Experimental results by using the MNIST (source) and the X-ray CT images (target) show that our proposed method can improve classification performance.

Index Terms—Deep learning, deep neural network, deep Boltzmann machine, stacked autoencoders, transfer learning, computer aided diagnosis.

The authors are with Panasonic Corporation, Japan (e-mail: sawada.yoshihide@jp.panasonic.com, kozuka.kazuki@jp.panasonic.com).

[PDF]

Cite: Yoshihide Sawada and Kazuki Kozuka, "Whole Layers Transfer Learning of Deep Neural Networks for a Small Scale Dataset," International Journal of Machine Learning and Computing vol.6, no. 1, pp. 27-31, 2016.

Copyright © 2008-2015. International Journal of Machine Learning and Computing. All rights reserved.
E-mail: ijmlc@ejournal.net