Preprocessing And Pretraining Of Multilayer Feed Forward Neural Network

Asadi, Roya (2009) Preprocessing And Pretraining Of Multilayer Feed Forward Neural Network. Masters thesis, Universiti Putra Malaysia.

[img] PDF
337Kb

Abstract

The main problem for Supervised Multi-layer Neural Network (SMNN) model lies in finding the suitable weights during training in order to improve training time as well as achieve higher accuracy. The important issue in the training process of the existing SMNN model is initialization of the weights. However, this process is random and creates the paradox of low accuracy and high training time. In this study, a Multi-layer Feed Forward Neural Network (MFFNN) model for classification problem is proposed. It consists of a new preprocessing technique which combines data preprocessing and pre-training that offer a number of advantages; training cycle, gradient of mean square error function, and updating weights are not needed in this model. The proposed technique is Weight Linear Analysis (WLA) based on mathematical,statistical and physical principles for generating real weights by using input values. WLA applies global mean and vectors torque formula to solve the problem. We perform data preprocessing for generating normalized input values and then applying them by a pretraining technique in order to obtain the real weights. The normalized input values and real weights are applied to the MFFNN model in one epoch without training cycle. In MFFNN model, thresholds of training set and test set are computed by using input values and real weights. In training set each instance has one special threshold and class label. In test set the threshold of each instance will be compared with the range of thresholds of training set and the class label of each instance will be predicted. To evaluate the performance of the proposed MFFNN model, a series of experiment on XOR problem and two datasets, which are SPECT Heart and SPECTF Heart was implemented. As quoted by literature, these two datasets are difficult for classification and most of the conventional methods do not process well on these datasets. For experiment result, Standard Back Propagation Network (BPN) as SMNN model is considered. SBPN is changed to MFFNN model by using WLA technique. Accuracy of MFFNN model using WLA is compared with several strong classification models and SBPN using best and latest pre-training techniques. Our results, however, show that the proposed model has been given high accuracy in one epoch without training cycle. The accuracies of 94% for SPECTF Heart and 92% for SPECT Heart which are the best results.

Item Type:Thesis (Masters)
Subject:Neural networks (Computer science)
Chairman Supervisor:Norwati Mustapha, PhD
Call Number:FSKTM 2009 10
Faculty or Institute:Faculty of Computer Science and Information Technology
ID Code:11929
Deposited By: Mohd Nezeri Mohamad
Deposited On:19 Jul 2011 03:42
Last Modified:27 May 2013 07:50

Repository Staff Only: item control page

Document Download Statistics

This item has been downloaded for since 19 Jul 2011 03:42.

View statistics for "Preprocessing And Pretraining Of Multilayer Feed Forward Neural Network "


Universiti Putra Malaysia Institutional Repository

Universiti Putra Malaysia Institutional Repository is an on-line digital archive that serves as a central collection and storage of scientific information and research at the Universiti Putra Malaysia.

Currently, the collections deposited in the IR consists of Master and PhD theses, Master and PhD Project Report, Journal Articles, Journal Bulletins, Conference Papers, UPM News, Newspaper Cuttings, Patents and Inaugural Lectures.

As the policy of the university does not permit users to view thesis in full text, access is only given to the first 24 pages only.