Logo

Performance of Multi-Layer Perceptron Neural Networks with an Exponential Decay Activation Function in Airwaves Estimation

Muhammad , Abdulkarim and Wan Ahmad, Wan Fatimah and Shafie, Afza and Razali, Radzuan (2013) Performance of Multi-Layer Perceptron Neural Networks with an Exponential Decay Activation Function in Airwaves Estimation. [Citation Index Journal]

[img] Other (IJASCSE volume 2 issue 2 )
28Kb

Abstract

Activation function is one of the main characteristic elements and a vital part of Artificial Neural Networks (ANN). It is a mathematical formula present within processing unit the (neuron) of the network known to play significant role for the convergence of training algorithms. Activation function also provides nonlinear mapping potential which determine and prevent outputs of the processing unit from attaining outsized values that can inhibit training and paralyze the neural networks. Logistic (sigmoid and tangent hyperbolic) and linear are the most used activation functions in practice for the Multi-Layer Perceptron (MLP) networks. In this study, we evaluate the performance of MLP with an exponential decay function as the hidden layer activation function in the context of Marine Controlled Source Electro-Magnetic (MCSEM). Simulated airwaves data from five different sea water depths were used to evaluate the estimation performance of the MLP neural networks. The benchmark for the performance evaluation is by comparing the exponential decay activation function with log-sigmoid and tan-sigmoid activation functions through back propagation algorithm. The results seem to indicate an improved estimation performance with the exponential decay function by producing better values of Mean Square Error, Sum of Squares Error and coefficient of determination (R2).

Item Type:Citation Index Journal
Impact Factor:0.344
Subjects:T Technology > T Technology (General)
Academic Subject One: Neural Networks
Departments / MOR / COE:Departments > Computer Information Sciences
ID Code:11080
Deposited By: Assoc Prof Dr Wan Fatimah Wan Ahmad
Deposited On:16 Feb 2014 23:41
Last Modified:16 Feb 2014 23:41

Repository Staff Only: item control page

Document Downloads

More statistics for this item...