eCite Digital Repository

Data mining using higher order neural network models with adaptive neuron activation functions


Xu, S, Data mining using higher order neural network models with adaptive neuron activation functions, International Journal of Advancements in Computing Technology , 2, (4) pp. 168-177. ISSN 2005-8039 (2010) [Refereed Article]

Restricted - Request a copy

Copyright Statement

Copyright © 2010 International Association for Information, Culture, Human and Industry

Official URL:

DOI: doi:10.4156/ijact.vol2.issue4.18


An information processing algorithm which simulates the way biological neural systems process information, and one of the most popular machine learning algorithms, ANN (Artificial Neural Network) has been extensively used for Data Mining, which extracts hidden patterns and valuable information from large databases. Data Mining is commonly used in a wide range of practices such as accounting, marketing, fraud detection, scientific discovery, etc. This paper introduces a new adaptive Higher Order Neural Network (HONN) model and applies it in data mining tasks such as determining liver disorders and predicting breast cancer recurrences. A new activation function which is a combination of sine and sigmoid functions is used as the neuron activation function for the new HONN model. There are free parameters in the new activation function. The paper compares the new HONN model against a Multi-Layer Perceptron (MLP) with the sigmoid activation function, an RBF Neural Network with the gaussian activation function, and a Recurrent Neural Network (RNN) with the sigmoid activation function. Experimental results show that the new HONN model offers several advantages over conventional ANN models such as improved generalisation capabilities as well as abilities in handling missing values in a dataset.

Item Details

Item Type:Refereed Article
Keywords:Neural network, Higher order neural network, Data mining, Adaptive neural network, Adaptive neuron activation function.
Research Division:Information and Computing Sciences
Research Group:Machine learning
Research Field:Neural networks
Objective Division:Information and Communication Services
Objective Group:Information systems, technologies and services
Objective Field:Information systems, technologies and services not elsewhere classified
UTAS Author:Xu, S (Dr Shuxiang Xu)
ID Code:65565
Year Published:2010
Deposited By:Information and Communication Technology
Deposited On:2010-11-23
Last Modified:2014-12-09

Repository Staff Only: item control page