Empirical analysis of neural networks training optimisation

dc.contributor.authorKayembe, Mutamba Tonton
dc.date.accessioned2017-01-19T06:42:47Z
dc.date.available2017-01-19T06:42:47Z
dc.date.issued2016
dc.descriptionA Dissertation submitted to the Faculty of Science, University of the Witwatersrand, Johannesburg, in fulfilment of the requirements for the degree of Master of Science in Mathematical Statistics,School of Statistics and Actuarial Science. October 2016.en_ZA
dc.description.abstractNeural networks (NNs) may be characterised by complex error functions with attributes such as saddle-points, local minima, even-spots and plateaus. This complicates the associated training process in terms of efficiency, convergence and accuracy given that it is done by minimising such complex error functions. This study empirically investigates the performance of two NNs training algorithms which are based on unconstrained and global optimisation theories, i.e. the Resilient propagation (Rprop) and the Conjugate Gradient with Polak-Ribière updates (CGP). It also shows how the network structure plays a role in the training optimisation of NNs. In this regard, various training scenarios are used to classify two protein data, i.e. the Escherichia coli and Yeast data. These training scenarios use varying numbers of hidden nodes and training iterations. The results show that Rprop outperforms CGP. Moreover, it appears that the performance of classifiers varies under various training scenarios.en_ZA
dc.description.librarianLG2017en_ZA
dc.format.extentOnline resource (xiv, 145 leaves)
dc.identifier.citationKayembe, Mutamba Tonton (2016) Empirical analysis of neural networks training optimisation, University of Witwatersrand, Johannesburg, <http://wiredspace.wits.ac.za/handle/10539/21679>
dc.identifier.urihttp://hdl.handle.net/10539/21679
dc.language.isoenen_ZA
dc.subject.lcshNeural networks (Computer science)
dc.subject.lcshTraining
dc.titleEmpirical analysis of neural networks training optimisationen_ZA
dc.typeThesisen_ZA
Files
Original bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
MSc_Dissertation_MT_Kayembe_678213.pdf
Size:
1.46 MB
Format:
Adobe Portable Document Format
Description:
Main article
No Thumbnail Available
Name:
Signed Declaration_for_MSc_Dissertion_MT_Kayembe_678213.pdf
Size:
102.96 KB
Format:
Adobe Portable Document Format
Description:
Declaration
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description:
Collections