A comparative analysis of dynamic averaging techniques in federated learning

Simple item page
dc.contributor.authorReddy, Sashlin
dc.date.accessioned2021-04-30T15:40:53Z
dc.date.available2021-04-30T15:40:53Z
dc.date.issued2020
dc.descriptionA dissertation submitted in fulfilment of the requirements for the degree Master of Science in the School of Computer Science and Applied Mathematics, Faculty of Science, University of the Witwatersrand, 2020en_ZA
dc.description.abstractDue to the advancements in mobile technology and user privacy concerns, federated learning has emerged as a popular machine learning (ML) method to push training of statistical models to the edge. Federated learning involves training a shared model under the coordination of a centralized server from a federation of participating clients. In practice federated learning methods have to overcome large network delays and bandwidth limits. To overcome the communication bottlenecks, recent works propose methods to reduce the communication frequency that have negligible impact on model accuracy also defined as model performance. Naive methods reduce the number of communication rounds in order to reduce the communication frequency. However, it is possible to invest communication more efficiently through dynamic communication protocols. This is deemed as dynamic averaging. Few have addressed such protocols. More so, few works base this dynamic averaging protocol on the diversity of the data and the loss. In this work, we introduce dynamic averaging frameworks based on the diversity of the data as well as the loss encountered by each client. This overcomes the assumption that each client participates equally and addresses the properties of federated learning. Results show that the overall communication overhead is reduced with negligible decrease in accuracyen_ZA
dc.description.librarianCK2021en_ZA
dc.facultyFaculty of Scienceen_ZA
dc.format.extentOnline resource (108 leaves)
dc.identifier.citationReddy, Sashlin (2020) A comparative analysis of dynamic averaging techniques in federated learning, University of the Witwatersrand, Johannesburg, <http://hdl.handle.net/10539/31059>
dc.identifier.urihttps://hdl.handle.net/10539/31059
dc.language.isoenen_ZA
dc.schoolSchool of Computer Science and Applied Mathematicsen_ZA
dc.subject.lcshWeb-based instruction
dc.subject.lcshMachine learning
dc.titleA comparative analysis of dynamic averaging techniques in federated learningen_ZA
dc.typeThesisen_ZA
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
Sashlin Reddy 675723_dissertation.pdf
Size:
14.66 MB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
ETD Collection