Creating an adaptive collaborative playstyle-aware companion agent
| dc.contributor.author | Arendse, Lindsay John | |
| dc.contributor.supervisor | Rosman, Benjamin | |
| dc.date.accessioned | 2024-11-25T20:06:23Z | |
| dc.date.available | 2024-11-25T20:06:23Z | |
| dc.date.issued | 2023-09 | |
| dc.description | A dissertation submitted in fulfilment of the requirements for the degree of Master of Science, to the Faculty of Science, School of Computer Science & Applied Mathematics, University of the Witwatersrand, Johannesburg, 2023. | |
| dc.description.abstract | Companion characters in video games play a unique part in enriching player experience. Companion agents support the player as an ally or sidekick and would typically help the player by providing hints, resources, or even fight along-side the human player. Players often adopt a certain approach or strategy, referred to as a playstyle, whilst playing video games. Players do not only approach challenges in games differently, but also play games differently based on what they find rewarding. Companion agent characters thus have an important role to play by assisting the player in a way which aligns with their playstyle. Existing companion agent approaches fall short and adversely affect the collaborative experience when the companion agent is not able to assist the human player in a manner consistent with their playstyle. Furthermore, if the companion agent cannot assist in real time, player engagement levels are lowered since the player will need to wait for the agent to compute its action - leading to a frustrating player experience. We therefore present a framework for creating companion agents that are adaptive such that they respond in real time with actions that align with the player’s playstyle. Companion agents able to do so are what we refer to as playstyle-aware. Creating a playstyle-aware adaptive agent firstly requires a mechanism for correctly classifying or identifying the player style, before attempting to assist the player with a given task. We present a method which can enable the real time in-game playstyle classification of players. We contribute a hybrid probabilistic supervised learning framework, using Bayesian Inference informed by a K-Nearest Neighbours based likelihood, that is able to classify players in real time at every step within a given game level using only the latest player action or state observation. We empirically evaluate our hybrid classifier against existing work using MiniDungeons, a common benchmark game domain. We further evaluate our approach using real player data from the game Super Mario Bros. We out perform our comparative study and our results highlight the success of our framework in identifying playstyles in a complex human player setting. The second problem we explore is the problem of assisting the identified playstyle with a suitable action. We formally define this as the ‘Learning to Assist’ problem, where given a set of companion agent policies, we aim to determine the policy which best complements the observed playstyle. An action is complementary such that it aligns with the goal of the playstyle. We extend MiniDungeons into a two-player game called Collaborative MiniDungeons which we use to evaluate our companion agent against several comparative baselines. The results from this experiment highlights that companion agents which are able to adapt and assist different playstyles on average bring about a greater player experience when using a playstyle specific reward function as a proxy for what the players find rewarding. In this way we present an approach for creating adaptive companion agents which are playstyle-aware and able to collaborate with players in real time. | |
| dc.description.submitter | MMM2024 | |
| dc.faculty | Faculty of Science | |
| dc.identifier | 0000-0002-5134-5637 | |
| dc.identifier.citation | Arendse, Lindsay John. (2023). Creating an adaptive collaborative playstyle-aware companion agent. [Master's dissertation, University of the Witwatersrand, Johannesburg]. https://hdl.handle.net/10539/42892 | |
| dc.identifier.uri | https://hdl.handle.net/10539/42892 | |
| dc.language.iso | en | |
| dc.publisher | University of the Witwatersrand, Johannesburg | |
| dc.rights | ©2023 University of the Witwatersrand, Johannesburg. All rights reserved. The copyright in this work vests in the University of the Witwatersrand, Johannesburg. No part of this work may be reproduced or transmitted in any form or by any means, without the prior written permission of University of the Witwatersrand, Johannesburg. | |
| dc.rights.holder | University of the Witwatersrand, Johannesburg | |
| dc.school | School of Computer Science and Applied Mathematics | |
| dc.subject | Game AI | |
| dc.subject | Companion agents | |
| dc.subject | Companion agents in video games | |
| dc.subject | Collaborative agents | |
| dc.subject | Playstyle identification | |
| dc.subject | Playstyles | |
| dc.subject | Player modeling | |
| dc.subject | Supervised learning | |
| dc.subject | Reinforcement Learning | |
| dc.subject | Bayesian inference | |
| dc.subject | K-nearest neighbour | |
| dc.subject | Deep Q-learning | |
| dc.subject | Rogue-like | |
| dc.subject | Platforming | |
| dc.subject | MiniDungeons | |
| dc.subject | Super Mario Bros | |
| dc.subject | UCTD | |
| dc.subject.other | SDG-9: Industry, innovation and infrastructure | |
| dc.title | Creating an adaptive collaborative playstyle-aware companion agent | |
| dc.type | Dissertation |