Content
summary Summary

Bots in games like Counter-Strike typically don't pose much of a challenge for pro players. But MLMOVE, an AI trained on over 100 hours of gameplay, could change that.

Ad

Researchers from Stanford, Activision Blizzard, Nvidia, University of Washington and Cornell have created a bot called MLMOVE that aims to replicate the movements of pro Counter-Strike: Global Offensive (CS:GO) players.

The team used imitation learning to train a transformer-based motion model on 123 hours of pro CS:GO gameplay.

In this video, three MLMove bots on offense perform a flank attack against three MLMove bots on defense. | Video: Durst et al.

Ad
Ad

Existing bots for multiplayer first-person shooters struggle to generate realistic, coordinated movements due to the complexity of human behavior and real-time gameplay demands. MLMOVE focuses on human-like movements in the "Retakes" mode on the de_dust2 map.

The figures show the proportion of time players spend in different regions of the map, aggregated over 1,430 game rounds. The heatmaps of human players and those of MLMove show great similarities. Image: Durst et al.

CSKNOW: data set from 17,000 hours of play

The researchers built a dataset called CSKNOW with game state info from over 17,000 rounds of pro CS:GO matches. This dataset trained the movement model to predict player movement commands based on the current game state. The model was then combined with rule-based aiming and shooting to create the full MLMOVE bot.

Image: Durst et al.

In a user study, human raters consistently judged MLMOVE's movements as more human-like than a rule-based bot and the standard CS:GO bot.

Quantitative analysis showed MLMOVE's behavior was more similar to human gameplay in map positioning, teamwork tactics, and kill/lifetime distributions.

Image: Durst et al.

The researchers also conducted quantitative analyses of self-play experiments, comparing the distribution of player positions, instances of teamwork and game outcomes between human gameplay and bot self-play.

Recommendation

The results indicated that MLMOVE's behavior was more similar to human gameplay than the baseline bots in terms of map occupation, use of flanking and spreading tactics, and distribution of kills and player lifetimes.

Will e-athletes soon be training on AI opponents?

MLMOVE demonstrates the potential of imitation learning for creating human-like AI in complex team games. In the future, this approach could lead to challenging AI opponents in competitive shooters and even be used to train esports athletes.

However, MLMOVE currently only works for one specific map and game mode in CS:GO. Further training would be needed to expand it to other games, maps and modes.

Further information and gameplay videos can be found on the project page.

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • A team of researchers from Stanford University, University of Washington, Cornell University, Activision Blizzard and Nvidia has developed MLMOVE, a bot that mimics the movements of professional CS:GO players using imitation learning based on a dataset of 123 hours of professional gameplay.
  • For the training, the CSKNOW dataset was created, which contains game state information from over 17,000 rounds of professional CS:GO matches. A transformer-based movement model predicts movement commands based on this and is combined with a rule-based aiming and shooting system to create the MLMOVE bot.
  • In quantitative analyses, MLMOVE showed more human-like behavior than previous bots in terms of map placement, tactics and game results. In the future, the technology could lead to challenging AI opponents in competitive games and in training for e-athletes.
Sources
Jonathan works as a technology journalist who focuses primarily on how easily AI can already be used today and how it can support daily life.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.