Deep reinforcement learning for procedural content generation of 3D virtual environments

Christian E. López, James Cunningham, Omar Ashour, Conrad S. Tucker

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

This work presents a deep reinforcement learning (DRL) approach for procedural content generation (PCG) to automatically generate three-dimensional (3D) virtual environments that users can interact with. The primary objective of PCG methods is to algorithmically generate new content in order to improve user experience. Researchers have started exploring the use of machine learning (ML) methods to generate content. However, these approaches frequently implement supervised ML algorithms that require initial datasets to train their generative models. In contrast, RL algorithms do not require training data to be collected a priori since they take advantage of simulation to train their models. Considering the advantages of RL algorithms, this work presents a method that generates new 3D virtual environments by training an RL agent using a 3D simulation platform. This work extends the authors' previous work and presents the results of a case study that supports the capability of the proposed method to generate new 3D virtual environments. The ability to automatically generate new content has the potential to maintain users' engagement in a wide variety of applications such as virtual reality applications for education and training, and engineering conceptual design.

Original languageEnglish (US)
Article number051005
JournalJournal of Computing and Information Science in Engineering
Volume20
Issue number5
DOIs
StatePublished - Oct 2020

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Science Applications
  • Computer Graphics and Computer-Aided Design
  • Industrial and Manufacturing Engineering

Fingerprint Dive into the research topics of 'Deep reinforcement learning for procedural content generation of 3D virtual environments'. Together they form a unique fingerprint.

Cite this