A Generative AI Game Jam Case Study from October 2024

Generative Artificial Intelligence (GenAI) promises to democratize many creative endeavors, from art, to music, to writing. However, video games are an underexplored field for GenAI given the highly multi-modal and interactive nature. In this work, we present a case study game-jam-style game development process (performed over only a few days!) making heavy use of available GenAI tools (as of October 2024) to create a game called Plunderwater: Sunken Treasure, a title selected from among GenAI suggestions.

Fly, Fail, Fix: Iterative Game Repair with Reinforcement Learning and Large Multimodal Models

Game design hinges on understanding how static rules and content translate into dynamic player behavior---something modern generative systems that inspect only a game's code or assets struggle to capture. We present an automated design iteration framework that closes this gap by pairing a reinforcement learning (RL) agent, which playtests the game, with a large multimodal model (LMM), which revises the game based on what the agent does. In each loop the RL player completes several episodes, producing
(i)~numerical play metrics and/or 

Brent Keeth

Brent presently serves as a Distinguished Research Scientist within the NVIDIA Circuits Research Group. He focuses primarily on low energy, high bandwidth memory integration into future AI systems. 

Assessing Learned Models for Phase-only Hologram Compression

We evaluate the performance of four common learned models utilizing INR and VAE structures for compressing phase-only holograms in holographic displays. The evaluated models include a vanilla MLP, SIREN [Sitzmann et al. 2020], and FilmSIREN [Chan et al.