Plotting Behind the Scenes: Towards Learnable Game Engines

Overview Dataset
Action-Conditioned Video Prediction Video Completion Unconditional Generation Random Conditioning Baselines Ablation
Camera Manipulation Style Manipulation Baselines Ablation
Paper GitHub

Random Conditioning

Results for the task of generating sequences given a randomly selected 5% portion of the ground truth actions and state properties.

Minecraft

Tennis