LogFAQs > #976641339

Steiner posted...

maybe i missed something saying otherwise but i'm under the impression this was all driven by visuals and not accessing actual data

He explains the full input later, it's the last 3 frames of visuals, plus some encoded game data. So he could encode more game data in there.

Technically though, you should be able to train a model using this method purely with visuals, and a really high-level goal like "reach the end screen". You would just need to run the training for millions or even billions of iterations so that the randomness has a chance to get to the end. Adding intermediate goals helps training massively since the randomness can latch onto something exponentially quicker.