Generating a level requires at least the code in the image below: “pip install mario-gpt” or “git clone >python setup.py install” Since MarioGPT is already open source, you can also download and experience it yourself. After ensuring that the computer has installed python version 3.8+, use the pip command or git: This is because 88% of the results it finally generates can be used to actually break through the level. This comes in the form of a pre-trained bidirectional LLM (BART).Īt the same time, the average hidden state of the forward propagation of the model is output here. Finally, it is enough to feed the output state into the cross-attention layer of the GPT2 architecture and combine it with the actual level sequence passed into the model. Regarding the effect of MarioGPT, the author expressed surprise. Like GPT2, MarioGPT can predict the next token sequence. The level in it is represented as a string, which will tokenize the encoder (Byte-Pair Encoding) through a byte. Levels are broken down by column and flattened into a single vector (or multiple levels into a batch of vectors). In order to incorporate the info entered by the user, the author arranges a frozen text encoder for MarioGPT.

The specific principle is shown in the figure below: Its training material includes Super Mario Bros and Super Mario Bros: The Lost Levels levels, provided by The Video Game Level Corpus. The authors are from Copenhagen University of Information Technology. It is the first model based on text to generate game levels (text2level), fine-tuned on GPT2 (distilgpt2). The model behind the project is called MarioGPT. Join GizChina on Telegram Generate Mario levels with GPT2

Download mate mario