Saved searches
Use saved searches to filter your results more quickly
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.
Implementation of the overlapping model of the Wave Function Collapse algorithm
License
avihuxp/WaveFunctionCollapse
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Name already in use
A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
Sign In Required
Please sign in to use Codespaces.
Launching GitHub Desktop
If nothing happens, download GitHub Desktop and try again.
Launching GitHub Desktop
If nothing happens, download GitHub Desktop and try again.
Launching Xcode
If nothing happens, download Xcode and try again.
Launching Visual Studio Code
Your codespace will open once ready.
There was a problem preparing your codespace, please try again.
Latest commit
Git stats
Files
Failed to load latest commit information.
README.md
A Generative Model For Random Image And Pattern Extrapolation
This project is my implementation of the «Wave Function Collapse» algorithm. The program is designed to generate an output pattern of arbitrary size, given a small image as its input, such that at any small environment in the output image, there is a resemblance to the input image.
This implementation of the algorithm is written with functional programming design in mind, and enables runtime rendering of the collapse process, pattern extraction and viewing (unrelated to the actual algorithm run), and saving the result of each algorithm run both as an image of the final product and as a video of the collapse process itself.
For a full demo video check this link.
Wave Function Collapse explained
The «wave function collapse» algorithm, as it is used in computer science and game design, is a technique that generates random but coherent sequences of events or states (in our case, this is the output image). The algorithm is based on the idea of the wave function collapse from quantum mechanics, where a system in a superposition of states collapses into a single definite state.
The input parameters for the algorithm include the initial state of the system (in our case, all patterns are valid in all cells), a set of rules for the possible transitions between states, and a probability distribution for those transitions (as gathered from the input data). The algorithm proceeds in steps, in each step a new state is selected according to the transition rules and probability distribution.
The stages of the algorithm are as follows:
- Initialization: This step can be broken into 3 parts:
- The algorithm interprets the input, and gathers from it all possible states and patters for each cell of the wave.
- The algorithm gathers the transition rules, meaning which patterns or states can relate to each other and in what way.
- The ‘wave’ (which is a matrix with width and height of the output, and with depth corresponding to the number of patterns gathered) is initiated, with all patterns valid in all the cells.
- Observe: A new state (a specific pattern in a specific cell) with the minimal entropy (i.e. the minimal number of patterns possible) is selected according to the transition rules and probability distribution: In case of a draw in entropy, the algorithm will choose a cell randomly from all cells with minimal entropy. After a cell with minimal entropy is found, it is collapsed (a pattern is chosen for it, and it is no longer in superposition) using the probability distribution of the patterns.
- Propagate: The wave’s state is now updated, with all cells affected by the collapse of the cell in the previous step updated to hold only valid patterns.
- Repeat: The algorithm continues to repeat steps 2 and 3 until all cells — and by that the wave — are fully collapsed. The output of the algorithm is the collapsed wave, meaning that at each cell, only one pattern is valid, and will be selected for the output image.
This algorithm is widely used in game design, to generate random but coherent levels, items, enemies, etc. in a game, but also in other fields such as natural language processing, music generation, art, and many others. For further reading, I recommend this blogpost by Robert Heaton.
The program requires the following to run:
git clone https://github.com/avihuxp/WaveFunctionCollapse.git
pip install -r requirements.txt
Run the program, with the following usage:
python3 wave_function_collapse.py input_path> pattern_size> out_height> out_width> [flip] [rotate] [render_iterations] [render_video] - path_to_input_image — str : The path to the input image for the algorithm, i.e. the base pattern.
- pattern_size — int : The size of the square sub images of the input image, should be as small as possible for efficiency, and large enough to capture the largest basic feature in the input image.
- out_height \ out_width — int s: the size, in pixels, of the output of the program.
Optional parameters
- flip — bool : Default is False , if True , the output will be able to include flipped (horizontally and vertically) versions of every pattern extracted from the input image.
- rotate — bool : Default is False , if True , the output will be able to include rotated (by 90°, 180°, and 270°) versions of every pattern extracted from the input image.
- render_iterations — bool : Default is True , if True , will render the state of the wave every NUM_OF_ITERATIONS_BETWEEN_RENDER = 15 iteration using matplotlib figure.
- render_video — bool : Default is True , if True , after collapsing the wave, will save a video of the collapsing of the wave, see additional info in the following section.
Other parameters inside the program
These parameters are found at the top of the python file, and can be changed before running:
Render in runtime parameters:
- NUM_OF_ITERATIONS_BETWEEN_RENDER = 15 — The number of iterations between rendering in runtime
- SHOW_PATTERNS = False — Set to True to render all patterns and their probabilities
- SAVE_PATTERNS = False — Set to True to save all patterns to file
- PRINT_RULES = False — Set to True to print out all adjacency rules
Video rendering parameters:
- DEFAULT_FPS = 30 — Fps of the output video
- DEFAULT_VIDEO_LENGTH = 6 — Length of the output video
- DEFAULT_OUT_VID_HEIGHT = 1000 — Vertical size (in pixels) of the output video, which will preserve the original aspect ratio
- Generate outputs from both RGB and GrayScale images.
- Render images of the collapse progress in runtime using matplotlib.
- Output the result of the algorithm to a large size image for better viewing experience.
- Improved runtime performance
- Added support for initial wave states (i.e. letting the wave function know about sky / ground / walls in the input image).
- Wrap around support for pattern extraction.
- Add a «Stride» option for pattern extraction, rules initialization, and propagation, so that this code will be able to run the tiled variant of the WFC algorithm.
- add video of usage with different output options to README
See the open issues for a full list of proposed features (and known issues).
Resources and Acknowledgments
This project is heavily inspired and implemented with the help of the following sources:
- The original WaveFunctionCollapse implementation, which can be found in Maxim Gumin’s repo.
- The paper based on mxgmn’s work.
- The Coding Train’s video on WaveFunctionCollapse , which introduced me to the algorithm, though it implements the tiled variant of the algorithm.
Also, OrrMatzkin deserves a noteable mention for the help with the README file.
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the «Software»), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
About
Implementation of the overlapping model of the Wave Function Collapse algorithm