I propose to add a new environment called simplest. This would be the simplest possible environment in PyMDP, which would allow for easy debugging and prototyping when developing new features; in particular for testing online and offline learning #211 . This would be proposed on the chore/notebook_cleanup branch as a prequel to #211 .

The proposed environment would live in simplest.py insides the envs subdirectory. The environment would comprise two states, "left" and "right," which are fully controllable (i.e., two actions: "go left" and "go right" that bring to the respective state with certainty), and there would be two observations, say "left" and "right" with an identity likelihood mapping.