Actions Deterministic vs Stochastic Episodic vs Sequential Dynamic vs Static Continuous vs Discrete Fully observable vs Partially Observable Single agent vs Multi agent
Playing soccer Stochastic Sequential Dynamic Continuous Partially Multi
Brushing your teeth Deterministic Sequential Static Continuous Fully Single
Playing a tennis match Stochastic Sequential Dynamic Continuous Partially Multi
Practicing tennis against a wall Deterministic Episodic Static Continuous Fully Single
Deciding what item to take at hostel lunch Deterministic Episodic Static Discrete Fully Single

Explanation for Playing soccer
1. Stochastic - It is stochastic because next state cannot be completely determined by the current state and the action selected by agents. We do not know what about team's player are thinking.
2. Sequential - It is sequential because subsequent episodes depends on the previous episodes i.e where the ball was, positioning of other players.
3. Dynamic - It is dynamic because the environment continuosly changes while player is making his move.
4. Continuous - The decision space of player is continuous. He position the ball in a continuous space and his moves are from a continuos space. The moves aren't finite and discrete.
5. Partially observable - It is partially observable because while playing the agent only knows about himself or partially about his teammates(beacuse of strategy on which they are playing). He doesn't know what moves the opposition members will make.
6. Multi-agent - Many playing ae working to determine a state.




The comic is sometimes about 2100 AD

some_text