Task | Deterministic/Stochastic | Episodic/Sequential | Static/Dynamic | Discrete/Continuous | Fully/Partially Observable | Single/Multi-Agent |
---|---|---|---|---|---|---|
Playing Soccer | Stochastic | Sequential | Dynamic | Continuous | Partially Observable | Multi-Agent |
Brushing your teeth | Deterministic | Sequential | Static | Continuous | Partially Observable | Single |
Playing a tennis match | Stochastic | Sequential | Dynamic | Continuous | Partially Observable | Multi-Agent |
Practicing tennis against a wall | Deterministic | Sequential | Dynamic | Continuous | Fully Observable | Single |
Deciding what item to take at hostel lunch | Deterministic | Episodic | Static | Discrete | Fully Observable | Single |
Playing Soccer is stochastic as it is a very complex real life task that it is impossible to keep track of all the unobserved aspects. Here, one can never predict what exactly the opponent is planning to do. There are numerous uncertainites associated when one kicks the ball or tackles a player ,etc. It is sequential as here the agent's experience is not divided into atomic episodes. Here, the current decision could affect all future decisions. It is a highly dynamic task as here the agent's environment can change while the agent is deliberating. The state of the environment keeps on changing continously and it cannot be divided into finite number of states, which makes it a continous task. The agent, player, is continously observing the situation and taking actions. A task environment is effectively fully observable if the sensors detect all aspects that are relevant to the choice of action. Here, we don't know what other players are thinking, where they will move next second and where the ball will be next minute. This makes it a partially observable task. It is clearly a multi agent task as there are 22 players on the field looking at the environment from their point of view and taking actions.