Task |
Deterministic / Stochastic |
Episodic / Sequential |
Static / Dynamic |
Discrete / Continuous |
Fully / Partially observable |
Single agent / Multiagent |
---|---|---|---|---|---|---|
Playing soccer |
Stochastic |
Sequential |
Dyanamic |
Continous |
Partially |
Multiagent |
Brushing your teeth |
Deterministic |
Sequential |
Static |
Continous |
Partially |
Single |
Playing a tennis match |
Stochastic |
Sequential |
Dyanamic |
Continous |
Partially |
Multiagent |
Practicing tennis against a wall |
Deterministic |
Sequential |
Dyanamic |
Continous |
Partially |
Single |
Deciding what item to take at hostel lunch |
Deterministic |
Episodic |
Static |
Discrete |
Fully |
Single |
Reason for PLAYING SOCCER:
Deterministic vs Stochastic
It's stochastic as while playing soccer the next state of the game cannot be accurately determined by the agent. There is a probability of number of outcomes. And according t this probability action can be choosen to maximize the chances for a goad or reward.
Episodic vs. Sequential
It's sequential because the action agent takes now will shape its future events. In soccer to score a goal, the agent have to perform a sequence of actions which will depend on each other.In soccer the action currently taken will depend upon the position of the ball, opponent and teammates which are a result of actions taken previously.
Static vs. Dynamic
It's dynamic because the environment can change while the agent is deliberating. The opponent and ball positions are continously changing without ant consent of the agent therefore the environment is dynamic.
Discrete vs. Continuous
It's continous because the parameter that the agent has to decide like speed with which to hit, direction to move, running speed are all continous. There are infinite possibilities for scoring a goal, to pass ball to a player or to tackle from other player. All these attributes are continous variables which the agent has to decide.
Fully observable vs. Partially observable
It's partially observable because the agent can't perceive the whole environment. The agent's sensory apparatus cannot give it access to the complete state of the environment. It's sensors cannot detect all aspects like what the opponent will do, with how much speed will it hit the ball etc that are relevant to the choice of action.
Single agent vs. Multiagent
It's multiagent because the game of soccer is atleast played between two players one yourself and other the opponent. Generally there are 11 player in each team, thus 22 players in all.