Homework 1

2. Task Identification

Task	Deterministic vs. stochastic	Episodic vs. sequential	Static vs. dynamic	Discrete vs. continuous	Fully observable vs. partially observable	Single agent vs. multiagent
Playing soccer	Stochastic	Sequential	Dynamic	Continuous	Partially Observable	Multi Agent
Brushing your teeth	Deterministic	Sequential	Static	Continuous	Partially Observable	Single Agent
Playing a tennis match	Stochastic	Sequential	Dynamic	Continuous	Partially Observable	Multi Agent
Practising tennis against a wall	Deterministic	Sequential	Dynamic	Continuous	Fully Observable	Single Agent
Deciding what item to take at hostel lunch	Deterministic	Episodic	Static	Discrete	Fully Observable	Single Agent

Deterministic vs Stochastic: It's stochastic as while playing soccer the next state of the game cannot be accurately determined by the agent. There are many possible outcomes.

Episodic vs. Sequential: It's sequential because the action agent takes now will shape its future events. In soccer to score a goal or to defend, the agent have to perform a sequence of actions which will depend on each other.

Static vs. Dynamic: It's dynamic because the environment keeps changing. The opponent and ball positions are continuously changing.

Discrete vs. Continuous: It's continuous because the parameter that the agent has to decide like speed with which to hit, direction to move, running speed are all continuous. There are infinite possibilities for scoring a goal, to pass ball to a player or to tackle from other player. All these attributes are continuous variables which the agent has to decide.

Fully observable vs. Partially observable: It's partially observable because the agent can't perceive the whole environment. The agent's sensory apparatus cannot give it access to the complete state of the environment.

Single agent vs. Multiagent: It's multiagent because the game of soccer is played atleast between two teams.

Back

1. Cartoon

Robots make fun of human..

2. Task Identification