Homework 1

Tapas Agarwal 11764

Environment	Deterministic vs Stochastic	Episodic vs Sequential	Static vs Dynamic	Discrete vs Continuous	Fully-Observable vs Partially-observable	Single-agent vs Multi-agent
Playing soccer	Stochastic	Sequential	Dynamic	Continuous	Partially-observable	Multi-agent
Brushing your teeth	Deterministic	Episodic	Static	Continuous	Fully-Observable	Single-agent
Playing a tennis match	Stochastic	Sequential	Dynamic	Continuous	Partially-Observable	Multi-agent
Practicing tennis against a wall	Stochastic	Sequential	Dynamic	Continuous	Fully-Observable	Single-agent
Deciding what item to take at hostel lunch	Deterministic	Episodic	Static	Discrete	Fully-Observable	Single-agent

Stochastic because it is impossible to anticipate every move and strategy of the players. Trajectory of soccer ball is also somewhat probabilistic in nature.
Sequential because series of events(i.e. passes and kicks) lead to the final aim to score a goal and win the game.In this my present actions will affect the future course of action.
Dynamic because the environment of the player(agent) keeps changing i.e. the movement of other players and movement of ball.
Continuous because the game play , movement of the ball , positions of players is dynamic and continuous .
Partially-Observable because every movement of every is difficult to track. Also players cannot anticipate every move of other players.It is difficult to observe.
Multi-agent because there many agents(i.e. players) involved in the game. There are 22 agents(i.e. players)involved in the game.