Assignment 1

Part 2

Playing Soccer	Brushing your teeth	Playing a tennis match	Playing tennis against wall	Deciding what item to take at lunch
Stochastic	Deterministic	Stochastic	Deterministic	Deterministic
Sequential	Sequential	Sequential	Sequential	Episodic
Dynamic	Static	Dynamic	Dynamic	Static
Continuous	Continuous	Continuous	Continuous	Discrete
Partially Observable	Partially Observable	Partially Observable	Fully Observable	Fully Observable
Multi-agent	Single agent	Multi-agent	Single Agent	Single Agent

Explanation for playing soccer

Stochastic

Future state is is dependent on how other players behave and weather conditions.

Sequential

Action depends on past actions.As an example you move towards the ball in the direction it was kicked before

Dynamic

The position of ball and player is changing.

Continuous

Decisions like how hard to kick the ball and at what angle are continuous

Partially Observable

Some information might not be available to the agent, like the intentions of other player and the actions they are about to take

Multi-agent

Other players playing the game.