Homework 1
1. Cartoon
2. Task Identification
| Task | Deterministic vs. Stochastic | Episodic vs. Sequential. | Static vs. Dynamic. | Discrete vs. Continuous. | Fully observable vs. Partially observable. | Single agent vs. Multi-agent. |
|---|---|---|---|---|---|---|
| Playing soccer | Stochastic | Sequential | Dynamic | Continuous | Partially observable | Multi-agent |
| Brushing your teeth | Deterministic | Episodic | Static | Continuous | Partially observable | Single agent |
| Playing a tennis match | Stochastic | Sequential. | Dynamic. | Continuous. | Partially observable. | Multi-agent. |
| Practicing tennis against a wall | Deterministic | Sequential. | Static | Continuous. | Fully observable | Single agent |
| Deciding what item to take at hostel lunch | Deterministic | Sequential. | Static | Discrete | Fully observable | Single agent |
Reasons of " Practicing tennis against a wall " :
- Deterministic : If the next state of the environment is completely determined by the current state and the action executed by the agent, then we say the environment is deterministic. When agent hits tennis ball , next position can be calculated mathematically as we know the direction of the ball.
- Sequential : As new position of tennis ball depends on the previous action taken by robot , so this is sequential.
- Static : We say that environment is static if , it's state doesn't change while agent is taking action .
- Continuous : As position of tennis ball is not at a discrete points ,so state of environment is not finite. Therefore Continuous.
- Fully observable : Robot can detect the position of the tennis ball .
- Single agent : No other agent is involved as it is playing against wall.