Task | Stochastic or deterministic | episodic or sequential | Static or dynamic | discrete or continuous | partially or fully observable | Single or multiagent |
---|---|---|---|---|---|---|
Playing Soccer | stochastic | sequential | dynamic | continuous | partially observable | Multiagent |
Brushing your teeth | deterministic | episodic | static | continuous | Partially observable | Single agent |
Playing a tennis match | stochastic | sequential | dynamic | continuous | Partially observable | Multiagent |
Practicing tennis against the wall | stochastic | sequential | dynamic | continuous | Fully observable | Single agent |
Deciding what item to take at hostel lunch | deterministic | episodic | static | discrete | Fully observable | Single agent |
Reasons for Playing Tennis Match: Stochastic : While playing the state and position of the game cant be determined by the player. It is probabilistic in nature depending on many factors and situations. The player can only judge the best course of action based on probability and cant be deterministic. Sequential : The decision taken previously affects the outcome of the match. Dynamic: The environment changes continuosly and the factors like angle, spin and speed are continuosly changing (dynamic). Continuous : Player has to continously decide on number of things, where to run, where to strike the ball etc. All the attributes are continuous. Partially Observable : The player cant possibly fully observe the spin, strength and many other factors. Taking an example, if he is returning a shot facing one side of court the player cant observe the opponent completely, making it partially observable. Multiagent : The game depends upon the decisions of at least two people.