1.Playing Soccer
- Stochastic -
as there is a physical component involved there is always a risk of failure, which can give rise to a different result
- Sequential -
every action has repercussions for the choice of future actions. For example if a pass is made to a player in front of goal, it is possible for the next action to be a shot. But if the ball is played to a player on the flanks, the next action cannot be a shot
- dynamic -
the environment can change even when the agent is deliberating on the future course of action as the other team will continue playing
- continuous -
percepts such as player positions and ball position as well as actions like the direction and force of kicks are all real valued
- partially observable -
not all information needed to make a decision can be gotten from the current percept. For example determining the speed and direction of ball movement in order to determine what action to take requires multiple readings from sensors such as distance detectors or cameras
- multiagent -
the opposition team acts like another agent as it modifies the environment in such a way so as to maximise its performance measure, which can be influenced by the agent
2. Brushing your teeth
- Stochastic -
mechanical failure risk like in the previous case (possible that one may get cramps)
- sequential -
can't move the toothbrush to the left beyond a point, due to the fixed size of one's mouth
- static -
assuming you keep your head still in relation to your hand while you think about what to do next
- continuous -
percepts and actions deal with real values
- partially observable -
must maintain some sort of internal state based on past percepts. For example you want to clean all areas of your mouth and so must keep track of which parts have already been cleaned
- single agent -
there is no other agent modifying the environment
3. Playing a tennis match
- Stochastic
- Sequential
- dynamic
- continuous
- partially observable
- mutliagent
4. Practicing tennis against a wall
- Stochastic
- Sequential
- dynamic
- continuous
- partially observable
- single agent
5. Deciding what item to take at hostel lunch
- Deterministic
- episodic
- static
(assuming no one will finish all the food while the agent is deliberating!)
- discrete
- fully observable
- single agent