[SOLVED] CSE571-Homework 1

Description

Exercise 1.1

Suppose that the performance measure is concerned with just the first T   time steps of the environment and ignores everything thereafter. Show that a rational agent’s action may depend not just on the state of the environment but also on the time step it has reached. Assume that the agent has access to time.  Exercise     1.2

For each of the following assertions, say whether it is true or false and support your answer with examples or counterexamples where appropriate. Use our vacuum domain ONLY.

1. An agent that senses only partial information about the state cannot be perfectly rational.
2. There exist task environments in which no pure reflex agent can behave rationally.
3. There exists a task environment in which every agent is rational.
4. Suppose an agent selects its action uniformly at random from the set of possible actions. There exists a deterministic task environment in which this agent is rational. Every agent is rational in an unobservable environment.

Exercise 1.3

Consider a modified version of the vacuum environment in which the geography of the environment—its extent, boundaries, and obstacles—is unknown, as is the initial dirt configuration. The agent can go Up    and Down           as well as Left         and Right. The agent can sense its current location and whether there is dirt in it. The performance metric is to clean the space.

1. Can a simple reflex agent be perfectly rational for this environment? Explain.
2. Can a simple reflex agent with a randomized agent function (i.e., the action may be a random choice from a set) outperform a simple reflex agent?
3. Can you design an environment in which your randomized agent will perform poorly, when movements are penalized?

Exercise 1.4

You         are          to            design    an            agent      that         moves    from       a              start        location to            a              goal location with        obstacles               in            between.

Assuming              that         your       agent      knows    about      the          start        and         goal        locations               and         can                sense      its           current   location.                However,              it             can          only        detect     an            obstacle                when      it             is             next        to            it             (i.e.,        tactile     sensing).               A             simple   method  that                allows    the          agent      to            solve      the          problem                is             to            follow    the          procedure:

• head toward   goal
• follow the          contour  of            an            obstacle encountered         (in           a              fixed       direction)           until       you         can          head       toward   the          goal        again      3)            continue

1. What is             this         type        of            agent?    Can         you         specify   the          agent      function?
2. Can this agent      always   reach      the          goal        location?               If             your       answer   is             yes,            explain   your         Otherwise,            justify    your       answer   by           giving     an            environment            where     it             won’t      work.