AL - Lec 2
AL - Lec 2
How it work.
Agent types.
Environment.
Advantages of AI agent.
Introduction
without human control. It can think, act, and learn on its own, without needing constant input
from humans.
• These agents are widely used in different industries, like healthcare, finance, and banking, to
• They can adjust to new situations, learn from their experiences, and make decisions using
• An intelligent agent is a system capable of autonomous interaction with its environment, taking actions
• AI agent is a software program designed to interact with its environment, perceive the data it receives
through sensors, and take actions based on that data through actuators to achieve specific goals.
gathered by the sensors and decides what action to take using the actuators.
The components of an Intelligent Agent
How does AI agents work ?
about its environment. It can do so using sensors or collecting data from various sources.
Processing input data: The agent takes the knowledge gathered in Step 1 and prepares it
for processing. This may include organizing the data, creating a knowledge base, or making
internal representations that the agent can understand and work with.
How does AI agents work ?
Decision-making: The agent uses reasoning techniques like logic or statistical analysis to
Executing an action: The agent makes a step or a series of steps to reach its goals.
Learning and Improvement: After taking action, the agent can learn from its own
experiences. This feedback loop allows the agent to improve performance and adapt to new
• Human
eyes, ear, skin, taste buds, etc. for sensors.
hands, fingers, legs, mouth for effectors.
• Robots
Camera, infrared, etc. for sensors.
grippers, wheels, lights, speakers, etc. for actuators.
• Software agent
functions as sensors.
functions as actuators.
Key characteristics of intelligent agents include:
Reactivity: Real-time perception (senses and interprets the environment) and response to
Socialness: Interaction with other agents or humans using different methods, like understanding
Learning: They can learn and enhance their performance through machine, deep, and
reinforcement learning elements and techniques evolving based on experiences and environmental
shifts.
Rational Agent
Rational agent should select an action that is expected to maximize its performance
measure, given the evidence provided by the percept sequence and whatever built-in
The nature of the task environment directly affects the appropriate design for the agent program.
Fully Observable VS. Partial Observable: If an agent’s sensors give it access to the complete state
of the environment at each point in time, then we say that the task environment is fully
observable. Fully observable environments are convenient because the agent need not maintain
any internal state to keep track of the world. An environment might be partially observable
because of noisy and inaccurate sensors or because parts of the state are simply missing from the
sensor data. If the agent has no sensors at all then the environment is unobservable.
Environmental Characteristics
environments may seem simple enough. For example, an agent solving a crossword puzzle by itself
multi-agent environment).
Deterministic vs. nondeterministic: If the next state of the environment is completely determined by
the current state and the action exec uted by the agent(s), then we say the environment is
An agent need not worry about uncertainty in a fully observable, deterministic environment. Ifthe
Taxi driving is clearly nondeterministic in this sense, because one can never predict the behavior
of traffic, moreover, one’s tires may blow out unexpectedly. The vacuum world as we described
appearing dirt.
Environmental Characteristics
EPISODIC VS. SEQUENTIAL: In an episodic task environment, the agent’s experience is divided into
atomic episodes. In each episode the agent receives a percept and then performs a single
action. The next episode does not depend on the actions taken in previous episodes (Arm Robot).
In sequential environments, the current decision could affect all future decisions such as Chess
Episodic environments are much simpler than sequential environments because the agent does
DISCRETE VS. CONTINUOUS: The discrete/continuous distinction applies to the state of the
environment, to the way time is handled, and to the percepts and actions of the agent. For
example, the chess environment has a finite number of distinct states (excluding the clock).
Chess also has a discrete set of percepts and actions. Taxi driving is a continuous-state and
continuous-time problem: the speed and location of the taxi and of the other vehicles sweep
through a range of continuous values and do so smoothly over time. Taxi-driving actions are
also continuous.
Environmental Characteristics
STATIC VS. DYNAMIC: Static environments are easy to deal with because the agent need not
keep looking at the world while it is deciding on an action, nor need it worry about the
passage of time. Dynamic environments, are continuously asking the agent what it wants to
do. Taxi driving is clearly dynamic where Crossword puzzles are static .
The Structure of Agents
Agent program take the current percept as input from the sensors and return an action
to the actuators.
The key challenge for AI is to find out how to write programs that, to the extent possible,
we have written the agent program using if-then-else statements, it is simple enough that it
can also be implemented as a Boolean circuit.
The types of AI agents
First, we need some information about how the world changes over time.
Second, we need some information about how the state of the world is reflected in the
agent’s percepts. For example, when the car in front initiates braking.
The types of AI agents
Goal-based agents
Knowing something about the current state of the environment is not always enough to decide what
to do, as well as a current state description, the agent needs some sort of goal information that
describes situations that are desirable being at a particular destination. For example, at a road
junction, the taxi can turn left, turn right, or go straight on. The correct decision depends on where the
taxi is trying to get to.
The types of AI agents
Learning agents execute machine learning techniques to improve their decision-making over
time.
What are the advantages of using AI agents?
Increased efficiency
Better decision-making
AI agents can analyze large amounts of data and provide valuable insights
customer satisfaction).
By automating tasks, AI agents can reduce the need for human resources and manual
labor, resulting in cost savings for businesses. They can handle high-volume, repetitive
Healthcare: AI agents can assist in diagnosing, treating, and monitoring patients (IBM Watson
Health).
Finance: They can analyze financial data, detect fraud, and make investment
Agriculture: AI agents can optimize crop production, monitor soil quality, and predict weather
patterns. John Deere uses an AI agent called (See & Spray) to detect and target weeds
tasks, and analyze student performance. Pearson’s AI agent, Aida, can provide feedback to
Must be sense.
Must be act.
Must be rational.