AI execution layer

AI agents vs chatbots for business: what operators actually need

When people compare AI agents vs chatbots for business, the useful difference is what each one is allowed to touch. A chatbot answers. An assistant helps you produce something you then move yourself. An agent takes actions in your tools. An execution layer coordinates agents and people, with approvals and a record.

closeup photo of turned-on blue and white laptop computer
Photo by Philipp Katzenberger on Unsplash

Part of our guide to What is an AI execution layer? A plain-English guide for operators

On this page · 8 sections
  1. Four kinds of business AI, defined by what they can touch
  2. When a chatbot is genuinely enough
  3. Where chatbots break: the Air Canada lesson
  4. How agents fail, and why it is different
  5. What an execution layer adds on top of agents
  6. A quick test: which tier does this task need?
  7. Mistakes we see when businesses pick the wrong tier
  8. Frequently asked questions

Most owner-operators need two of these, not one. A chatbot is fine for answering common questions on your website. For back-office work (follow-ups, receipting, reminders, CRM updates, research) you want agents that can act in your systems, with a person approving anything that goes out. The mistake is buying the first and expecting the second.

This article sits under our guide to what an AI execution layer is. Here we define the four tiers by capability, show how each one fails, and give you a quick test for matching a task to the right tier.

Four kinds of business AI, defined by what they can touch

Marketing labels blur together, so ignore them. Ask what the system can read, what it can change, what it remembers and who finishes the job.

Capability by tier (typical behaviour; individual products vary)
ChatbotAssistantAgentExecution layer
Can readA fixed knowledge base or FAQWhat you paste or uploadConnected tools: mailbox, CRM, files, webConnected tools, plus the history of every task
Can changeNothing outside the chatNothing outside the chat (or a draft in one app)Records, drafts, messages, filesRecords, drafts, messages, files, calls; split across specialists
MemoryUsually none between visitorsPer conversation or projectTask-level, sometimes longerStanding rules per business, per agent
Who does the last mileThe customer, or a human who takes overYouThe agent, if allowedAgents, with approvals at the edges
Typical failureConfidently wrong answerCopy-paste errors and lost contextActs on bad input, or acts too muchOver-asks for approval, or under-asks
Enough whenQuestions repeat and answers are stableThe job is thinking or writingOne job, one tool, low stakesWork crosses tools and needs a record

Notice that the tiers are not "good, better, best". A chatbot that answers "What are your opening hours?" is the right tool. Putting an agent with write access to your CRM behind that question would be overkill and a security risk.

When a chatbot is genuinely enough

Don't let anyone upsell you past this. A well-scoped chatbot is cheap, predictable and useful if all of these are true:

  • The questions repeat: hours, pricing bands, service areas, how to book, what to bring.
  • The answers are stable and you can write them down in one document.
  • A wrong answer is an inconvenience, not a financial or legal problem.
  • There is a clear hand-off to a person (a form, a phone number, a booking link) for everything else.

If a question needs a lookup in a customer's record, a judgement call or an action, it has outgrown the chatbot.

Where chatbots break: the Air Canada lesson

The best-known cautionary tale is Moffatt v. Air Canada, a 2024 decision of British Columbia's Civil Resolution Tribunal. The airline's website chatbot told a grieving customer he could apply for a bereavement fare after travelling. The airline's actual policy said otherwise. Air Canada argued, in effect, that the chatbot was responsible for its own words. The tribunal rejected that and found the airline had not taken reasonable care to make sure its chatbot was accurate.

It is a Canadian small-claims decision, not Australian law, but the lesson travels: if an AI speaks to customers on your behalf, customers will reasonably treat what it says as what your business says. For Australian operators that means two rules. First, any customer-facing AI that states policy, prices or entitlements must answer from your approved source documents, not from general knowledge. Second, anything that commits the business (a refund, a discount, a booking change) should be drafted for a person to approve, not promised in the chat.

How agents fail, and why it is different

Chatbots fail by saying the wrong thing. Agents fail by doing the wrong thing, which is more expensive. The common patterns:

Acting on stale or partial data

An agent drafts an overdue-payment reminder from last week's export because nobody told it the customer paid on Friday. Fix: agents should read from the live system of record at the time of the task, and say which source and timestamp they used.

Being manipulated by the content they read

An agent that reads email or web pages can be steered by instructions hidden in that content. OWASP lists prompt injection as the first risk in its LLM top ten. Fix: treat everything an agent reads as data, limit which tools it can call, and keep approvals in front of outward actions. Our security writers cover this in depth in prompt injection through email.

Doing too much

Given a vague brief like "tidy up the CRM", an over-eager agent merges records you wanted separate. Fix: scope every task with a definition of done and stop conditions, and keep deletes and merges behind approval.

Running up cost quietly

An agent that retries a failing task in a loop can burn model usage for hours. Fix: budgets, timeouts and an orchestrator that notices when a task is stuck and asks a person.

What an execution layer adds on top of agents

Single agents are useful. They become dependable when something sits above them: an orchestrator that splits work and assigns owners, specialists with narrow access, a shared record, and approval steps. That is the difference between "an AI that can send email" and "a team that drafts the email, logs it in the CRM, and waits for you". We explain the orchestration part in how an orchestrator splits work across agents, and the approval design in approval gates for autonomous agents.

Whether you assemble that yourself or buy it is a separate decision with real trade-offs. We set out the components and their hidden costs in build your own AI agents vs buy.

A quick test: which tier does this task need?

Run each task you are considering through five questions. The first "yes" from the top tells you the minimum tier.

  1. Does the task need to act across two or more systems, or keep a record of who approved what? Execution layer.
  2. Does it need to change something in one system (draft an email, update a record, book a slot)? Agent, with approval if it touches a customer.
  3. Does it need your context (a document, a client file) to produce writing or analysis that you will act on yourself? Assistant.
  4. Is it a repeated question with a stable, written answer? Chatbot.
  5. None of the above? It may not need AI at all.
Example tasks and the minimum tier they need (illustrative)
TaskMinimum tierWhy
Answer "Do you service Parramatta?" on the websiteChatbotStable, written answer
Summarise a 30-page lease before a meetingAssistantNeeds your document; you act on it
Draft replies to new enquiries in the shared inboxAgentReads and drafts in one system; you approve
Chase overdue invoices, log outcomes, call the ones who don't replyExecution layerAccounting, email, CRM and phone; needs a record
Turn a site-visit voice note into a work order, tenant SMS and CRM noteExecution layerSeveral tools and a hand-off to a person

Mistakes we see when businesses pick the wrong tier

  • Buying a website chatbot to fix a back-office problem. The enquiries get answered faster, but nobody follows them up.
  • Using a general assistant as an agent. The owner becomes the integration, pasting between ChatGPT, the inbox and the CRM. We call this the copy-paste tax and quantify it in ChatGPT vs AI agents for business.
  • Giving an agent broad access without approvals because the demo looked good. The first wrong email to a customer costs more than a year of approvals.
  • Measuring the wrong thing. Counting messages sent rather than work accepted. Our method for measuring hours saved counts only finished, approved work and includes review time.

If your work crosses email, CRM and phone and you want to stay the one who signs off, the Fulcrum Cortex platform is built for that tier. If a chatbot is genuinely enough, start there and come back when it isn't.

Frequently asked questions

What is the difference between a chatbot and an AI agent?

A chatbot converses and answers questions, usually from a fixed knowledge base, and can't change anything outside the chat. An AI agent can use tools: it can read a mailbox, update a CRM record or draft a message in another system. That makes agents more useful and riskier, so they need scoped access and approvals.

Are AI agents safe for small businesses?

They can be if access is limited to what each task needs, outward-facing actions wait for human approval and every action is logged. The biggest risks are agents acting on manipulated content, such as instructions hidden in an email, and agents given broad permissions without review.

Is ChatGPT a chatbot or an agent?

Out of the box it is a general assistant: you bring the context and carry the result into your other tools. Its agent and connector features let it take some actions, but it is not wired into your CRM, phone lines and approval rules unless you set that up.

Can a business be held responsible for what its chatbot says?

In Moffatt v. Air Canada, a Canadian tribunal held the airline responsible for inaccurate information its website chatbot gave a customer. That is not Australian law, but it is a sensible assumption to plan around. This is general information, not legal advice.

Sources

  1. Moffatt v. Air Canada, 2024 BCCRT 149 · Civil Resolution Tribunal (British Columbia)
  2. LLM01: Prompt Injection · OWASP GenAI Security Project

General information only, not legal, financial or professional advice. Check the source for your circumstances.