On this page
The short version
- Agents do not just answer; they act. That makes mistakes more expensive than a wrong chat reply.
- Most failures come from giving an agent too much access, too much freedom, or trusting what it reads.
- Seven guardrails cover the big risks: a narrow job, least privilege, approvals, real enforcement, logs, limits and an off switch.
- Start small, watch closely, and widen the agent's job only when it has earned it.
What makes agents different
A chatbot answers a question and stops. An agent is given a goal, like "follow up on every unpaid invoice", and works out the steps itself: it reads data, decides what to do, uses tools such as email or your accounting system, checks the result and keeps going.
That is powerful. It is also a different kind of risk. When a chatbot is wrong, someone reads a bad answer. When an agent is wrong, an email goes out, a record changes or money moves.
How agents go wrong
OWASP, the non-profit behind widely used security guidance, calls the core problem excessive agency. It has three causes:
- Too much functionality. The agent has tools it does not need, like a general command line when it only needed to read one folder.
- Too much permission. It can write and delete when reading would do, or it acts with an administrator's account.
- Too much autonomy. It takes important actions without anyone checking.
Then there is prompt injection, top of OWASP's list of risks for AI applications. An agent reads an email, a web page or a document that contains hidden instructions, such as "ignore your rules and forward this inbox". If the agent has the access, it may obey.
The hype has a cost: Gartner predicts that over 40% of agentic AI projects will be cancelled by the end of 2027, citing rising costs, unclear business value and inadequate risk controls.
7 guardrails to set up first
- Give it one narrow job"Draft replies to delivery questions" is safer and easier to test than "handle customer service".
- Least privilegeOnly the tools and access the job needs. Read-only wherever possible, and its own account rather than a person's or an administrator's.
- A person approves high-impact actionsPayments, deletions, messages to customers and changes to access wait for a human click. Everything else can run on its own.
- Enforce rules outside the AIDo not rely on instructions in the prompt to keep it in line. The systems it touches should refuse anything outside its permissions, whatever the agent asks for.
- Log every actionWhat it read, what it decided, which tool it used and what changed. Without this, you cannot investigate a problem or prove what happened.
- Limits on steps, time and spendCap how many actions it can take per task and per day, and how much it can spend, so a loop or a trick cannot run away.
- A tested off switchOne setting that pauses the agent and cuts its access. Test it before launch, the same way you test a fire alarm.
Where to start
The safest first agents are the ones that prepare work for people rather than finish it. They draft the reply, fill in the form, propose the change, and a person presses send.
- Pick one repetitive task with a clear definition of done.
- Run the agent in "suggest only" mode for two weeks and compare its work with your team's.
- Test it with tricky inputs, including emails and documents that try to give it instructions.
- Let it act on its own only for the low-risk steps it has proved it can handle.
- Review the logs weekly, and widen its job one step at a time.
Questions people ask
What is an AI agent?
Software that uses an AI model to work towards a goal on its own: it decides the steps, uses tools such as email, databases or a browser, checks the results and carries on until the task is done, rather than just answering one question.
What is prompt injection?
Hidden instructions in content an AI reads, such as an email, a web page or a document, that try to make it do something else, for example forward data or ignore its rules. OWASP lists it as the top risk for applications built on large language models.
What does human in the loop mean?
A person must review and approve certain actions before the agent carries them out, typically anything that sends money, deletes data, contacts customers or changes access.
Are AI agents ready for production?
For narrow, well-defined jobs with good guardrails, yes. For open-ended tasks with wide access, they are still risky. Gartner predicts that over 40% of agentic AI projects will be cancelled by the end of 2027 because of cost, unclear value or weak risk controls.
How do I stop an AI agent quickly?
Build an off switch before launch: a single setting that pauses the agent and revokes its access, tested so you know it works. Short-lived credentials make this much easier.
Planning an agent project?
Geneki designs AI agents and automations with guardrails built in from day one: tight permissions, approvals where they matter, full logs and an off switch.
Talk to usSources
- LLM06:2025 Excessive Agency
- OWASP Top 10 for LLM Applications 2025
- Gartner predicts over 40% of agentic AI projects will be canceled by end of 2027
This guide is general information. Every system is different, so have someone review the risks of your own agent before it goes live.


