Skip to main content
Blog

Why AI Gets Contract Review Wrong: What ChatGPT Misses in UK Contracts

1 Jan 2025·10 min readPrivacy & SecurityAI ToolsContract ReviewUK LegislationLegal Tech
Lóránt BarthaWritten by Lóránt Bartha
Why AI Gets Contract Review Wrong: What ChatGPT Misses in UK Contracts

AI gets contract review wrong primarily because it predicts plausible-sounding responses, not legal accuracy. The five most common failures are: summarising clauses by their everyday meanings rather than the legal definitions in the document, missing risks that only appear when multiple clauses are read together, underweighting short clauses with major consequences, and being misled by the reassuring tone of professionally drafted documents.

Picture this: you receive a 14-page job offer, run it through ChatGPT, and get back a clear, confident summary. Nothing alarming. You sign. Six months later, you discover a restrictive covenant in clause 19 that prevents you from working for any competitor for 12 months after leaving. ChatGPT mentioned a "non-competition provision" in passing, but framed it as standard.

It wasn't wrong because it was careless. It was wrong because helpful and fluent are not the same as legally accurate.

Key Takeaways

  • AI predicts plausible responses; it doesn't reason about legal effect

  • Defined terms in a contract override everyday meanings; generic AI misses this

  • Multi-clause risks (e.g. payment combined with termination) require cross-reading; AI reads linearly

  • A confident-sounding summary is not the same as accurate legal analysis

  • Use AI for extraction tasks (clause lists, specific terms); not for legal assessment

Who this is for

This article is for UK employees reviewing job offers, freelancers examining service agreements and NDAs, gig workers assessing platform contracts, and anyone who has been tempted to paste a contract into ChatGPT and trust the result.

Two questions come up most often: is it safe to upload your contract to AI tools, and does the AI actually give you accurate analysis? This article addresses the second question. For the first, see whether it's safe to upload your contract to ChatGPT.

How AI actually reads a contract

When a lawyer reviews a contract, they slow down for complexity. They track defined terms from the definitions section across every clause they appear in. They notice when a payment clause and a termination clause interact in a way that disadvantages one party. They read the whole document before forming a view on any individual clause.

AI models work differently. They predict the most useful-sounding response based on patterns in the text. That's a powerful capability for many tasks. But contract analysis isn't pattern recognition; it's systematic legal reasoning across a structured document.

The practical result: an AI tool will give you the response that sounds most helpful for your query. That isn't always the response that's most accurate about your legal exposure.

Five ways AI misses the point in your contract

1. The summary sounds right, but the legal effect is wrong

Contracts often contain carve-outs: exceptions buried inside clauses that look protective on the surface. A clause that appears to limit your liability may contain a carve-out for "gross negligence or wilful misconduct" that effectively removes the protection in any situation where you're likely to need it.

A generic AI tool will typically summarise the headline protection. It may mention the carve-out in passing. But it's unlikely to flag that the exception significantly undermines the protection you thought you had.

2. Defined terms quietly rewrite everything

This is probably the most common source of AI error in contract review.

Legal contracts define their own vocabulary. "Gross Misconduct" in your contract might be defined to include "any breach of company policy, whether or not the breach causes loss." That means a minor procedural breach could be grounds for dismissal without notice. "Confidential information" might be defined so broadly that it covers anything you've observed about the business during your engagement.

A generic AI uses the everyday meaning of these terms. It doesn't track back to the definitions section and apply them consistently across the rest of the document. The result: the summary sounds reasonable, but the legal effect is different from what the summary implies.

3. The real risk is hidden across multiple clauses

Important legal risks often only become visible when you read two clauses together.

A payment clause that says invoices are due "within 30 days of written approval" combined with a termination clause that allows the client to terminate with 7 days' notice, for any reason, at any time: those two clauses together mean the client can terminate before approving your final invoice, leaving you with legitimate work unpaid and no contractual mechanism to force approval.

Neither clause, read in isolation, looks alarming. The problem is the interaction. Generic AI reads sequentially; it doesn't map interactions across sections. For a full list of the clauses most likely to cause problems when read together, see the risky clauses UK freelancers should always check.

4. Reassuring language distracts from the sharp edges

Professionally drafted contracts are designed to read well. The language is clear, the structure is logical, and the tone is neutral and professional. That presentation influences how AI tools respond.

If a contract contains 20 clauses that are reasonable and 2 that are one-sided, the overall professional tone will tend to pull the AI's assessment toward calm. The same effect happens with humans, which is why the best contract reviewers deliberately read contracts looking for what's missing, not what's there.

5. Short clauses with big consequences get overlooked

Non-compete clauses, IP ownership provisions, and automatic renewal terms are often a single paragraph. In a 14-page contract, a short clause doesn't command much attention from a sequential reader. But a non-compete that prevents you working in your industry for 12 months, or an IP clause that assigns everything you create to the client, are potentially more significant than any other clause in the document.

For IP ownership specifically, see what UK freelancers need to know about IP in their contracts. For non-compete clauses, see whether non-competes in freelance contracts are actually enforceable.

What this means for your specific contract

The clauses where AI is most likely to give you an inaccurate picture:

Termination clauses. How much notice you get, what triggers termination, whether there's a payment in lieu of notice provision, and whether you retain the right to invoice for work already completed. These interact with payment terms in ways a summary won't capture.

Restrictive covenants. Non-compete clauses, non-solicitation clauses, and garden leave provisions. These are often short, often buried near the end of the contract, and often drafted more broadly than they're likely to be enforceable. A generic AI may flag them; it's unlikely to assess their enforceability accurately.

IP ownership. Who owns the intellectual property you create during the engagement, what happens to work in progress, and whether you retain the right to reference the work in your portfolio. In creative and technical freelance contracts, these clauses often assign more than the client genuinely needs.

Liability and indemnity. A liability cap that limits your exposure to the contract value sounds protective. An indemnity clause that requires you to cover the client's legal costs for any third-party claim related to your work can effectively remove that protection. Read them together, not separately.

A safer approach: how to use AI on your contract

AI tools are useful for contract review if you use them for the right tasks. Here's what they do well and how to get more out of them.

Ask for extraction, not assessment. Request a list of all clauses by type: "List every clause that restricts what I can do after the contract ends." This is a pattern-matching task that AI does well. Assessing whether those restrictions are enforceable is a different task, one that requires UK-specific legal knowledge.

Ask for direct quotes. "Quote the exact wording of the termination clause, including all sub-provisions" gives you the actual language to review yourself. A paraphrase loses the legal precision.

Test it on something you know. Before relying on the analysis, check it against a clause you already understand. If it gets the obvious one wrong, treat the whole output with more scepticism.

Manually verify high-impact sections. For any employment or service contract, always read these yourself, regardless of what the AI says: termination, liability caps, indemnity, IP ownership, restrictive covenants, renewal provisions, payment triggers, and the definitions section.

Check every capitalised term. Any term that's capitalised in the contract body (Confidential Information, Gross Misconduct, Deliverables) has a specific definition somewhere in the document. Find it and read it before you trust any summary of the clause that uses it.

Why purpose-built contract review is different

Purpose-built tools differ from generic chatbots in ways that matter specifically for legal documents.

Clause-by-clause analysis means every section gets individual attention, not just the ones that appear most prominently in a summary. Jurisdiction-specific insights mean the analysis is grounded in UK contract law, not general legal knowledge from multiple jurisdictions. Cross-clause risk identification means the tool can flag when a payment clause and a termination clause interact in a way that disadvantages you. And plain-English explanations mean you understand what each clause actually does, not just what it says.

Privacy is also different. With a general-purpose AI tool, you need to anonymise your contract before uploading to avoid data and confidentiality risks. For a guide to doing this safely, see how to anonymise your contract before uploading to any AI tool.

The bottom line

The question isn't whether AI is useful for contracts. It is, for specific tasks. The question is whether your AI tool of choice reads your contract in a way that preserves the legal risk. That requires more than general-purpose AI.

Ookulli reviews your contract from £10, clause by clause, UK-specific, no waiting list.

Frequently asked questions

Can ChatGPT review a contract?

It can summarise and extract information, but it shouldn't replace specialist review for any contract you're about to sign. Generic AI may overlook defined terms, carve-outs, cross-references, and risks that are only visible when you read multiple clauses together. It's most useful for extraction tasks; least reliable for legal assessment.

Can I trust ChatGPT to review my employment contract?

As a starting point for orientation, it can help. For a signing decision, no. Employment contracts contain termination provisions, restrictive covenants, IP clauses, and jurisdiction-specific protections that require UK-specific analysis. A generic tool won't reliably flag problems with these, and it may actively reassure you when the contract warrants concern.

Why does AI sound so confident even when it gets things wrong?

AI models are trained to produce helpful, clear, fluent responses. Confidence in tone reflects the model's output style, not the accuracy of the legal analysis. A response that sounds authoritative about a contractual risk may still be missing the defined term that changes what that clause actually means.

What contracts is AI most likely to miss important clauses in?

Longer contracts with complex defined terms, contracts that mix confidentiality with restrictive covenants (a common structure in client service agreements and NDAs), and contracts with liability caps that interact with broad indemnity provisions. If your contract has any of these, treat any AI summary as a starting point only.

Does the way a contract is written affect what AI picks up?

Yes. Professionally drafted contracts read well: clear language, logical structure, neutral tone. That presentation can pull AI analysis toward calm even when individual clauses are one-sided. Contracts that use a lot of capitalised defined terms are also more likely to trip up generic AI, because the model uses everyday meanings rather than the specific legal definitions in the document.

Is AI contract review legal in the UK?

Yes, using AI to assist with contract review is legal. There's no restriction on using AI tools for personal or commercial document analysis. The questions are practical, not legal: whether using a public AI tool breaches the confidentiality clause in your contract, and whether uploading a document containing personal data is compliant with UK GDPR. A purpose-built tool designed for legal documents sidesteps both concerns.

What should I do instead of asking AI for a summary?

Ask for extraction, not assessment. Request a list of all clauses by type, ask for exact quotes from high-risk sections, and verify those sections manually. For assessment of enforceability, especially for restrictive covenants, IP clauses, and liability provisions, use a purpose-built review tool or seek brief legal advice.

Ookulli reviews your contract from £10, clause by clause, UK-specific, no waiting list.

Related posts

Ready to see through the legal fog?

Try Ookulli now for free if you have an NDA or a service contract

Upload your contract