Think Build Implement Repeat
London, UK +44 7367 067226
WhatsApp FOLLOW f in X
  1. Home
  2. Blog
  3. Scoping a First Version of an AI Application
AI Apps

Scoping a First Version of an AI Application

Scoping an AI app MVP around the real risk, accuracy on real data: what the MVP must include, what can wait, and why manual work behind the scenes is fine.

Updated 2 min readBy SpiderHunts Technologies

Free estimateNo obligation

Get a free estimate

Tell us what you need. A senior engineer reads every enquiry.

Takes under a minute. We never share your details.

  • Free consultation
  • No commitment
  • NDA on request

Prefer to talk? Book a free 30-minute call →

Quick answer — TL;DR

The risky question in an AI app is almost always accuracy on real data, not whether people want it. So the MVP should be the narrowest thing that lets you measure accuracy on real cases with a human in the loop — not a polished product with an unproven model.

The risky assumption is different

In a conventional MVP the question is whether anyone wants it. In an AI MVP there is usually a second, sharper question: will it be accurate enough on our actual data to be useful?

That question can be answered far more cheaply than a product, and it should be answered first.

Answer accuracy before building anything

  1. Take fifty real cases with known correct answers
  2. Run the intended approach against them
  3. Measure per field or per category, not overall
  4. Show the results to whoever will use it and ask whether that is good enough
This costs days rather than weeks. If accuracy on fifty real cases is poor, no amount of engineering rescues the use case — the problem is the problem, not the implementation.

What the MVP must include

  • The core workflow end to end, actually working
  • An evaluation set that runs on every change
  • A review interface, because the first version will need humans
  • Instrumentation showing completion and correction rates
  • A way for users to report that something is wrong

What can wait

  1. An admin panel — a developer running a query is adequate for the first fifty users
  2. Multiple roles — permissions multiply testing faster than anything else
  3. Self-service billing — invoice the first customers manually; it is better research
  4. Additional document types or languages — prove one first
  5. Automatic actions — start with suggestions a human approves

Manual behind the curtain is legitimate

If the hard part is a process, run it by hand at first. The customer sees a form and receives a result; behind it a person does the work with AI assistance.

It is the cheapest possible test of whether the result is worth paying for, and it produces exactly the labelled data you need to automate later.

FAQ

Frequently asked questions

The questions readers ask us after this guide.

Still have a question?

Ask us directly — a senior engineer will get back to you.

Ask about your project

How long should an AI MVP take?

Eight to sixteen weeks. Beyond five months you are building on faith rather than testing an assumption, which is a different and more expensive activity.

What accuracy is good enough to launch?

Whatever beats the current process at acceptable risk with a good escalation path. Many useful systems launch in the mid-eighties and improve. Waiting for perfection usually means never launching.

Should we tell users it is AI?

Yes, and tell them what a human still checks. Users are far more tolerant of a disclosed AI making an occasional error than of discovering it after the fact.

What if accuracy is not good enough?

Then either narrow the scope until it is, add a human step, or stop. All three are better than shipping something people cannot trust.

Keep reading

More on AI Apps

AI Apps

The Hidden Work in 'Simple' AI Features

Why an AI feature that took an afternoon to demo takes weeks to ship: the evaluation, edge cases, guardrails, cost control and monitoring nobody sees.

Start here

Have an AI idea and want it tested cheaply?

Send us fifty real cases with the answers you would expect. We will tell you whether the approach is viable before anyone builds anything.

  1. You tell us what you needTwo minutes on the form, or a message on WhatsApp.
  2. A senior engineer reviews itAnd comes back with questions, a realistic range and an honest view on fit.
  3. Free 30-minute scoping callWe talk through scope, options and a realistic estimate — with no obligation.
Free estimateNo obligation

Talk to someone who builds this

Send a short brief and we will come back with an honest view and a realistic range.

Takes under a minute. We never share your details.

  • Free consultation
  • No commitment
  • NDA on request

Prefer to talk? Book a free 30-minute call →