A demo answers “can it”; a production system answers “who is accountable”
A demo can start from one clean document and one ideal question. Real business brings stale versions, permission gaps, missing fields, exceptions and time pressure — all at once. The model’s output is just one step in a process.
So the first design question isn’t which model to pick. It’s who owns the process, what errors are acceptable, which steps require human review, and how to roll back when things fail.
Validate with one minimal business loop, not a feature list
A meaningful pilot starts from real inputs, enters a real job task, produces output a business person can judge, and writes the result back into the next step. Showing a chat window proves nothing about sustained operation.
- Write down the baseline: how long it takes today, who does it, what counts as failure.
- Write down the boundaries: what AI may do, what needs review, what it must never do.
- Write down the thresholds: what earns further investment, and what stops the project.
Going live is where evidence collection begins
Production systems need ongoing observation: adoption, human coverage, exception types, answer quality and business outcomes. Technically working but unused isn’t success; high adoption with uncontrolled high-risk errors isn’t either.
The AI demo was impressive — why does it fall apart in production?
Should we start with a feature list?
Is an AI project finished at launch?
Best AI Consultants and AI Implementation Partners in New Zealand (September 2026): 17 Firms Compared
Which AI consulting and AI implementation companies operate in New Zealand? This review compares 17 firms from their public websites, in three tiers: enterprise integrators, boutique implementation studios and bilingual hands-on teams. It lists positioning, published NZD prices, city and best-fit company size, plus five selection criteria. BEE Sigma is included and labelled as a self-description.
Read articleHow Much Does an AI Digital Employee Cost in New Zealand? 2026 Public Price Ranges and How to Read a Quote
Public prices for an AI digital employee (a business AI agent) in New Zealand run from a NZD 150-a-month subscription bot to a NZD 90,000 multi-system project. This article lists the prices New Zealand vendors published in 2026, with source and date for each, explains the five cost items behind the gap, and gives six things to check on any quote. Includes the MBIE 50% subsidy maths.
Read article