Systemising Pain: When to Fix a Process with Software, Automation or AI

Signs You've Outgrown Spreadsheets (and What to Replace Them With)

By Andrew Lee Ward 5 min read Updated 27 Jun 2026

You've outgrown a spreadsheet when it stops calculating and starts running a process. The signs: "final_v7" version chaos, weekly manual consolidation, one person who understands it, no audit trail, silent broken formulas, and people overwriting each other's edits. Replace it with a shared database, an off-the-shelf SaaS tool, or a custom internal app.

Signs You've Outgrown Spreadsheets (and What to Replace Them With)

A spreadsheet that calculates is a tool. A spreadsheet that runs a process is a liability waiting to be discovered.

The line between the two is easy to miss, because the spreadsheet that now quietly runs your onboarding, your stock, or your project tracking started life as a harmless grid of numbers. It grew. Below are the concrete signs it has crossed that line, and where to move once it has.

What are the signs you've outgrown a spreadsheet?

You've outgrown a spreadsheet when it stops being a calculation and starts being a system of record that several people depend on. The tell-tale signs are consistent across teams:

  • Version chaos — the file is called tracker_final_v7_USE_THIS_ONE.xlsx and nobody is certain which copy is current.
  • Manual consolidation — someone spends hours each week stitching numbers together from several copies because no single sheet has the whole picture.
  • One person who understands it — the formulas, macros and undocumented rules live in one head, so everyone else is afraid to touch it.
  • No audit trail or permissions — you can't see who changed a number, when, or why, and you can't stop someone editing a cell they shouldn't.
  • Broken formulas and silent errors — a dragged formula, a deleted row or a stray paste quietly corrupts a result, and nobody notices for weeks.
  • No concurrency — two people open the file, both edit, and one set of changes is overwritten when they save.
  • It runs a real process — the sheet isn't doing arithmetic any more; it's tracking jobs, approvals or customers and driving decisions.

Any one of these is a warning. Two or three together mean the spreadsheet has become the risk it was meant to remove.

How common are spreadsheet errors, really?

Spreadsheet errors are far more common than most teams assume, and the research is consistent on this. Decades of work by Professor Raymond Panko of the University of Hawaii found that errors appear in the large majority of operational spreadsheets when they are carefully audited — his reviews of field audits put the share of flawed spreadsheets well above 80%.1 The European Spreadsheet Risks Interest Group (EuSpRIG) maintains a public catalogue of real, costly failures traced back to a single cell.

The danger isn't that spreadsheets are error-prone — all systems are. It's that a spreadsheet has no audit trail and no validation, so an error stays invisible. A database rejects a malformed entry; a spreadsheet accepts it and recalculates around it.

"A spreadsheet hides its errors as patiently as it hides its single point of failure." — The Control Standard

Why is scattered data the real problem?

Scattered data is the real problem because the same fact ends up living in several places that quietly drift apart. When a "master" sheet spawns regional copies, monthly copies and someone's personal working version, you no longer have one number — you have five, and the weekly job of reconciling them is pure overhead. This is data fragmentation: information spread across tools, sheets and inboxes so that no one source can be trusted.

It compounds into a second problem. The person who knows how the copies fit together becomes the only person who can produce a reliable answer. That is key-person risk, measured by the bus factor — the number of people you can lose before the process stalls. A spreadsheet with a bus factor of one is a single resignation away from a crisis, and you usually discover it the week they leave.

What should you replace a spreadsheet with?

Replace a spreadsheet with one of three things, depending on how standard your process is and how much it matters:

  1. A shared database or internal app. Structured storage with validation, permissions, history and genuine multi-user access, fronted by a simple interface. This kills concurrency clashes and silent errors at the source.
  2. An off-the-shelf SaaS tool. If a proven product already does what your sheet does — a CRM, a project tracker, an inventory system — buy it. You inherit maintenance, security and updates for a subscription.
  3. A custom internal tool. Justified when the process is genuinely specific to how you work and is a source of advantage, so no off-the-shelf product fits without bending your business around it.

The honest default is to buy before you build. A custom tool is only worth it when the process is both distinctive and valuable enough to repay the build and the maintenance. That trade-off is its own decision — work through it in build vs buy software before you commit budget either way.

Before you replace anything: should this process be automated at all?

Decide whether the process is worth systemising before you decide what to build it in. A bad process moved into a database is just a faster bad process. Two questions come first:

  • Is this worth automating yet? A rare, unclear or low-value process is usually better clarified by hand first. Work through when to automate a process to test it.
  • What does the automated version look like? Once a process earns automation, the practical path — mapping it, owning it, and choosing where the logic lives — is covered in business process automation.

Both sit under the systemising pain hub, which is the wider question this guide is one corner of: knowing when a repeated, painful task is worth fixing with software at all.

How do you migrate off a spreadsheet without breaking everything?

Move one process at a time and run the new system in parallel with the old sheet for a cycle or two. Map what the spreadsheet actually does — not what you think it does — because the real rules are often buried in conditional formatting and a macro nobody remembers writing. Clean and de-duplicate the data before it moves, keep a read-only copy of the original as a fallback, and reconcile the two systems until you trust the new one. A big-bang cutover of an entire workbook is how migrations fail; an incremental one is how they succeed.

If you're not sure whether your spreadsheet pain is worth solving with software at all, the free Pain Automation Score below rates it in a few minutes and tells you whether to systemise, automate, or leave well alone.


  1. Raymond R. Panko, "What We Know About Spreadsheet Errors," University of Hawaii — summarised on his Spreadsheet Research site at panko.com/ssr/

Frequently asked

When should you move from a spreadsheet to a database?
Move when more than one person needs to edit the same data at once, when you keep copying rows between sheets to keep them in sync, or when the data has clear relationships (clients, orders, jobs) that a flat grid can't enforce. A database gives you concurrency, validation and a single source of truth; a spreadsheet gives you none of those by default.
What are the risks of running a business on spreadsheets?
The main risks are silent errors, version confusion and key-person dependency. Research on operational spreadsheets has repeatedly found errors in the large majority of audited files, and because spreadsheets have no audit trail or permissions, a wrong number can propagate for months before anyone notices. When one person holds the logic in their head, a single resignation can stall the whole process.
What should replace a spreadsheet — a database, an app, or a SaaS tool?
It depends on how standard the process is. If a proven off-the-shelf SaaS tool already does the job, buy it. If your process is genuinely specific and a source of advantage, a custom internal app is justified. A shared database sits between the two — structured storage you build a thin interface on. The choice is a build-versus-buy decision; see build vs buy software.
Is Excel bad for business processes?
Excel isn't bad — it's the wrong tool past a certain point. It's superb for modelling, one-off analysis and prototyping a process. It's poor at multi-user editing, enforcing rules, keeping history and scaling, because it was never designed to be a shared system of record. The problem is reaching for it to run an ongoing operational process, not using it to calculate.
What is the bus factor and how do spreadsheets create it?
The bus factor is the number of people a process can lose before it stalls — a bus factor of one means a single person is a single point of failure. Spreadsheets create this when the formulas, macros and undocumented conventions live only in one person's head. If they leave, the logic is opaque to everyone else. See bus factor.
How do you migrate off spreadsheets safely?
First map the process the spreadsheet actually runs, then clean and de-duplicate the data. Run the new system in parallel with the old sheet for a cycle or two so you can reconcile the two. Migrate one process at a time, not the whole workbook at once, and keep a read-only copy of the original as a fallback.
How many copies of a spreadsheet is too many?
More than one editable copy of the same data is already too many. The moment you maintain a 'master' and people work from their own versions, you've created data fragmentation — the same fact lives in several places and they drift apart. That manual reconciliation is one of the clearest signs you need a shared system.

Keep reading

Guide

Build vs Buy: When Custom Software Beats Off-the-Shelf

Buy when the process is generic and a credible tool fits it with little bending; most needs are like this. Build bespoke software when the process is core to how you compete, no off-the-shelf tool fits without heavy workarounds, or per-seat licensing scales badly. The honest default is buy. Custom earns its cost only on the few processes that genuinely set you apart.

Guide

When Is a Process Worth Automating? A Practical Decision Framework

A process is worth automating when it is frequent, broadly stable each time, costly in time or errors, supported by data you already hold, and mostly rules-based rather than judgement-heavy. If it is rare, changes case by case, needs a person to decide each time, or the steps are not yet clear, automate later — systemise first.

Guide

Business Process Automation: A Practical Starting Guide

Business process automation (BPA) is using software to run a repeatable business process — approvals, reminders, data entry, status reporting — with little or no manual effort. Start where the work is frequent, rule-based and structured, the data already exists, and an error is costly. Systemise the process first, then automate it.

Topic

Systemising Pain: When to Fix a Process with Software, Automation or AI

Systemising operational pain means turning a repeated, painful task into a clear, owned process before you reach for software. A process is worth fixing with software, automation or AI when the pain is frequent, structured and costly, and the data already exists. Most teams either automate too early or never systemise at all.

Term

Single Source of Truth

A single source of truth (SSOT) is one authoritative, agreed place where a given piece of information lives, so everyone reads and updates the same version instead of keeping rival copies. It removes the "which spreadsheet is right?" problem, kills duplicate data, and means a decision is based on one set of facts rather than several conflicting ones.

Term

Process Mapping

Process mapping is the practice of drawing a process as a step-by-step diagram — showing each task, decision, handoff and information flow from trigger to outcome. It makes invisible work visible, exposes where things stall, and creates a shared picture a team can agree on before they try to improve or automate anything.