QXProveIt Research Report

The Last Manual Process

Finance automated decades ago. Marketing, sales, HR โ€” all platform-driven. Quality assurance, the function responsible for whether the product actually works, is still running on spreadsheets and human labor. Nobody noticed.

๐Ÿ“– 10 min read ๐Ÿข Organizational analysis ๐ŸŽฏ For CTOs, COOs & Engineering VPs

If you walked into your finance department and found the team reconciling accounts in spiral notebooks, you'd fire someone. If your marketing team was tracking campaign performance on a whiteboard, you'd question the CMO's judgment. If your sales team managed their pipeline in personal spreadsheets, you'd wonder how the company survived.

Now walk into your QA department.

Test cases maintained in spreadsheets โ€” or in a test management tool that is, functionally, a spreadsheet with a login page. Requirements traced to test cases by hand, in documents that were outdated before they were finished. Compliance evidence gathered manually from six different systems and assembled into folders for auditors. Security reviews conducted when someone remembers to request one. Release decisions based on the collective sentiment of people in a room, none of whom have quantified data about actual test coverage.

This is the current state of quality assurance at the majority of software companies. Not at struggling startups โ€” at well-funded, well-managed organizations that have automated every other business function and somehow never noticed that the one responsible for product quality was still operating like it's 2004.

The Automation Timeline Every Other Department Followed

To appreciate how far behind QA has fallen, look at the timeline. Every other business function went through a transformation from manual processes to platform-driven operations. Most of them completed that transformation over a decade ago.

When Each Department Got a Platform

The year the function transitioned from manual processes to automated, platform-driven operations
Finance
QuickBooks, NetSuite, SAP. Automated reconciliation, real-time reporting, audit-ready records.
1998โ€“2005
Automated
Sales
Salesforce, HubSpot, Pipedrive. Pipeline management, forecasting, activity tracking โ€” all automatic.
2000โ€“2008
Automated
Marketing
Marketo, HubSpot, Pardot. Campaign tracking, attribution, lead scoring โ€” no spreadsheets.
2006โ€“2012
Automated
HR
Workday, BambooHR, Rippling. Payroll, benefits, performance management โ€” systematized.
2008โ€“2015
Automated
Customer Success
Gainsight, Totango, ChurnZero. Health scores, renewal forecasting, automated engagement.
2012โ€“2018
Automated
DevOps
Jenkins, GitHub Actions, CircleCI. Build, test execution, deployment โ€” fully automated pipelines.
2013โ€“2019
Automated
Quality Assurance
Manual test authoring. Spreadsheet traceability. Hand-assembled compliance evidence. Subjective release decisions.
Still waiting
Manual

Read that table slowly. Finance got its platform in 2005. Sales in 2008. Marketing by 2012. Even DevOps โ€” which didn't exist as a discipline until the early 2010s โ€” automated faster than QA.

QA is the last function standing that still relies on humans to manually produce the core artifacts of their job. Not to make decisions โ€” to produce deliverables. Requirements documents. Test cases. Compliance evidence. Traceability matrices. These are production outputs that, in every other department, have been platform-generated for years.

20+ years
behind the automation curve that every other business function completed over a decade ago
Based on platform adoption timelines across business functions

What Every Other Department Did (That QA Didn't)

The transformation that finance, marketing, sales, and HR went through followed a consistent pattern. In each case, the function shifted from humans producing artifacts to humans reviewing artifacts that a platform produced. The work didn't disappear. The labor model changed.

Finance
Accountants manually reconcile every transaction
Platform reconciles automatically. Accountants review exceptions.
Transformed: ~2003
Marketing
Marketers manually track every campaign result in spreadsheets
Platform attributes leads and reports ROI. Marketers optimize strategy.
Transformed: ~2010
Sales
Reps manually log every call and update pipeline forecasts
CRM tracks activity automatically. Reps focus on selling.
Transformed: ~2008
HR
HR manually processes payroll, tracks PTO, manages enrollment
Platform handles administration. HR focuses on people strategy.
Transformed: ~2012
Quality Assurance
Engineers manually write test cases, track coverage, assemble evidence
Engineers still manually write test cases, track coverage, and assemble evidence.
Not yet transformed

The pattern is clear โ€” and its absence in QA is conspicuous. The function that determines whether the product works is the only one where the core deliverables are still handmade. Not hand-reviewed. Hand-made.

The Absurdity, Stated Plainly

Sometimes the best way to see something clearly is to place it next to its equivalent in a context where you'd never tolerate it. Here's what QA's current operating model looks like when you translate it to other departments.

If Other Departments Operated Like QA

Finance: An accountant reviews every bank transaction and manually types a journal entry for each one into a spreadsheet.
โ‰ˆ
QA: A test engineer reads every code change and manually writes test cases for each one into a test management tool.
Marketing: A marketing analyst manually checks every ad platform daily and copies performance data into a deck for leadership.
โ‰ˆ
QA: A QA lead manually gathers test results from CI, coverage tools, and bug trackers, then builds a status report in PowerPoint.
Sales: A sales rep writes a memo after every customer interaction describing what was discussed, then files it in a shared drive.
โ‰ˆ
QA: A tester writes documentation after every test pass describing what was verified, then files it in a shared drive for auditors.
HR: An HR coordinator manually calculates every employee's paycheck, deductions, and tax withholding in Excel.
โ‰ˆ
QA: A QA analyst manually calculates test coverage, traces requirements to test cases, and computes release readiness in Excel.
DevOps: A release engineer manually copies build artifacts to each server and runs deployment commands one at a time.
โ‰ˆ
QA: A QA engineer manually assembles compliance evidence from multiple systems and organizes it into folders for the auditor. (This is literally still happening.)

The left column describes practices that were abandoned 10 to 20 years ago. The right column describes what's happening today, right now, in QA departments at companies that consider themselves modern, well-run engineering organizations.

Nobody decided QA should stay manual. It just never had its platform moment โ€” the point where a single system absorbed the manual labor and transformed the human role from producer to reviewer. The tools that exist in the QA market are management tools โ€” they organize and store what humans create. They don't create anything.

"I had a realization during a board meeting. Our CFO was presenting real-time financial dashboards generated automatically by NetSuite. Our CRO showed pipeline analytics from Salesforce. Our CMO had attribution data from HubSpot. Then our VP Engineering presented QA status โ€” from a manually assembled slide deck, with coverage numbers calculated by hand, based on test results someone exported from three different tools that morning. We were the only function in the room still doing manual reporting."

โ€” CTO, Series C SaaS Company

Why QA Got Left Behind

The question of how this happened has a straightforward answer. It wasn't neglect. It was a technology constraint that was mistaken for a permanent condition.

The core problem was generation, not management. Finance platforms didn't just organize financial records โ€” they generated reconciliations, reports, and forecasts automatically. Sales platforms didn't just store contacts โ€” they tracked activity, scored leads, and predicted pipeline automatically. The transformation in every department was the shift from humans producing artifacts to platforms producing artifacts. QA tools never made that shift because they lacked the ability to generate the artifacts โ€” test cases, requirements, compliance evidence โ€” from the source material. They could only store artifacts that humans created.

The source material required code-level understanding. Financial data is structured. Sales activity is structured. Marketing campaign data is structured. Code is... not. Reading a codebase and understanding what it does โ€” well enough to generate meaningful test cases and accurate requirements โ€” required a kind of comprehension that software tools couldn't do until recently. The information was there, but extracting it required an intelligence that tools didn't have.

The industry normalized the manual approach. When every company operates the same way, nobody questions whether the approach is optimal. Manual test authoring isn't a best practice โ€” it's a default that persisted because the alternative didn't exist. Test management tools optimized the storage and tracking of manually-created artifacts, which made the manual creation process more efficient without questioning whether it should be manual at all.

What the Delay Is Actually Costing

The cost of QA's delayed transformation isn't just the cost of manual labor โ€” though that's substantial. It's the compounding cost of operating a critical function at a fraction of its potential efficiency while every other function operates at full platform-enabled capacity.

The Compounding Cost of the QA Gap

Direct Labor
$1.2Mโ€“$2.4M/yr
For a 50-engineer org: manual test authoring, requirements writing, compliance evidence assembly, traceability maintenance, reporting. All work that platforms handle in other departments.
Opportunity Cost
$800Kโ€“$1.6M/yr
Engineers writing tests instead of features. QA analysts building reports instead of improving quality. The velocity tax of manual processes on every sprint, every release.
Quality Deficit
$300Kโ€“$900K/yr
Production incidents caused by inadequate coverage. Customer churn from reliability issues. Hotfix cycles that displace planned work. The cost of not catching defects that a platform would catch.
Competitive Disadvantage
Unquantifiable
Your competitor who automates quality ships faster, ships more reliably, and spends fewer engineering hours on non-feature work. The gap compounds with every sprint.

Add the quantifiable costs, and the QA automation gap costs a 50-engineer organization between $2.3M and $4.9M annually. That's not the cost of QA โ€” it's the cost of doing QA manually in an era when the alternative exists.

$3.6M
Average annual cost of manual QA operations for a 50-engineer team (midpoint estimate)
Direct labor + opportunity cost + quality deficit

What QA Looks Like When It Finally Gets Its Platform

When QA follows the same transformation path that every other department already completed, the function doesn't shrink. It changes shape. Just as accountants didn't disappear when NetSuite automated reconciliation โ€” they shifted to analysis and strategy โ€” QA professionals shift from artifact production to quality judgment.

Test cases are generated, not authored. The platform reads the codebase and produces comprehensive tests โ€” unit, integration, functional, acceptance โ€” across all affected code. QA engineers review and refine rather than write from scratch.

Requirements are extracted, not transcribed. The platform analyzes code to produce formal requirements documents. Requirements analysts focus on validating business intent rather than manually describing technical behavior.

Compliance evidence is continuous, not assembled. The platform scans every commit against applicable frameworks and produces audit-ready evidence packages automatically. Compliance officers review findings rather than gathering screenshots.

Release decisions are data-driven, not sentiment-driven. The platform provides real-time coverage metrics, security scan results, and compliance status. Go/no-go meetings become 5-minute evidence reviews rather than 30-minute consensus checks.

Reporting is live, not assembled. Traceability matrices, coverage reports, executive dashboards, and audit evidence are generated on demand from current data. Nobody spends 86 hours a month building reports that are stale before they're presented.

"When I describe what our QA team does now versus 18 months ago, people think I'm exaggerating. I'm not. The team is the same size. They're just doing different work. They used to write tests. Now they review them. They used to build reports. Now they analyze them. They used to assemble compliance evidence. Now they audit it. The platform handles the production work. The humans handle the judgment work. That's what automation was supposed to look like all along."

โ€” Director of Engineering, B2B Platform Company

The Moment of Recognition

Manual production
Platform generation
Core QA Artifacts
20+ years behind
Parity achieved
Automation Maturity vs. Peers
$3.6M manual cost
~$18Kโ€“36K/yr
Annual Platform Cost (50 eng.)
Artifact producers
Quality strategists
QA Team Role

The Bottom Line

Every business function eventually reaches a point where manual operations become untenable and a platform absorbs the production work. Finance reached it in the early 2000s. Sales and marketing reached it by 2010. HR and customer success followed. DevOps automated faster than any of them.

Quality assurance has been waiting for its turn. The technology constraints that prevented it โ€” the inability to automatically read code, understand behavior, and generate quality artifacts โ€” have been resolved. The platform exists. The transformation path is the same one every other department already walked.

The question for engineering leadership is whether they want to be the organization that recognizes this now, or the one that's still doing it manually when their competitors have already moved on. Every other department in the company already knows the answer. QA is just the last one to get there.

It's Time QA Got Its Platform.

QXProveIt transforms quality assurance from a manual production function into a platform-driven operation โ€” generating test cases, requirements, security scans, and compliance evidence across 20 languages and 18 compliance frameworks. Automatically.

The Last Manual Process: Why QA Is 20 Years Behind Every Other Department | QXProveIt | MCX Services