LogoLucyWorks
  • Lessons
  • Answers
  • Pricing
  • About
  • Ask Lucy
  • Book a call
LW·A16·Can AI do this?← All answers

Is free-tier AI good enough for procurement work?

Enough for triage, not enough for unsupervised decisions. In PAIR-20's July 2026 run, all findings came from free or standard web tiers, which produced useful drafts and still made arithmetic, ranking, and fabrication errors.

Free-tier AI is good enough to start procurement work. It is not good enough to finish procurement work without review.

That is the honest reading of the July 2026 PAIR-20 run. The run used ChatGPT, Claude, Gemini, and Copilot on free or standard web tiers: the kind of access a procurement team can use without waiting for an IT ticket. The tasks were realistic synthetic files: SaaS quote comparison, MSA review, freight landed cost, supplier risk, consulting bid comparison, and MRO catalog merge.

The same run also showed the limit. The platforms found useful issues, built readable tables, and often named the right supplier or risk. They also missed a unit conversion, produced landed-cost numbers that did not match the case answer, ranked the highest consulting bid first after doing the math, and filled a blank catalog field with a guess.

PAIR stated the run conditions plainly: these were single runs dated 2026-07-01 and 2026-07-02, not averages. A miss in that run might be caught on another run, and a catch might be missed later. Free-tier model versions can shift without notice, and long case files sometimes had to be pasted in chunks.

Use it for first-pass coverage. Free-tier AI can read a messy file, name the obvious traps, draft a comparison table, and make the work easier to inspect. That is a useful start.

Do not use it as the approval layer. The errors in the July run were not only rough wording. They affected units, totals, rankings, and blank fields. Those are decision inputs.

Build the workflow around verification. The practical question is not whether the tool costs money. It is whether the team has a review step for the fields that change the recommendation.

Where this comes from

  • PAIR-20 July 2026 run of record — free or standard web tier run conditions, screenshots on file

Last checked Sat Jul 04 2026 00:00:00 GMT+0000 (Coordinated Universal Time). Evidence comes from dated, single-run platform sessions with screenshots on file — read each finding as “this happened,” not “this always happens.”

See what the platforms caught — and missed

Twenty procurement tasks, four AI platforms, real dated runs. Lesson 2 is free to read, no account needed.

Read the free lessonTraining for your team
LogoLucyWorks

AI training that ends with a working agent.

Product
  • The 20 Lessons
  • Answers
  • Ask Lucy
  • PAIR-20 benchmark
  • Reality Check
  • Pricing
  • Book a call
Company
  • About
Legal
  • Cookie Policy
  • Privacy Policy
  • Terms of Service
© 2026 LucyWorks. All Rights Reserved.