HIGH SALIENCE / RESEARCH / PAYROLL TEARDOWN

TEARDOWN 07 · PUBLISHED · UPDATED · DATASET INCLUDED

100 Payroll Software Questions: What ChatGPT Recommends

We asked ChatGPT 100 payroll software questions to see what it recommends, and one brand's website was cited in two answers out of three. Seventh category, same method: ChatGPT with web search on, every answer coded under the rulebook the earlier teardowns used, Google's top ten as a control. Payroll answers are slow to commit: 19 of the 100 make no pick of their own, more than any earlier category except payment processing. But when a buyer asks directly what to use, one brand is always in the verdict. The reason is visible in the citations: that brand's website is the model's main reading material for the whole category.

This page was recoded on September 27, 2026 under codebook v2.0: two independent AI readers coded every answer and a third reader settled their disagreements. The rule-based coder behind the original figures agreed with them on 51.4 percent of brand codes. The biggest changes: answers recommending no dictionary brand fell from 28 to 1 (19 answers still make no pick), Gusto's recommendations rose from 47 to 73 (61 of them picks), and head-to-heads recommending every named brand rose from 18 to 30 of 30 (21 at the picked level). The earlier version's data is available on request.

01Method

How we tested ChatGPT on payroll software

We tested ChatGPT on payroll software the same way as the earlier teardowns: same query structure, same coding, one new category.

Queries: 100 payroll software queries built from the same templates as the earlier teardowns: 30 category, 30 comparison, 20 alternative and 20 recommendation. The full list is in the dataset.

Surface: ChatGPT with web search forced on, logged out, United States, English, via the DataForSEO scraper, one run per query, collected September 21, 2026.

Control: Google's top ten organic results for the same queries in the same window, via the DataForSEO SERP API at depth 20 and truncated to the first ten organic results.

Coding: every answer was coded by two independent AI readers (Claude agents working blind from a written protocol), with a third settling disagreements. They were not people. Each brand named was coded picked (the answer's own verdict: "my pick", "choose X if", a shortlist it tells you to act on, the #1 of its ranking), recommended (assigned to a stated case or fit, such as "best for small teams", without being the answer's verdict), listed (named as an option, no fit given), passing (named but not offered as an option) or anchor (the brand being replaced in an "alternatives" query), against a 55-brand dictionary fixed before collection, under codebook v2.0. "Recommended" in the tables includes picked brands. The two readers agreed on 98.8% of brand codes in this teardown (99.3% at the recommended level). Cited URLs were deduplicated to their domain and classed as first-party or third-party.

Collection note: the ChatGPT answers and the Google controls for this category were both collected through the DataForSEO connector's live endpoints, one query at a time, with the same settings as the earlier teardowns. The Google controls were pulled two result pages deep, because a single page at depth 20 returned fewer than ten organic results for most payroll queries; every control has ten. Eleven aliases in the brand dictionary were narrowed before coding because they are also ordinary words or name a parent product ("remote", "check", "hourly", "plane", "warp", and the payroll add-ons of Sage, Xero, Wave, Square and Toast); the dictionary shipped with the dataset is the narrowed one.

One run per query, so this is a teardown, not the benchmark. Frequencies describe this window only. Absence means not observed in this sample, never zero visibility.

02Findings

Which payroll software does ChatGPT recommend most?

The payroll software ChatGPT recommended most often was Gusto, in 73 of 100 answers, and Gusto was its own pick in 61 of the 100. In short: one default, and a field the model describes but seldom picks.

Bar chart of 10 payroll software brands showing, out of 100 ChatGPT answers, how many each appears in, how many recommend it and how many pick it. Gusto 73, 73 and 61, ADP 46, 45 and 23, Rippling 41, 38 and 26, QuickBooks Payroll 40, 39 and 25, OnPay 31, 28 and 14, Paychex 28, 26 and 8, Patriot 20, 18 and 12, Deel 18, 18 and 13, Justworks 18, 16 and 15, Square Payroll 14, 13 and 4.
BrandAppears inRecommended inPicked inPicked share of appearances
Gusto73736184%
ADP46452350%
Rippling41382663%
QuickBooks Payroll40392562%
OnPay31281445%
Paychex2826829%
Patriot20181260%
Deel18181372%
Justworks18161583%
Square Payroll1413429%

Each linked brand has its own page: how ChatGPT recommends every brand in this dataset, with positioning labels, head-to-head results and sources.

Out of 100 answers, codebook v2.0. "Picked" means the answer itself chose the brand as its verdict, overall or for a case. "Recommended" means the answer assigned the brand to a stated case or fit, and includes picked brands. "Appears" adds brands named as an option with no fit. The brand being replaced in an "alternatives" query is excluded from all columns.

Gusto is in every recommendation pick

Gusto is named in 73 of 100 answers, recommended in all 73 and picked in 61. All 20 recommendation-intent queries produced a pick from the dictionary, and Gusto was picked in every one of them. It was the only pick for an ecommerce store, a real estate brokerage and a business replacing the accountant who runs its payroll. QuickBooks Payroll and ADP were picked in 9 of the 20 each, Rippling in 7, Justworks in 5. Only one other category so far has a brand in every recommendation answer that made a pick, QuickBooks in accounting (19 of 19), and no other brand in this series is picked in all 20.

The rest of the field is recommended, then passed over

Below Gusto, the rest of the field is mostly recommended for some case, but far less often the answer's own verdict. ADP is named in 46 answers, recommended in 45 and picked in 23. QuickBooks Payroll is named in 40 and picked in 25. OnPay 31 and 14. Paychex is named in 28 answers, recommended in 26 and picked in 8, and three of those eight are the questions about a 50-person company, a mid-size company and employees in multiple states. The highest pick rates after Gusto belong to brands with a clear lane: Justworks is picked in 15 of its 18 appearances, Deel in 13 of 18, most often for international, remote and contractor payroll and for startups, and Patriot in 12 of 20, mostly on price, simplicity and very small teams.

The model asks for your headcount before it commits

In most answers the model ends by asking the buyer for headcount, often with states and benefits. Nineteen answers make no pick of their own, more than any earlier category except payment processing (22). Only one answer recommended no dictionary brand at all: the open source alternative to Gusto, which named Frappe HR, Horilla and Odoo, none of them in the payroll dictionary. The comparison queries show the caution most clearly. All 30 head-to-heads recommended every brand named for some case, but only 21 picked every brand named, the second-lowest of the seven categories after payment processing (19), and seven picked none of them. Gusto versus ADP, Gusto versus Paychex and ADP versus Paychex each came back as a side-by-side followed by a request for headcount; Deel versus Remote asked whether the buyer was hiring or being hired. Two of the seven, both involving Paycor, noted that Paychex acquired Paycor in 2025.

The vertical prompts mostly kept the general field

Most vertical prompts left the general field in place. Nonprofits got picks of Gusto, OnPay, Justworks and ADP; law firms got Gusto, ADP, Paychex, OnPay and QuickBooks Payroll. A real estate brokerage got Gusto as its pick, with ADP, Rippling, OnPay and Square Payroll recommended for other cases. Restaurants got Toast Payroll and Homebase alongside Gusto and ADP. Healthcare practices got Paylocity alongside Gusto and ADP. Two prompts did swap the field: household employers were pointed to Poppins Payroll, SurePayroll and HomePay, with no pick, and construction companies to Payroll4Construction, Foundation Software, Sage, ADP and Miter, with Gusto and QuickBooks Payroll kept for small private-work contractors.

More than half the picks go to brands that rank

Brands whose own site ranks for the query take most of the picks here. Of the 383 recommended brand mentions, 202 were for brands whose own website does not rank in Google's top ten organic results for that query, 53 percent. Of the 246 picked mentions, 113 were, 46 percent. Both are the lowest of the seven categories. Google's top ten for payroll queries is also the most vendor-heavy so far: 347 of the 1,000 organic results are brand sites, and gusto.com alone is in the top ten for 58 of the 100 queries, adp.com for 48.

One website is the reading list

A single website tops the model's reading list by a wide margin. Across 100 answers there were 314 citation events to 91 domains, one per cited domain per answer. gusto.com alone accounts for 65 of them, 21 percent of every citation in the category, and it is cited in 65 of the 100 answers. Forty-eight of those 65 answers are to questions that do not mention Gusto at all: "best payroll software for restaurants", "ADP alternatives", "which payroll software should I use if I have employees in multiple states". Gusto publishes comparison and guide pages on its competitors, and the model reads them. The next most-cited domains are adp.com (20), patriotsoftware.com (15) and intuit.com (13). Sixty-one percent of all citation events went to vendors' own sites, the highest share of the seven categories, and 49 answers cited nothing but vendor pages. Fit Small Business (12) and G2 (10) lead the third-party sources. Reddit and Wikipedia have zero citations, for the seventh teardown running.

One hundred thirty-four of the 314 citation events involved a domain that also sat in Google's top ten for that query, 43 percent, the highest overlap so far.

037 categories, side by side

ChatGPT's payroll software answers vs other categories

The table sets ChatGPT's payroll software answers beside the other categories tested earlier in the series, side by side under the same rulebook.

Measure (codebook v2.0)Project management, Sept 8CRM, Sept 17Email marketing, Sept 17Help desk, Sept 17Accounting, Sept 17Payment processing, Sept 17Payroll, Sept 21
Recommendations per category answer (average)5.94.35.05.54.34.24.6
Answers with no recommended dictionary brand1 of 1005 of 1001 of 1001 of 1000 of 1005 of 1001 of 100
Answers with no pick (the answer's own verdict)2 of 10011 of 1002 of 1004 of 1009 of 10022 of 10019 of 100
Most-recommended brand: appears / recommendedAsana 73 / 73HubSpot 75 / 74Mailchimp 58 / 56Zendesk 70 / 69QuickBooks 75 / 73Stripe 70 / 68Gusto 73 / 73
Most-picked brand: appears / pickedAsana 73 / 70HubSpot 75 / 69Mailchimp 58 / 44Zendesk 70 / 61QuickBooks 75 / 65Stripe 70 / 54Gusto 73 / 61
Head-to-head queries recommending every named brand30 of 3028 of 3030 of 3029 of 3026 of 3028 of 3030 of 30
Head-to-head queries picking every named brand30 of 3023 of 3029 of 3029 of 3025 of 3019 of 3021 of 30
Recommendation-intent queries with a dictionary recommendation19 of 2018 of 2020 of 2020 of 2020 of 2019 of 2020 of 20
Recommendation-intent queries with a pick19 of 2018 of 2020 of 2020 of 2019 of 2018 of 2020 of 20
Recommended mentions where the brand does not rank in Google's top 10398 of 468 (85%)269 of 387 (70%)313 of 419 (75%)350 of 445 (79%)206 of 368 (56%)294 of 360 (82%)202 of 383 (53%)
Picked mentions where the brand does not rank in Google's top 10349 of 416 (84%)226 of 330 (68%)270 of 370 (73%)291 of 380 (77%)141 of 279 (51%)170 of 222 (77%)113 of 246 (46%)
Google top 10 that is third-party pages746 of 1,000 (75%)710 of 1,000 (71%)720 of 1,000 (72%)714 of 1,000 (71%)743 of 1,000 (74%)787 of 1,000 (79%)653 of 1,000 (65%)
Citation events to vendors' own sites216 of 362 (60%)136 of 320 (42%)193 of 367 (53%)152 of 345 (44%)125 of 302 (41%)161 of 301 (53%)192 of 314 (61%)
Answers citing only vendor pages50 of 10040 of 10037 of 10027 of 10034 of 10047 of 10049 of 100
Share of citations in the 10 most-cited domains54%40%42%45%55%58%55%
Citation events whose domain is in Google's top 1083 of 362 (23%)83 of 320 (26%)97 of 367 (26%)80 of 345 (23%)99 of 302 (33%)98 of 301 (33%)134 of 314 (43%)
Reddit and Wikipedia citations0000000

All columns are coded under codebook v2.0 by two independent AI readers per answer; the project management column is the September 8 dataset recoded under it. Each teardown is one run per query in its own window, so differences between columns mix category with collection date.

04What this changes

What ChatGPT's recommendations mean for payroll software brands

What ChatGPT's recommendations mean for payroll software brands comes down to four things, in order.

Your competitor's content can be your competitor's recommendation engine. In this category the model reads gusto.com to answer questions about ADP, Paychex and restaurant payroll. A vendor that publishes the category's best comparison pages is writing the model's briefing notes. If that vendor is not you, you are being described in someone else's words.

Answer the headcount question on the page. The model asks for employee count in most answers, and in 19 it picks nothing. The brand that states "for 1 to 50 employees in one state" in plain words gives the model a condition it can use.

Being recommended is not being picked. Paychex is one of the largest payroll companies in the country. It is recommended for some case in 26 of the 28 answers that name it, and picked in 8. Scale gets you into the list; a stated case gets you chosen from it.

Specialists win their lane. Deel for international and contractors, Patriot on price, Toast Payroll for restaurants. Deel is picked in 13 of its 18 appearances and Patriot in 12 of its 20, both more than twice Paychex's rate. A narrow case stated clearly beats a broad one.

05Limitations

Limitations of the ChatGPT payroll software test

The limitations of the ChatGPT payroll software test start with variance: one run per query means answer variance is unmeasured; Benchmark 01 runs each query three times across three surfaces. The teardowns are collected on different days, so differences between categories mix the category with the date. The brand dictionary covers the general payroll software market and deliberately excludes vertical tools, so their appearances are described in prose and not counted. The readers are AI models, not people: they follow a written protocol and agree with each other closely, but a shared blind spot would not show up as disagreement. The line between picked and recommended is a judgment, documented in the protocol with examples. Sentiment is not coded. No vendor-tool cross-check was read for this category. Google's control counts a brand as ranking only when its own domain is in the top ten; a listicle that features the brand does not count. The ChatGPT answers and Google controls for this category were collected four days after the earlier teardowns, through the live connector rather than the standard queue; the settings are the same, the window is not. The dictionary excludes vertical tools by design; Payroll4Construction, Miter, Restaurant365 and HR for Health appear in answers but are not counted.

06Dataset

Download the ChatGPT payroll software dataset

Every number above can be recomputed from the ChatGPT payroll software dataset below, so download it and check it rather than believe it. CC BY 4.0: use the files, cite the page.

  • queries.csv: the 100 queries with intent labels.
  • brands.csv: the 55-brand dictionary with aliases and canonical domains.
  • mentions.csv: 433 coded brand mentions with position, type, a 0/1 picked column and whether the brand's domain was in Google's top ten.
  • citations.csv: 314 citation events with domain class and Google overlap.
  • observations.csv: one row per query with brand, recommendation, citation and control counts.
  • codebook.md: the rulebook, with dated amendments through v2.0.
  • reader-protocol.md: the written protocol both readers coded against (codebook v2.0).
  • picked_stats.json: the picked-level figures.

The earlier teardowns: Teardown 01, project management, Teardown 02, CRM, Teardown 03, email marketing, Teardown 04, help desk, Teardown 05, accounting, Teardown 06, payment processing. This teardown is also being published on the High Salience Substack.

Get the ChatGPT payroll software test for your own category

The ChatGPT test we ran on payroll software can be run on your own category too. In the wider series: seven categories, and the reading list is the story.

In payroll the model's picks track one vendor's website. In help desk they track a comparison blog nobody had heard of. In accounting they track NerdWallet. Finding out what the model is reading for your category is the first thing a Category Salience Brief does, with a query set you approve first.

Turning a category read like this into a plan, and then into picks, is what our AI SEO services are for.

For companies selling payroll software, the same data sets the plan for B2B SaaS SEO across Google and AI answers.