Humanizers vs AI Detectors: One Service Beats Pangram in 4% or 87% of Cases, Depending on the Test

A factual 2026 breakdown: how the invisible watermarks of ChatGPT, Claude and Gemini work, how accurate the Pangram, GPTZero and Turnitin detectors are, what percentage of “success” humanizers deliver in benchmarks and independent studies, what they do to facts, and how AI text is caught on Wikipedia. 23 charts, a false-accusation calculator, a map of methods, a navigator by role.

Humanizers vs AI Detectors: One Service Beats Pangram in 4% or 87% of Cases, Depending on the Test
On this page
  1. 01 · Three signals that are constantly confused
  2. 02 · Three years of the race
  3. 03 · Watermarks: What They Withstand and What They Do Not
  4. 04 · Detectors: Vendors’ Promises and Independent Tests
  5. 05 · The Arithmetic of False Accusations
  6. 06 · What a Humanizer Is and Who Uses It
  7. 07 · How Much “Success”: Benchmarks With a Conflict of Interest
  8. 08 · Independent Tests: From 1% to 97%
  9. 09 · The Price of Rewriting: Facts, Quotes, Meaning
  10. 10 · Wikipedia: They Check Sources, Not Style
  11. 11 · Ukrainian and the Human Eye
  12. 12 · Rules and Money
  13. 13 · Method map
  14. 14 · What this means for you
  15. 15 · What’s next
  16. Honesty and limitations
  17. Sources

On October 5, 2026, OpenAI announced that it is embedding an invisible textGrain watermark in ChatGPT texts for users in the EU. In August Anthropic announced the same for Claude, and Google has been marking Gemini texts since 2024. At the same time, the market for services that promise to make machine text “human” — humanizers — is growing. Their benchmarks name winners every month: in October one ranked StealthGPT first (88% of texts passed the Pangram detector), another ranked Phrasly first (86.7%; in the overall ranking of that benchmark WriteHuman came first). In the first benchmark, the same Phrasly passed Pangram in only 4% of cases.

The real picture is less dramatic. A watermark, a linguistic-profile detector and paste metadata are three different signals, and bypassing one does not mean bypassing the others. Humanizer benchmarks are run by the humanizer sellers themselves, and each ends up in first place in its own test. Independent studies show a spread of 1% to 97% of missed texts for the same detector, depending on versions. And in the strictest quality test (run by the humanizer maker TextPulse, with GPTZero as the detector), the share of texts that passed the detector and did not lose facts, quotations or meaning was 0 to 10%.

A humanizer’s “success” percentage is a property of the pair “service + detector” on a given date and of whoever runs the test, not of the service alone: in five independent studies Pangram missed from 1% to 97% of rewritten texts, and on Wikipedia machine text runs up against source verification, not the detector, in any case.

4% / 87%
the same humanizer (Phrasly) beats Pangram in two October tests — the tests differ in who ran them, the service mode and the Pangram version (4.1 vs 4)
1–97%
of rewritten texts were missed by Pangram in five independent studies in 2025–2026 — depending on the rewriting service, detector version and genre; Pangram 4/4.1 has not been independently tested
92% → 17%
detection of OpenAI’s textGrain watermark after replacing 25% of words with synonyms (company test, 400 tokens)
0–10%
of texts passed GPTZero without losing facts, citations or meaning in the strictest quality test (TextPulse — a humanizer vendor’s test, 11 services)

This is a review of published studies and tests as of October 28, 2026, not a guide to bypassing detectors and not legal advice. All percentages refer to specific versions of services and detectors on the date of the test.

01 · Three signals that are constantly confused

A language model writes text by choosing the next token — a word or part of a word — from several plausible options each time. A statistical watermark slightly steers this choice with the help of a secret key. A single word gives nothing away, but over hundreds of words a pattern accumulates that only the detector of the key’s owner can check. The mark lives in the choice of words, not in formatting, so copying into a document or a content management system does not destroy it. An em dash, the word “delve” or uniform sentence length is not a watermark but a stylistic feature.

A linguistic-profile classifier — Pangram, GPTZero, Turnitin, Originality.ai — is trained on examples of human and machine texts and estimates the probability that a model wrote the text. It knows nothing about watermark keys and works with texts from any model, including open ones, which have no marks. This is exactly the profile that humanizers try to change.

Paste metadata is the third signal. When text is copied from a chatbot’s web interface, service metadata can travel with it. This is exactly what LLM Paste Check has been checking since September 2026 in the visual editor of English Wikipedia (since October 8, in all Wikipedias).

1. Creation 2. Copying 3. Pasting 4. Publishing Watermark lives in word choice; weakened by word swaps, rewriting, translation read only by key owner’s detector Linguistic profile rhythm, vocabulary, syntax; what humanizers alter Pangram, GPTZero, Turnitin — probability score Paste metadata accompany text copied from a chatbot and pasted LLM Paste Check in the Wikipedia editor; lost on republishing
Watermark, linguistic profile and paste metadata are three different signals: bypassing one does not mean bypassing the othersNeuroDrift diagram based on descriptions by Anthropic (August 2026), OpenAI textGrain (October 2026), Google SynthID-Text (Nature, 2024), Pangram 4.1 (model card, October 2026) and the Wikimedia page “Edit check / LLM Paste Check.”

Hence the main conclusion for this entire article: a text that passed Pangram may still contain a textGrain or Claude watermark. And vice versa: a detected watermark does not show who checked the facts, how much a human edited, or whether the text complies with Wikipedia’s rules.

02 · Three years of the race

OpenAI’s first attempt, the AI Text Classifier, was shut down within six months because of low accuracy. Since then detectors have grown stronger, bypassing has become a business of its own, and Wikipedia and regulators have moved from recommendations to bans and mandatory labeling.

2023 2024 2025 2026 Watermarks green list (KGW) OpenAI withholds SynthID (Nature) Claude mark OpenAI textGrain Detectors OpenAI Classifier shut down Turnitin vs. bypass Pangram 4 Bypass DIPPER rewrite mark stealing 19-service audit StealthGPT Super Wikipedia AI Cleanup G15 deletion 44:2 ban LLM Paste Check Rules White Paper UA China: labeling EU Code AI Act Art. 50 Year: publication, launch or entry into force; see caption.
Three years of the race: detectors got stronger, bypassing became a business, and Wikipedia and regulators moved from advice to bans and labelingKirchenbauer et al. (January 2023); OpenAI AI Text Classifier (Jan 31, 2023, closed Jul 20, 2023); Krishna et al., DIPPER (March 2023); Jovanović et al., Watermark Stealing (February 2024); WSJ on OpenAI’s unreleased watermark (August 2024); Dathathri et al., Nature (October 2024); DAMAGE audit (January 2025; the authors are Pangram employees); Turnitin AI bypasser detection (August 2025); Pangram 4 (July 2026); Anthropic (Aug 14, 2026); StealthGPT Super (Sep 8, 2026); OpenAI textGrain (Oct 5, 2026); WikiProject AI Cleanup (Dec 4, 2023); G15 (Aug 4, 2025); RfC 44:2 (Mar 20, 2026); LLM Paste Check (Sep 24, 2026 — English, Oct 8, 2026 — all Wikipedias); Ministry of Digital Transformation White Paper (June 2024); China (Sep 1, 2025); EU Code of Practice (Jun 10, 2026); AI Act, Art. 50 (Aug 2, 2026).

03 · Watermarks: What They Withstand and What They Do Not

Google described its SynthID-Text in a peer-reviewed paper in Nature in October 2024. In an experiment on ≈20m Gemini responses, the share of “like” ratings with and without the watermark differed by 0.01 percentage points, and “dislike” ratings by 0.02 pp: users did not notice a difference. Google released the code for generating and checking the watermark in the Hugging Face Transformers library. The company itself warns that the watermark is less effective on factual responses, and that heavy rewriting or translation lowers the detector’s confidence.

On August 14, 2026, Anthropic explained that its new Claude models embed a variant of the same SynthID-Text approach in text — because of AI Act requirements, but immediately for the whole world. The company gives no reliability figures of its own, but it honestly lists the limitations: verification is unreliable on short texts, and the signal is weak in factual texts and code; light edits are unlikely to remove the watermark, while “rewriting every word in full” will. A translation done by Claude itself preserves the watermark, because the model chooses every word. The detector is available only through a closed API for regulators, media, fact-checkers, researchers and educational organizations.

On October 5, 2026, OpenAI announced textGrain in ChatGPT and Codex for EU users: the rollout is phased, over the coming weeks. API customers worldwide can enable it for selected models — by default it is off. The company’s own page is not available for automated reading, so we cross-checked the figures of the technical report against four publications. On excerpts of 400 tokens the watermark was detected in about 95% of cases, on 200 tokens in about 80%, at a threshold of 1% false positives. Controlled replacement of words with synonyms shows the limit of robustness.

0 25 50 75 100 92 unedited 66 10% words swapped 17 25% words swapped % passages, watermark found
OpenAI’s watermark survives light editing, but replacing every fourth word leaves it in only 17% of passagesOpenAI (self-reported), “Our approach to EU text provenance rules,” October 5, 2026, as relayed from the technical report by fonearena, actuia, letsdatascience and interestingengineering (the OpenAI page is not available for automated reading). English-language passages of ~400 tokens, threshold set at 1% false positives; the 92% baseline comes from a separate test. This is controlled synonym replacement, not a commercial humanizer.

OpenAI had a text watermark ready as early as 2024: at that time The Wall Street Journal wrote about a system that recognized ChatGPT texts with “99.9%” confidence, but the company did not release it. Whether this is the same textGrain is unknown. In a survey commissioned by OpenAI, almost 30% of users said they would use ChatGPT less if the watermark appeared only in ChatGPT. The watermark appeared in response to EU requirements: Article 50 of the AI Act began to apply on August 2, 2026 (for systems already on the market — with a grace period until December 2).

Academic research shows the same picture on open models. The “green list” watermark (Kirchenbauer et al.) remained detectable after human paraphrasing, but on average only after 800 tokens. Paraphrasing by a separate model, DIPPER, lowered detection of the watermark from 100% to 57%, and detection by the statistical detector DetectGPT from 70% to 5%. Recursive five-round paraphrasing lowered watermark detection on excerpts of 300 tokens from 99.3% to 9.7% (Sadasivan et al.). And “watermark stealing” made it possible to forge or erase academic schemes with a success rate above 80% for less than $50 of queries (ICML 2024).

0 50 100 100.0 70.3 13.9 none 97.1 28.7 9.1 light 85.8 15.4 7.3 medium 68.9 8.7 7.1 strong 57.2 4.6 1.2 strongest % at 1% false positives watermark (Kirchenbauer) DetectGPT GPTZero (2023)
Paraphrasing hits statistical detectors hard, while the watermark holds up longer: 57% versus 5% after the strongest rewritingKrishna et al., “Paraphrasing evades detectors of AI-generated text,” NeurIPS 2023 (arXiv 2303.13408): GPT-2 XL texts, ~300 tokens, threshold at 1% false positives. Paraphrase levels are lexical diversity 20/40/60 and reordering 60. 2023 detectors; current GPTZero versions are considerably stronger. Intermediate values are from the paper’s table (ar5iv).

Two hands hold a sheet of old cream paper against a bright window: the light reveals a large pale watermark in the fibers, invisible from the front; behind it is a blurred typewriter; on the windowsill is a yellow rubber duck

A paper watermark is visible when held to the light. A text watermark is visible only to a detector that has the key.

There is also a limit that current watermarks do not yet overcome: models with open weights. We did not find evidence that Llama, Qwen, DeepSeek or Mistral put watermarks in their texts. Researchers (Gloaguen et al., 2025) explain that the methods for closed models do not work here, because the user controls generation, and watermarks embedded in the weights do not survive further training and quantization. The AI Act formally does not exempt open generative models from Article 50, but how to meet this requirement for models run on one’s own computer is an open question.

04 · Detectors: Vendors’ Promises and Independent Tests

In January 2023, OpenAI released the AI Text Classifier, which correctly recognized 26% of machine-written texts and falsely flagged 9% of human ones. On July 20, 2023, it was shut down “due to its low accuracy.” Since then, detectors have become much more accurate — at least by their own reports.

On October 16, 2026, Pangram reported that its fourth version falsely flagged 0.0041% of 2,046,273 human texts and missed 0.34% of ≈520 thousand machine ones. The detection rates by text length — 98.71% (50–99 words), 99.59% (100–249) and 99.79% (250–499) — are one hundred percent minus the miss rate (1.29%, 0.41% and 0.21%) published by the vendor; Pangram itself does not print the detection rates.

0 0 1 2 1.29% 50–99 words 0.41% 100–249 words 0.21% 250–499 words % missed (vendor self-reported)
The shorter the passage, the more often the detector errs: on a paragraph under 100 words there are three times as many misses as at 100–249 words, and six times as many as at 250–499Pangram Labs, “Is Pangram accurate?”, October 16, 2026: miss rates (false negative rate) for unedited machine-generated texts; the sample size in each range is not given, and there is no separate data for 500+ words. This is the vendor’s internal test. The Pangram 4.1 model card (October 19, 2026) separately warns of greater uncertainty below 150 words.

The Pangram 4.1 model card, dated October 19, adds a caveat: the minimum is 50 words “mostly in complete sentences,” below 150 words the interface shows lower confidence, and the miss rate for English even rose slightly: 0.3652% versus 0.3396% in Pangram 4. For a single sentence there are no reliable measurements at all. So a “paragraph” for Pangram is the minimum usable fragment, while an A4 page (≈350–600 words) is in practice comfortable, although Pangram publishes data only up to 499 words.

Independent checks mostly confirm that Pangram is a strong detector, but not as flawless as in its self-report; however, they were run on early versions (before Pangram 4/4.1), so a direct comparison with the self-report is tentative.

  • University of Chicago (NBER, 2025, working paper, not peer-reviewed; 2025 version of Pangram). On 1,992 human excerpts from before 2020, at the optimal threshold (by Youden’s index), the average false-positive rate across six genres (calculated from the paper’s table) was: Pangram — 0.22%, Originality.ai — 0.75%, GPTZero — 0.89%, the open RoBERTa model — 57.9%. On short excerpts of up to 50 words, Pangram erred more often: 1.1% false positives, 3.2% misses.
  • Epoch AI (July 2026, Pangram 3.3.2). On 495 human texts, Pangram and GPTZero did not err a single time, while Originality.ai erred 19 times (3.84%). But when models imitated the style of a specific author, Pangram missed 10.1% of machine texts, GPTZero 10.8%, and Originality.ai 17.9%; scientific texts were the hardest.
  • VUB university in Brussels (2026, preregistered study). In 160 papers of 4,000 words or more (40 of them human), none of the four detectors produced false positives. Fully machine-written papers (ChatGPT Deep Research) were recognized by Pangram under the strict criterion in 65% of cases, and by Turnitin, GPTZero and Copyleaks in 0%. On its own page of “third-party evaluations,” Pangram cites a softer figure — 97.5%.
  • RAID benchmark. The leaderboard is saturated, but the results are submitted by the detector developers themselves: at 5% false positives and without attacks, Winston AI has 100%, GPTZero 98.4%, and Pangram (2024 model) 99.3%. In a 2024 paper, a homoglyph attack — replacing letters with look-alike characters from other alphabets — lowered Originality’s accuracy from 85% to 9%.

05 · The Arithmetic of False Accusations

Even an accurate detector can produce many false accusations if genuine cases are rare. The formula is simple: share of false accusations among flagged papers = FPR × (1 − p) / [FPR × (1 − p) + TPR × p], where p is the share of papers actually written by AI. Take 1,000 papers, of which 100 were written by AI, and a detector with a 1% false positive rate that catches every machine-written text. It will flag 109 papers, and 9 of them will be human-written — every twelfth accusation. If only one paper in a hundred was produced with AI, half of the accusations will already be false.

OpenAI Classifier, 2023 75.7% 2023 tools, non-native essays 84.7% Originality.ai, Epoch 2026 25.7% any detector with 1% FPR 8.3% GPTZero, Chicago 2025 6.1% Pangram, Epoch upper bound 5.2% Pangram, self-reported 0.04%
Even “1% false positives” means that every twelfth accusation is wrong; for old detectors and non-native speakers, most of them areNeuroDrift calculation: share of false flags = FPR·(1−p) / [FPR·(1−p) + TPR·p] at p = 10% (close to the 11% of papers with ≥20% AI that Turnitin stated in 2024). Inputs: OpenAI (FPR 9%, TPR 26%, 2023); Liang et al., Patterns 2023 (FPR 61.3%, TPR assumed to be 100%); Epoch AI, July 2026 (Originality.ai FPR 3.84%; Pangram 0 of 495 → upper bound 0.6%); Jabarian & Imas 2025 (GPTZero FPR 0.71%); Pangram 4, October 2026 (FPR 0.0041%, TPR 99.66%, self-reported). TPR for the rest: GPTZero 98.63% (Chicago), Originality.ai 99.66% and Pangram 100% (Epoch).

Calculator: how many accusations will be false

Choose a detector or set your own values. The share of false accusations depends not only on how accurate the detector is, but also on how common cheating is in the group.

8.3%
Without JavaScript: with 10% of papers written by AI, an FPR of 1% and a TPR of 100%, one accusation in twelve will be false (8.3%). Out of 1,000 papers, 9 innocent ones are among the 109 flagged.

Blue: texts that really are machine-written among those flagged; orange: human-written texts flagged by mistake.

Non-native speakers fare worst. In 2023, Stanford researchers tested 91 TOEFL essays with seven detectors: on average 61.3% of the essays were judged machine-written, and 97.8% were flagged by at least one detector. Essays by American eighth-graders were classified almost flawlessly. Modern detectors claim the problem has been solved: in October 2026, Pangram reported zero false positives on 15,420 essays by students for whom English is not a native language. But this is self-reported, and we did not find independent tests of that scale.

The consequences are already measurable. Vanderbilt University switched off the Turnitin detector in August 2023, having calculated that 75,000 papers a year at a claimed 1% false positive rate meant ≈750 papers that could be falsely flagged. Washington State University abandoned the same detector in February 2026: in fall 2024, 148,547 papers went through it, and 33% of the AI cases heard by the integrity committee in 2023–2025 ended in a “not guilty” decision, because there was no evidence other than the detector. Australian Catholic University, according to ABC, received ≈6,000 referrals for integrity violations in 2024, ≈90% of them related to AI; the university disputes these figures, but switched off the detector in March 2025. In January 2026, a court in New York reportedly overturned a sanction against an Adelphi University student that had been imposed on the basis of a Turnitin finding of “100% AI.”

Regulators have also started checking the promises. In 2025, the US Federal Trade Commission ordered Workado to stop advertising its detector as “98% accurate”: according to tests by the developers of the model the company took off the shelf, it recognized machine-written texts outside scientific subjects in only 53% of cases. The same company sold a feature that made text “undetectable.”

06 · What a Humanizer Is and Who Uses It

A humanizer is a paraphrasing service. It changes words, syntax, sentence length, the order of arguments and tone to move the text away from the patterns detectors were trained on. Their aim is to change the words and structure of the text. Hidden characters and homoglyphs are known mainly from academic attacks (RAID), and in the TextPulse test no hidden characters were found in any of the services. An audit of 19 services (DAMAGE, January 2025, authors from Pangram) documented typical side effects: meaningless phrases, invented references, dictionary-based word replacement without changing sentence structure, a drop in style to a middle-school level, typos.

The market is large and fast-moving. By OneLittleWeb’s estimate, in September 2026 the 23 humanizers in its selection (excluding Undetectable.ai, QuillBot, HIX Bypass and Walter Writes) together had ≈33m visits a month, 44% more than in August. The largest are Stealthwriter (13.3m; not to be confused with StealthGPT, which has 0.35m) and Humanize AI (12.3m). Undetectable.ai claims more than 24m users and at the same time sells its own detector. The cheapest paid plans of the leading services cost ≈$10–30 a month. According to NBC, Turnitin tracks about 150 such services.

A late-night self-service laundromat: in the glass door of a washing machine, printed pages spin in soapy water; above the machines, wet sheets with blurred letters hang on a rope; a person in a hood waits on a plastic chair; a yellow rubber duck sits on one of the machines

Text can be “laundered” beyond recognition. The question is what is left of the numbers and quotes after the spin cycle.

An ironic detail: on GitHub, one of the most popular open-source “humanizers” for chatbots — the blader/humanizer repository, over 61,000 stars — is built on the Wikipedia page “Signs of AI writing.” The page itself warns: do not treat these signs as problems that need fixing, because that only makes detection harder.

07 · How Much “Success”: Benchmarks With a Conflict of Interest

Both benchmarks exist, and their figures match the published ones. But HumanizerBench is run by WriteHuman, and HumanizerEval, by all appearances, by StealthGPT (it does not disclose this itself): both companies sell services that were tested.

HumanizerEval (October 22, 2026) ran 50 English-language machine-generated texts of 364–997 words through 11 humanizers and six detectors. “Passed” means the detector gave an overall verdict of “human”; mixed verdicts count as a failure. StealthGPT passed Pangram 4.1 in 88% of cases and all six detectors at once in 17 of the 50 texts; Undetectable.ai did so in one text, the rest in none. The benchmark data is published in the StealthGPT-Labs GitHub organization with the description “public StealthGPT benchmark reports”, but the site does not name the organizer and the conflict of interest is not disclosed. The benchmark itself warns that the margin of error for a share out of 50 texts is about ±14 percentage points.

Pangram 4.1 GPTZero Orig. Turbo Orig. 5.0 ZeroGPT Winston 5.0 StealthGPT 88% 92% 92% 34% 84% 92% Undetectable.ai 40% 86% 98% 4% 100% 100% WriteHuman 26% 90% 100% 6% 96% 100% Rephrasy 26% 70% 86% 0% 92% 100% Grubby 10% 68% 100% 0% 96% 100% RewriteAI 2% 54% 98% 0% 90% 94% Phrasly 4% 44% 72% 0% 82% 90% HIX Bypass 0% 6% 66% 0% 92% 100% Humbot 0% 0% 76% 0% 88% 100% BypassGPT 0% 4% 56% 0% 88% 100% Ryne 0% 0% 0% 0% 4% 0% original AI text 0% 0% 0% 0% 2% 0%
HumanizerEval: Winston, ZeroGPT and Originality Turbo miss on average 77–89% of “humanized” texts, Pangram 4.1 — 18%, Originality 5.0 — 4%; the exception is StealthGPT, a product linked to the test’s organizer (88% and 34%)HumanizerEval, “October 2026 Review,” October 22, 2026: 50 English-language machine-generated texts of 364–997 words each; “passed” = the detector’s overall verdict “human”; mixed and uncertain verdicts count as failures. Phrasly — standard mode via API (Ultra was not enabled). The data are published in the StealthGPT-Labs GitHub organization; the organizer is not named on the site, and the conflict of interest is not disclosed. The 95% confidence interval for a share out of 50 texts is about ±14 pp.

HumanizerBench (test of October 1, 2026) openly states that it is run by WriteHuman. Here 14 services were given 30 tasks each, and “passed” means a “human” score of 50% or higher. Against Pangram, Phrasly came first (26 of 30), followed by StealthGPT (22) and WriteHuman (15); Undetectable.ai passed once, and nine services, including Walter Writes, HIX Bypass and Grammarly, not at all. Pangram and GPTZero agreed on the verdict for only 52.6% of texts.

Pangram 4 GPTZero Originality Copyleaks Winston ZeroGPT Phrasly 86.7% 100% 96.7% 100% 96.7% 100% StealthGPT 73.3% 96.7% 100% 100% 90% 96.7% WriteHuman 50% 100% 100% 93.3% 100% 100% Clever AI Humanizer 26.7% 93.3% 100% 96.7% 93.3% 83.3% Undetectable.ai 3.3% 90% 93.3% 90% 100% 93.3% Walter Writes 0% 93.3% 93.3% 86.7% 96.7% 73.3% Humbot 0% 70% 96.7% 93.3% 100% 90% Stealth Writer 0% 43.3% 100% 96.7% 100% 100% HIX Bypass 0% 13.3% 80% 83.3% 96.7% 90% Grammarly 0% 3.3% 50% 60% 76.7% 36.7%
HumanizerBench: Pangram catches 83% of all 420 texts, but misses the leading services (Phrasly, StealthGPT) in 73–87% of cases, and the other detectors miss 83–100% of the top five’s textsHumanizerBench, “Best AI Humanizer for Pangram” and the pages of other detectors, test of October 1, 2026: 30 prompts per service; “passed” = a “human” score of 0.50 or higher. 10 of 14 services shown. The benchmark is run by WriteHuman, which states this openly. Turnitin was not tested.

One service gives opposite results in different tests. Phrasly against Pangram: 4% in HumanizerEval (Pangram 4.1, standard mode, without Ultra), 86.7% in HumanizerBench (Pangram 4, mode not specified) and 100% in Phrasly’s own test (Pangram 4, Ultra mode, 72 texts). Results go stale within weeks: in the StealthGPT-Labs benchmark, the share of WriteHuman passes against Pangram fell from ≈65% in the September 30 report (Pangram 4; value taken from the repository description) to 26% in the October 22 report (Pangram 4.1).

HumanizerEval HumanizerBench Phrasly test 0% 25% 50% 75% 100% Phrasly 4% 86.7% 100% StealthGPT 88% 73.3% 52.8% WriteHuman 26% 50% 8.7% Undetectable.ai 40% 3.3% HIX Bypass 0%
One service, three different answers: a humanizer’s result against Pangram depends on who runs the test — and, probably, on the service mode and the detector versionHumanizerEval (Oct 22, 2026, Pangram 4.1, n = 50; Phrasly — standard mode); HumanizerBench (test of Oct 1, 2026, Pangram 4, n = 30; mode not stated); Phrasly blog “What Pangram detects” (Sep 15, 2026, Pangram 4, n = 69–72; Phrasly Ultra). The organizers of HumanizerBench (WriteHuman) and the Phrasly blog sell the services they tested; HumanizerEval is, judging by the signs, linked to StealthGPT (the StealthGPT-Labs repository, operator not named). Each puts its own service at the top: StealthGPT and Phrasly Ultra are the highest in their own tests, WriteHuman is first by overall score (only third on Pangram).

Despite the conflicts, the benchmarks agree on a few things. Cheap services — HIX Bypass, Humbot, BypassGPT — do not get past Pangram at all. Across all tests, Undetectable.ai passes Pangram 4 and 4.1 in fewer than half of cases. And Winston AI and ZeroGPT let through most texts from almost all services, often 90–100%. In other words, a humanizer’s “success rate” largely measures the weakness of the detector it is compared against.

HumanizerBench (420 texts) HumanizerEval (550 texts) Pangram 82.2 82.9% GPTZero 36.0 53.3% Originality (Turbo) 11.4 23.3% ZeroGPT 14.8 17.1% Winston AI 7.1 11.3%
Both vendor benchmarks agree on one point: Pangram catches over 80% of rewritten texts, while the other popular detectors catch from 7% to 53%HumanizerBench (WriteHuman), October 2026: 14 services × 30 texts; HumanizerEval (StealthGPT-Labs data), Oct 22, 2026: 11 services × 50 texts; the share was calculated by NeuroDrift as 100% minus the average pass rate (HumanizerEval’s mixed and uncertain verdicts count as “detected”). Pangram: version 4 in HumanizerBench, 4.1 in HumanizerEval; Originality: model not stated in HumanizerBench, Turbo in HumanizerEval. The newer Originality 5.0 model missed only 4% of texts in HumanizerEval (not shown: it is absent from HumanizerBench). Copyleaks in HumanizerBench — 13.8%.

Turnitin, the most widespread detector at universities, was not tested in these benchmarks: it has no public API for such a volume. The claim on the HumanizerEval homepage of “≈95% Turnitin bypass” rests on unnamed “independent testing”, although Turnitin was not tested there. Since August 2025 Turnitin has had a separate mode for detecting humanizers, but it has not published its accuracy.

08 · Independent Tests: From 1% to 97%

Studies without a commercial interest are few, and none tested the newest versions of both humanizers and detectors at the same time. But they too show that the result is determined by the pair of versions, the genre and the threshold.

no humanizer after StealthGPT Pangram 0.28 1.3% Originality.ai 0.92 6.2% RoBERTa (open model) 16.4 50.3% GPTZero 1.9 56.8%
In an independent University of Chicago test, the humanizer barely touched Pangram but made GPTZero miss more than half of machine-generated textsJabarian & Imas, “Artificial Writing and Automated Detection,” NBER Working Paper 34223, September 2025 (not peer-reviewed): 1,992 human passages from before 2020 and 1,992 passages each from GPT-4.1, Claude Opus 4, Claude Sonnet 4 and Gemini 2.0 Flash; StealthGPT in its 2025 standard mode (not Super). NeuroDrift averages across 24 “model × genre” combinations from Tables 7 and B.4; the “before” threshold is the Youden-optimal one (Table 7); for “after” (Table B.4) the paper does not state the threshold explicitly.

In a University of Chicago test, after StealthGPT (2025 version) Pangram missed on average 1.3% of machine-generated texts, Originality.ai 6.2% and GPTZero 56.8% (NeuroDrift averages across 24 “model × genre” combinations from the paper’s table). At the ICML 2026 conference, researchers ran 2,000 machine-generated peer reviews of scientific papers through Undetectable AI: Pangram 3.0 labeled 7.2% as human (the rest as machine-generated or mixed), GPTZero did not flag 13.3% as machine-generated, and three open detectors failed to recognize a single one. In the same study, humanizing human reviews that had been edited by AI raised GPTZero’s false positives from 3.0% to 65.6% (for Pangram 3.0, only from 3.0% to 3.6%).

The most unexpected result is in the preprint by Karr et al. (August 2026). On 642 scientific abstracts after Undetectable AI version 11, Pangram 3.2 missed 96.6% of machine-generated abstracts from 2023–2025, and GPTZero 96.1%. Meanwhile, human abstracts edited by the Gemini model with a prompt along the lines of “make it sound more human” (not pure grammar) were flagged as AI by Pangram 3.2 in 64–80% of cases. The authors conclude that honest editing with AI carries a higher risk of punishment than deliberate evasion with a humanizer.

Pangram GPTZero Jabarian & Imas 2025 · StealthGPT 1.3 56.8% Saha et al. 2026 · Undetectable AI 7.2 13.3% Van Vlasselaer 2026 · GPT-4o prompt 7.5 97.5% Russell et al. 2025 · o1-pro prompt 10.0 53.3% Karr et al. 2026 · Undetectable v11 96.1 96.6%
Independent studies do not give a single percentage: Pangram missed from 1% to 97% of “humanized” texts, depending on the service, the detector version and the genreJabarian & Imas, NBER WP 34223 (2025, Pangram API v2025-05); Saha et al., ICML 2026 (arXiv 2603.20450, reviews, Pangram 3.0; “Mixed” counted as detection); Van Vlasselaer et al., IJEI 2026 (40 hybrid papers with ≈44% AI text, a single GPT-4o prompt; “missed” = estimate outside the known range of AI share); Russell, Karpinska, Iyyer, ACL 2025 (30 articles); Karr et al., arXiv 2608.11256 (2026, abstracts from 2023–2025, Pangram 3.2, threshold 0.5). All five rows are Pangram before version 4 (Van Vlasselaer do not state the version): we did not find independent tests of Pangram 4/4.1 against humanizers. Different texts, versions and definitions — comparison across rows is illustrative.

Detector makers contradict one another. Pangram states that its fourth version detects AI in 98.83% of texts after 13 commercial humanizers. GPTZero claims that on rewritten texts it has 93.5% recall, while Pangram v3 has only 50.2%. We did not find independent verification of Pangram 4 or 4.1 against commercial humanizers after July 2026.

09 · The Price of Rewriting: Facts, Quotes, Meaning

A humanizer is judged by whether the text passes a detector. But for publication, what matters more is whether the text remains true. The strictest check was run by TextPulse — a company that itself sells a humanizer, so its results need independent replication. The quality threshold included similarity of meaning, retention of 90% of quotes, no invented numbers or names, and no hidden characters.

passed GPTZero passed and kept facts and quotes Walter Writes 0.0 60.4% Phrasly 2.1 38.3% QuillBot 0.0 22.7% TextPulse 10.4 18.8% Clever Humanizer 0.0 16.7% GPTinf 2.1 14.6% UnAIMyText 0.0 12.5% Grammarly 0.0 0.0%
The best detector bypass had the worst text: Walter Writes’ 60% pass rate fell to zero after numbers, quotes and meaning were checkedTextPulse, “A Controlled Comparison of AI Text Humanizers,” working paper, August 2026 (Zenodo 10.5281/zenodo.22170060): 48 academic texts of ~300 words each, 11 services, from 19 to 48 texts per service; GPTZero API 2026-08-09. Quality threshold: cosine similarity ≥ 0.95, ≥ 90% of quotes, zero invented numbers and names, no hidden characters, length 0.7–1.3 of the original. TextPulse sells its own humanizer and set this threshold itself.

Walter Writes, the best at evading GPTZero (60%), invented on average 4.4 new numbers or names per text of ≈300 words — invented sample sizes, percentages, confidence intervals, authors and institutions. QuillBot retained only 29% of quotes (its responses were cut off at ≈125 words). Grammarly never passed GPTZero, but 85% of its texts were judged fit for use.

HumanizerEval, linked to StealthGPT, also tested factual consistency — it does not disclose its methodology and does not publish the rewritten texts. Even by its own estimate, most services alter facts in a third to three-quarters of texts.

Grubby 76% StealthGPT 68% Ryne 64% Phrasly 50% RewriteAI 40% WriteHuman 38% Rephrasy 32% Undetectable.ai 32% Humbot 30% BypassGPT 24% HIX Bypass 22%
Even by the assessment of a benchmark linked to a vendor, most services alter facts in anywhere from a third to three quarters of textsHumanizerEval, Oct 22, 2026: “factual consistency” check on 50 texts per service; the scoring methodology is not disclosed and the rewritten texts are not published. Orange — services where fewer than a third of texts remained free of factual discrepancies.

HumanizerBench shows the same pattern from the other side: the better a service evades detectors, the less meaning it preserves.

40 60 80 100 60 80 mean bypass score of six detectors, 0–100 meaning retained, 0–100 Phrasly WriteHuman StealthGPT Undetectable.ai HIX Bypass Grammarly
The better a service bypasses detectors, the more it changes the meaning: the bypass leader preserves meaning leastHumanizerBench (run by WriteHuman), October 2026 leaderboard: “bypass” — the average “human” score across six detectors; “meaning” — cosine similarity of embeddings with the original, rescaled to a 0–100 scale. Six services shown, those for which both components are published.

The vendors acknowledge this. According to Phrasly’s own test, StealthGPT introduced on average 3.5 factual changes per text, Undetectable 6.2, WriteHuman 2.6, and Phrasly Ultra itself 0.9. StealthGPT reported that 18% of texts from its new Super model failed an internal factual-consistency check. Scientific integrity researchers described “tortured phrases” as far back as 2021 — a product of paraphrasers that, for example, turned “artificial intelligence” into “counterfeit consciousness”. For an encyclopedic article, a single such number or one invented quote costs more than any detector passed.

10 · Wikipedia: They Check Sources, Not Style

Over 2025–2026, the large Wikipedias moved from advice to bans. English Wikipedia has had a guideline in force since March 2026: using language models to generate or rewrite article text is “strictly prohibited”. The discussion ended 44 to 2. The exceptions are grammar edits to one’s own text with human review, and translation from other language editions. Sanctions require evidence beyond “basic stylistic or linguistic features”. Since August 2025, speedy deletion criterion G15 has been in force. From August 2026 it requires unambiguous signs: a chatbot addressing the user, nonexistent sources (incorrect ISBNs, DOIs that lead to a different article), or technical traces such as “oaicite” and “turn0search0”. German Wikipedia adopted a ban by a vote of 208 to 108 in February 2026. Ukrainian Wikipedia took over the English rules: the guideline “Writing Articles Using LLMs” (a translation of the English one) was approved on May 6, 2026 with the participation of 10 users, and speedy deletion criterion 2.5 appeared in July 2026 (July 30 according to the Meta table; we did not see the discussion). We did not find a separate rule on AI in the policies on paid editing (WP:PAID, conflict of interest, Wikimedia terms of use), but the ban applies to everyone.

Tools have also appeared. LLM Paste Check warns in the visual editor when at least 50 characters with ChatGPT, Claude, Gemini, Copilot or DeepSeek metadata are pasted, and asks the user to explain why the text should be kept. It was enabled on English Wikipedia on September 24, and on all Wikipedias on October 8, 2026. It is not a classifier and not a watermark. There are no official effectiveness figures. By an unofficial count in a community query (Quarry), of 731 warnings shown, 54% ended with saving without a tag — that is, the text was removed or the metadata cleaned. The check is easy to bypass: it does not work in the wikitext editor, and, according to the author of the proposal on the community wishlist, chatbots already recommend exactly that editor to users. Watermarks have so far appeared only in a request for a prototype check via SynthID — and only for Gemini.

Pangram is used selectively on Wikipedia. Wiki Education — an organization that runs student editing programs — runs participants’ edits through it and automatically sends them warnings. At the same time, the organization states directly that it does not regard the result as evidence: only as a signal to check the text more carefully.

0 5 10 15 20 2023 2024 2025 2026 % of pages ≈10% ≈15.5%: spring 2025 peak warnings since fall 2025
After Wiki Education began warning participants automatically, the share of flagged pages fell from ≈15% to ≈10% — and did not decline furtherWiki Education, “Generative AI and Wikipedia: The last six months,” July 14, 2026 (analysis by Salvi and Horta Ribeiro): values read off the chart by NeuroDrift (±0.5 pp); the text says only “a little over 10%” and “a peak in spring 2025.” The unit is the share of pages in which Pangram found any share of AI text, not the share of words. Before the launch of ChatGPT — close to zero. The organization cannot estimate Pangram’s false negatives.

The most valuable figures are from its 2025 report. Pangram flagged 178 of 3,078 new articles by participants (5.8%) and not a single article from before ChatGPT appeared. Half of the organization’s staff spent a month checking them manually.

failed source verification over 2/3% had made-up sources 7%
In the articles Pangram flagged in Wiki Education projects, the main problem is not fabricated sources but real sources that do not support what is writtenWiki Education, “Generative AI and Wikipedia editing: What we learned in 2025,” January 29, 2026: 178 of 3,078 new articles by program participants since 2022 (5.8%) were flagged by Pangram as generated, none before ChatGPT appeared; manual review in summer 2025; “over two thirds” failed source verification, in most of them almost every sentence with a citation.

That is, invented sources are rather the exception: in the Wiki Education sample they appeared in only 7% of the 178 articles, while the rest cited real sources that did not support what was written (more than two-thirds of the articles failed verification). In an interview with IEEE Spectrum, WikiProject AI Cleanup described such citations as “extremely common”. That is why WikiProject AI Cleanup uses Pangram and GPTZero only as “one more data point”, and the page “Signs of AI writing” explicitly advises against relying on detectors alone.

The scale of the phenomenon is hard to measure. In August 2024, researchers (Brooks et al.) flagged more than 5% of new English Wikipedia articles (GPTZero: 5.36%); after subtracting the expected false positives — at least 4.4%. By an estimate that WikiProject AI Cleanup cited to IEEE Spectrum, at the end of 2025 Pangram flagged ≈20% of new articles and drafts, and in early 2026 15–16%; the methodology has not been published.

0 2 4 6 5.4 3.3 English 4.5 1.4 French 2.0 1.1 German 2.9 4.8 Italian % articles (1% FPR cutoff) GPTZero Binoculars
In August 2024, GPTZero flagged ≈5% and Binoculars ≈3% of new articles on English Wikipedia — before ChatGPT appeared, both stayed near 1%Brooks, Eggert, Peskoff, “The Rise of AI-Generated Content in Wikipedia,” WikiNLP 2024 (arXiv 2410.08044): 2,909 new English articles (GPTZero — 156, that is 5.36%; lower bound after subtracting 1% false positives — 4.36%), 3,138 French, 3,907 German, 3,003 Italian. NeuroDrift read the values for the other languages off the chart (±0.3 pp). The Italian Binoculars figure was inflated by one user with 57 translated articles.
0 500 1,000 1,500 355 08.25 375 09 505 10 558 11 585 12 385 01.26 464 02 368 03 340 04 223 05 580 06 856 07 447 08 784 09 1,333 10.26 articles still tagged
Tags marking suspected AI text on English Wikipedia are getting more numerous: October 2026 has 1,333, the most among tags still in place; the month is not over yetCategory “Articles containing suspected AI-generated texts,” as of October 28, 2026 (Wikipedia API): 8,190 pages in total, or 0.11% of 7.26m articles. This is the remainder of articles that still carry the tag, by the month it was placed, not the number of new cases: fixed and deleted articles drop out of the category. October 2026 is not over yet; 32 pages tagged in May–July 2025 are not shown in the chart.

An old library reading room in daytime: a volunteer editor, seen from the side and behind, checks a laptop screen against a thick reference book, keeping a finger on a line of footnotes; around them are stacks of journals with bookmarks, an open card-catalog drawer, a green lamp; a yellow rubber duck among the books

On Wikipedia, what saves or sinks a text is not style but the footnote: whether the source says what the article says.

We discussed why Wikipedia matters for what language models say about a company in “Why ChatGPT Trusts Wikipedia More Than Your Website” and “A Brand Without Wikipedia Is a Company Without a Passport in the LLM Era”, and how AI answers change the traffic of the encyclopedia itself in the briefing “Wikipedia Traffic 2001–2035”.

A practical conclusion follows for professional Wikipedia editing. The quality metric is not whether the text passed a detector, but whether every substantive claim is confirmed by an independent source and whether the policies on AI and paid editing are observed. A humanizer does not help here and may do harm: in tests, some services added invented numbers and quotes — exactly what machine-written articles get caught on.

11 · Ukrainian and the Human Eye

Detectors were trained primarily on English, and for a long time this showed. In the independent MULTITuDE test (2023), GPTZero on Ukrainian barely distinguished machine text, whereas a multilingual detector fine-tuned on 11 languages worked as well in Ukrainian as in English. An interesting detail: a detector trained only on English gave 0.67 on Ukrainian texts, while one trained on Russian gave 0.94; linguistic proximity matters.

GPTZero, 2023 version multilingual detector, tuned on 11 languages English 0.56 0.94 Ukrainian 0.10 0.94 Russian 0.10 0.96 German 0.10 0.91 Spanish 0.10 0.94 Arabic 0.11 0.85 Chinese 0.12 0.77
The 2023 version of GPTZero almost never caught machine-generated text in Ukrainian; a multilingual detector fine-tuned on 11 languages recognizes Ukrainian as well as EnglishMacko et al., MULTITuDE (arXiv 2310.13606, 2023): 74,081 texts, 11 languages, 8 LLMs, ~89% of the test set is machine-generated text; macro-F1 ≈ 0.47 corresponds to a detector that always answers “machine.” GPTZero — the 2023 version; the current version, by the vendor’s self-report (October 2025), has 96% recall on Ukrainian. We did not find independent tests of current detectors on Ukrainian.

Modern vendors claim high accuracy in Ukrainian. Pangram reported 99.95% in 2024 (≈2,000 texts per language, machine texts only from GPT-4o); GPTZero reported 96% recall in 2025, the lowest figure among the 21 languages in its table. According to the model card of Pangram 4.1 itself, it falsely flags 0.009% of Ukrainian human texts (the sample size is not given). But we did not find independent tests of modern detectors in Ukrainian. Back-translation as an attack turned out to be weaker for Ukrainian than for English: 14.5% success versus 30.6% for the m2m100 model (for NLLB, 15.4% versus 21.3%) (Macko et al., EMNLP 2024).

In Ukraine, the Ministry of Education and Science (MON) and the Ministry of Digital Transformation issued recommendations on the use of AI in higher education in 2025 (we could not open the text itself). Universities use StrikePlagiarism, which has had an AI-text detection function since 2023, while the Unicheck site now leads to a Turnitin page. We did not find an independent evaluation of these tools on Ukrainian texts. In a small survey of 201 students in Bila Tserkva (autumn 2025), more than 80% said they use AI in their studies, and 88% do not consider assistive use a violation of academic integrity. We did not find mandatory labeling of AI content in Ukrainian legislation. The White Paper of the Ministry of Digital Transformation (June 2024) proposes voluntary labeling tools at the first stage and places mandatory regulation on the model of the AI Act in the second stage.

People without tools recognize machine text worse than it seems. In a 2024 study, experienced teachers correctly identified only 37.8% of essays written by ChatGPT. The exception is people who often write with ChatGPT themselves: five such experts, by majority vote, were wrong on one article out of 300. But individually, each of them falsely accused authors in 1.3–12% of cases.

experienced teachers (n=200) 38% student teachers (n=89) 45% random annotators (n=4) 57% frequent ChatGPT users, mean (n=5) 87% same, majority vote 99% Pangram, same articles 98% GPTZero, same articles 85%
A teacher “by eye” recognizes fewer than half of machine-generated essays; experienced ChatGPT users individually recognize 87% on average, and only a majority vote of five of them reaches the level of the best detectorsFleckenstein et al., Computers & Education: AI 6 (2024) — argumentative essays, teachers; Russell, Karpinska, Iyyer, ACL 2025 — 300 non-fiction articles (GPT-4o, Claude, o1-pro), breakdown by sample base: experts, majority vote and detectors — all 300 articles (five-expert average 86.9%, individually 59–97%); annotators without experience of writing with AI — only the first experiment (60 GPT-4o articles, where experts average 92.7%, and Pangram and GPTZero — 100%). Share of false accusations: ≈52% for non-experts, ≈3–4% for experts (individually 1.3–12%), Pangram 2.0%, GPTZero 0.7%. Different studies and texts.

Stylistic markers move with fashion. At least 13.5% of 2024 PubMed abstracts were processed by LLMs, and the word “delves” appeared 28 times more often than predicted. The frequency of “ChatGPT markers” in arXiv abstracts began to fall from April 2024; the study’s authors explain this by saying that the authors of the texts learned to avoid them. So a word list is the weakest kind of evidence.

delves 28.0× underscores 13.8× showcasing 10.7×
Style markers are not a watermark: “delves” appeared 28 times more often than predicted in 2024, and in arXiv abstracts such words began to thin out from April 2024 — the study’s authors explain this by people starting to avoid themKobak et al., “Delving into LLM-assisted writing in biomedical publications through excess vocabulary,” Science Advances 11(27), 2025: over 15m PubMed abstracts from 2010–2024; the expectation is an extrapolation of 2021–2022; at least 13.5% of 2024 abstracts were processed by LLMs. The decline of “ChatGPT markers” in arXiv abstracts from April 2024 — Geng & Trotta, Findings of ACL 2025.

12 · Rules and Money

Mandatory labeling of text exists in China (from September 1, 2025) and the EU. California’s SB 942 does not cover text.

2025 2026 2027 today China labeling, incl. text since Sep 1, 2025 EU AI Act, Art. 50 machine-readable labeling grace Dec 2, 2026 EU Code of Practice ≈190 signatories drafts shared detector California, SB 942 images, video, audio only text not covered Ukraine MDT White Paper voluntary tools only
Labeling of text has become mandatory in China and the EU, but not in California; Ukraine so far limits itself to voluntary toolsChina’s measures for labeling synthetic content (CAC) and standard GB 45438-2025 — from September 1, 2025; EU Regulation 2024/1689, Art. 50(2) — from August 2, 2026, deferred to December 2, 2026 for systems already on the market (Digital Omnibus, OJ July 24, 2026); Code of Practice on transparency of generated content — final June 10, 2026, ≈190 signatories, a shared solution for checking watermarks — by February 2, 2027 (per analyses by CSA and DLA Piper); California SB 942 / AB 853 — from August 2, 2026, excluding text; Ukraine’s Ministry of Digital Transformation (MDT) — White Paper on AI regulation (June 2024). Dashed — a transition period or soft instruments.

Article 50(2) of the AI Act obliges providers of systems that generate text, images, audio, or video to mark the output in a machine-readable format so that it can be detected. The obligation does not apply when the system merely assists with standard editing or does not substantially change the input text. Article 50(4) requires those who publish generated text to inform the public on matters of public importance to disclose this, except where the text has undergone human review or editorial control and a specific person or organization is responsible for the publication. The fine is up to €15m or 3% of worldwide turnover, whichever is higher. We did not find a ban on users removing the watermark in Article 50: the obligation lies with providers. For systems that were on the market before August 2, 2026, labeling was postponed under the Digital Omnibus package to December 2, 2026. The Code of Practice on the transparency of generated content, the final version of which was published on June 10, was signed by about 190 organizations by the end of July, including OpenAI, Anthropic, Google, Meta, and Mistral.

The money made in detection is noticeable but not huge. In July 2026, Pangram raised $9m in a Series A led by Menlo Ventures (≈$13–14m in total); it is integrated into Substack and costs $20 a month. GPTZero raised $10m in 2024; Sacra estimates its annual recurring revenue (ARR) at the end of 2025 at $24m. Turnitin is owned by Advance Publications, which bought it in 2019 for $1.75bn; by March 2024 the detector had checked more than 200m papers and found at least 20% AI text in ≈11% of them. Grand View Research estimates the detector market at $750m in 2026; this is the estimate of a single analytics company with an unverified methodology.

13 · Method map

Below are 16 detection and bypass methods with their status as of October 2026: what already works in products, what is available in limited form, and what exists only in research papers.

Methods map: what already works and what exists only in papers

Filter by status and type. Status as of October 2026.

works in productsClassifiers · 2023
GPTZero

A classifier for education, 20+ languages.

Chicago 2025: after StealthGPT it missed 56.8% of machine-written texts; on RAID (5% false positives), 97.2% accuracy in 2025.

works in productsClassifiers · 2023
Turnitin AI + bypass detection

A detector inside the plagiarism-checking system; since August 2025 there has also been a separate “AI bypasser detection”.

Claimed <1% false positives on documents with ≥20% AI. The company has not published the accuracy of bypass detection.

works in productsEvasion · 2023
Commercial humanizers

StealthGPT, Undetectable.ai, Phrasly, WriteHuman and others: rewrite text to get past detectors; the cheapest paid plans are ≈$10–30 a month.

Against Pangram in vendor tests: from 0% to 100% pass rates; the strictest quality test (its threshold was designed by TextPulse, which sells its own humanizer and scores best on it): 0–10% of texts without damage to facts.

works in productsWatermarks · 2024
SynthID-Text (Google)

A statistical watermark in Gemini texts; the code is open-sourced in Hugging Face Transformers.

Nature, 2024: ~20m responses with no difference in user ratings (0.01–0.02 pp). The detector sees only Google’s watermark; we did not find a public text detector (the SynthID Detector portal in 2025 was waitlist-only).

works in productsMetadata & process · 2025
Grammarly Authorship

A record of the writing process: what was typed, what was generated, what was pasted.

Evidence of process, not an assessment of the finished text; Curtin University replaced the Turnitin detector with it from 2026.

works in productsClassifiers · 2026
Pangram 4 / 4.1

A linguistic-profile classifier with a separate “humanized” label; integrated into Substack and used by Wiki Education.

Pangram 4 self-report: 0.0041% false positives on 2m texts (4.1: 0.0090% on the English-language FineWeb set). We did not find independent tests of 4/4.1; tests of earlier versions showed it missing between 1% and 97% of humanized texts.

works in productsMetadata & process · 2026
LLM Paste Check (Wikipedia)

A warning in the visual editor when pasted text carries metadata from ChatGPT, Claude, Gemini, Copilot or DeepSeek.

English Wikipedia: Sep 24, 2026; all Wikipedias: Oct 8, 2026. Not a classifier and not a watermark; does not work in the wikitext editor.

limited accessWatermarks · 2026
Claude watermark (Anthropic)

A variant of SynthID-Text in new Claude models; the watermark applies globally, not only in the EU.

Anthropic page, Aug 14, 2026: verification is through a private API for regulators, media and researchers; rewriting every word in full destroys the watermark.

limited accessWatermarks · 2026
textGrain (OpenAI)

A watermark in ChatGPT and Codex for EU users; in the API, at the customer’s option.

92% detection when unmodified, 66% after 10% of words are replaced, 17% after 25% (company test, 400 tokens). The detector is available only to approved organizations.

pilot / standard in developmentMetadata & process · 2025
C2PA for plain text

A signed manifest hidden in invisible Unicode characters inside the text.

Specification 2.3–2.4: “under review”; invisible characters disappear when the text is cleaned.

lab onlyWatermarks · 2023
Green list (Kirchenbauer)

An academic watermark: the model picks words from an “allowed” list more often.

After human paraphrasing it is detected on average at 800 tokens (ICLR 2024); recursive paraphrasing lowers detection from 99.3% to 9.7%.

lab onlyMetadata & process · 2023
Search over stored responses

The provider stores all responses and searches for ones similar to the text being checked.

Finds 80–97% of paraphrases among 15m generations (NeurIPS 2023), but requires storing all responses.

lab onlyEvasion · 2023
Paraphrasing with a language model (DIPPER)

A separate model rewrites the text while preserving its meaning.

DetectGPT: detection falls from 70.3% to 4.6%; watermark: from 100% to 57.2% (NeurIPS 2023).

lab onlyEvasion · 2024
Watermark stealing

From a model’s responses, the watermark rule is reconstructed in order to forge or erase it.

Over 80% success for less than $50 in queries (ICML 2024), for academic schemes, not for SynthID or textGrain.

lab onlyEvasion · 2025
Evasion training with reinforcement learning

A small model learns to rewrite text, rewarded through the detectors’ APIs.

AuthorMist: 78.6–96.2% success against GPTZero, Winston, Originality at content similarity >0.94 (preprint; Pangram was not tested).

discontinuedClassifiers · 2023
OpenAI AI Text Classifier

OpenAI’s first detector.

Caught 26% of machine-written texts and wrongly flagged 9% of human-written ones; discontinued on Jul 20, 2023 “due to its low rate of accuracy”.

14 · What this means for you

What this means for you

Choose a role to see what to rely on, what to avoid, and what changed in 2026.

An instructor who received a “90% AI” score in a report
What to rely on

The detector is a reason for a conversation, not proof. Compare with the student’s earlier work, ask for drafts and version history, and ask them to explain their reasoning orally.

What not to do

Do not punish on a percentage alone: at WSU a third of AI cases ended with the student cleared precisely because there was no other evidence. Be especially careful with non-native speakers and short texts.

What changed

Universities (Vanderbilt, Waterloo, Curtin, WSU) are switching off the Turnitin detector; a New York state court overturned a sanction imposed on the basis of a “100% AI” Turnitin result as unfounded (Newby v. Adelphi, 2026; the court assessed the procedure, not the detector’s accuracy).

Before deciding: check whether your institution has an appeals procedure and what exactly its AI policy says.

A Wikipedia editor, including a paid one
What to rely on

Every substantive claim needs an independent source that actually supports it. LLMs must not be used to create or rewrite article text (English guideline since March 2026, Ukrainian since May).

What not to do

Do not count on a humanizer: what gets checked is sources, not style. Of the articles from Wiki Education programs flagged by Pangram, more than two-thirds failed precisely the source check. A humanizer may also fail to remove an invisible watermark.

What changed

LLM Paste Check in the visual editor (all Wikipedias from Oct 8, 2026), speedy deletion criterion G15 (English) and 2.5 (Ukrainian), more than 8,000 articles tagged “possibly AI-generated text”.

Paid editing: the disclosure rules (WP:PAID) do not mention AI, but the LLM ban applies to everyone.

An author writing in a non-native language
What to rely on

Keep your drafts and version history: this is the best proof of authorship. English Wikipedia allows grammar correction of your own text if a person has checked the result.

What not to do

Do not run your own text through a humanizer “just in case”: quality drops, and in the Karr et al. preprint (Pangram 3.2) AI rewriting on the prompt “make the text more human” was flagged more often (64–80%) than text after a humanizer (<4%).

What changed

Modern detectors claim near-zero false positives on non-native essays (Pangram: 0 of 15,420), but this is self-reported; there are no large independent tests.

If you have been accused: ask which detector, version and threshold were used, and provide your drafts.

A newsroom, publisher or content team
What to rely on

Invest in fact-checking, source-checking and editorial responsibility. Under Art. 50(4) of the AI Act, AI-generated text on matters of public interest must be labeled unless it has been reviewed by an editorial team that bears responsibility.

What not to do

Do not build a process around one detector’s score: the same humanizer passes Pangram in 4% or 87% of tests depending on who is measuring, and versions change every month.

What changed

From Aug 2, 2026, model providers in the EU must mark generated text (for systems already on the market, from Dec 2, 2026); Google has added watermarks (SynthID) since 2024, while Anthropic (August 2026) and OpenAI (October 2026) have announced their own and are gradually rolling them out.

Penalty for violating Art. 50: up to €15m or 3% of worldwide turnover.

A student who is being advised to use a humanizer
What to rely on

Find out your course’s AI policy and disclose use where it is allowed. Write in a document with version history.

What not to do

A paid humanizer does not guarantee a result: in independent tests, Pangram before version 4 missed from 1% to 97% of rewritten texts depending on the humanizer, version and genre, and the text often loses numbers and quotations.

What changed

Turnitin tracks about 150 humanizers and since 2025 has had a separate mode for detecting them; the accuracy of this mode has not been published.

The consequences of cheating are determined by the institution, not the detector: check the academic integrity policy.

15 · What’s next

What follows are NeuroDrift’s analytical scenarios, not forecasts from the sources.

  • December 2026 – February 2027. On December 2, the grace period for labeling in the EU ends — for systems that were on the market before August 2, 2026. By February 2, 2027, signatories of the Code of Practice are to create a joint solution for verifying watermarks — according to lawyers’ analyses, this is the date from the Code. If such a solution starts working, newsrooms and universities will for the first time be able to check the watermarks of several providers in one place.
  • The race continues. Humanizers are appearing that are trained to evade detection directly on detector outputs: in one preprint, AuthorMist bypassed GPTZero, Winston and Originality in 78.6–96.2% of cases. Detectors respond by adding separate “humanized” labels. Any percentage in this article should be treated as a snapshot on the date of the test.
  • A combination of signals. The most likely direction (our estimate) is a combination of watermarks for closed models, classifiers for open ones and evidence of the writing process: version histories, drafts, edit logs. Wikipedia is already moving this way: paste metadata, edit filters and manual source checking.
  • Independent tests. The biggest gap is the absence of an independent, regular and open comparison in which neither the organizer nor the sponsor sells any of the tested products. Until there is one, every “humanizer ranking” should be read together with the name of whoever runs it.

Honesty and limitations

The strongest argument for detectors. Independent tests by the University of Chicago, Epoch AI and VUB showed that modern classifiers, above all Pangram, almost never err on human texts written before ChatGPT appeared. In one study, five human experts who often write with AI, by majority vote, recognized machine text almost flawlessly (individually they falsely accused authors in 1.3–12% of cases), so the signal is real. Vendor humanizer rankings themselves show that most services do not work against Pangram.

The strongest argument against. Few false positives on “clean” texts from before 2022 is not the same as few false accusations in real life. There, texts are edited with Grammarly, translated, written by non-native speakers, and the share of genuine cases is unknown. A preprint by Karr et al. (Pangram 3.2) showed that having a model edit abstracts with a prompt such as “make it sound more human” gets flagged more often than bypassing with the Undetectable AI humanizer. Most figures on the accuracy of current versions come from those who sell detectors or humanizers.

Limitations of this review. We did not run our own experiments with detectors or humanizers. OpenAI pages are not available for automated reading, so the textGrain figures were cross-checked against four publications rather than the primary source. Some values (the Wiki Education and Brooks charts, among others) were read off published images with an error of ±0.3–0.5 pp. The court ruling in the Adelphi case is known from secondary sources. We did not find independent tests of Pangram 4/4.1 against commercial humanizers, or of any modern detectors in Ukrainian. “We did not find” here means exactly that, not “does not exist.”

Sources

Frequently asked

Can a humanizer be guaranteed to bypass Pangram?

No. In the October 2026 benchmarks, the same service, Phrasly, passed Pangram on 4% of texts in one test and 86.7% in another, while cheap services such as HIX Bypass or Humbot passed on 0%. In independent studies Pangram missed from 1% to 97% of rewritten texts, depending on the version of the service and the detector. Results go stale within weeks: in one benchmark, WriteHuman’s pass rate fell from ≈65% to 26% in three weeks.

Does a humanizer remove the invisible ChatGPT or Claude watermark?

Unknown: we did not find public tests of commercial humanizers against OpenAI’s textGrain or Claude watermarks. According to OpenAI’s test, replacing 25% of words with synonyms lowers watermark detection from 92% to 17%. Anthropic writes that light edits are unlikely to remove the mark, while rewriting every word will; a translation done by Claude itself preserves the mark. Passing the Pangram detector says nothing about the watermark — these are different signals.

Can a student or author be punished solely on a detector’s conclusion?

This is risky. Even a detector with a 1% false positive rate that catches every machine-written text, when 10% of cases are genuine, makes every twelfth accusation false. At Washington State University, a third of AI cases in 2023–2025 ended in acquittal because the detector was the only evidence, and the university dropped the Turnitin detector. English Wikipedia explicitly requires, for sanctions, evidence beyond stylistic or linguistic features.

How does Wikipedia detect AI-generated text?

Through a combination: LLM Paste Check warns when pasted text carries ChatGPT, Claude, Gemini, Copilot or DeepSeek metadata (from October 8, 2026, in all Wikipedias); edit filters catch technical traces such as “oaicite”; criterion G15 allows speedy deletion of pages with obvious signs. Wiki Education checks the edits of participants in its programs through Pangram but regards this only as a signal. The decisive check is whether the sources support what is written.

Do AI detectors work in Ukrainian?

Modern ones do, according to their makers: Pangram reported 99.95% accuracy on Ukrainian texts in 2024, and GPTZero reported 96% recall in 2025. But we did not find independent tests of modern detectors in Ukrainian. In an independent 2023 test, GPTZero in Ukrainian barely distinguished machine text (macro-F1 0.10 versus 0.56 in English), while a fine-tuned multilingual detector reached 0.94.

Comments

Signed-in readers only — to keep it human, not a bot swamp.