False-Positive Calls of Reimplemented Published Analyses for Covert Command-Following on Electroencephalograms Recorded Without Study Commands
How to prepare an accurate paper press kit? Illustrated guide
A. Gorenshtein, Y. Adiniaev, Y. Barash, E. Klang, O. Daniel · DOI: 10.64898/2026.11.03.26367200 · Summary page
Why cover this story this week?
When a consciousness test finds commands that were never given
An EEG signal interpreted as following a command can have profound consequences for an unresponsive patient. But how often would the analysis declare success without any command being issued? Researchers reimplemented published analyses and tested them on command-free recordings, including clinical EEG patients, people with prolonged disorders of consciousness and comatose patients after cardiac arrest. Some procedures produced positive calls far above a 5% benchmark, with rates reaching 27.3% after cardiac arrest.
The problems were not interchangeable: they included mishandling dependence within commands, selecting among analytical configurations and times, and using a permissive threshold. A correction to one analysis, fixed before testing on new patients, sharply reduced false calls while retaining strong detection for imagery-versus-rest sessions. The broader lesson of this preprint is that detecting genuine responses is not enough: a diagnostic claim also needs a measured false-call rate for the complete decision procedure. Even imagery-versus-rest detection may indicate task engagement rather than the requested imagery itself.
Editorial context written by AI from abstracts, not independent scientific validation. The kit and its verified quotes rely on the source paper, not on this letter.
Talk about a paper in public without overstating it: yours, one you are asked to comment on, or one you write about as a journalist.
- Your paper: a draft release for your press office, the questions journalists will ask with what the paper lets you answer, the likely misreadings, a lay summary and a short thread.
- Asked to comment: what the paper shows and does not, its strengths and weaknesses with their passages, and what would settle its main claim.
- Writing about it as a journalist: reporting angles, the wording to check before publication, and the questions to ask the authors.
- For everyone: findings with their passages checked word for word, the novelty set against the closest earlier papers, a hype check, figures with their credit, and researchers for an outside view who have not signed with the authors.