Editor in chief of JAMA+AI since the platform launched in October 2024. Psychiatrist at Massachusetts General Hospital, where he directs the Center for Quantitative Health, holds the Ronald I. Dozoretz Chair, and serves as associate chief for research in psychiatry. Professor of psychiatry at Harvard Medical School. His lab runs machine learning against large clinical databases alongside patient-derived cellular models, and his group reported the first common genetic variant associated with major depressive disorder (Nature Genetics, 2016). He is not a bystander to the subject matter, which is part of why the questions land.
Chief health officer at Google. (The episode bills him as chief clinical officer, the title he held previously; his Google research profile now carries the broader role, which Karen DeSalvo held before she retired.) Pulmonary and critical care physician. Before Google he was chief quality officer at University of Chicago Medicine, with associate professorships at Harvard Medical School and the University of Chicago, and he wrote a textbook on healthcare delivery science. Patient safety and quality is the tradition he names as his own, and it shows in the places where he is most candid.
Roy Perlis asks Michael Howell whether people actually click the links. It is the sharpest question in the interview, it is the one question with a published answer, and Howell answers it three times without giving a number.
That sentence is a criticism of the answer, not of the interview. The interview is good. Perlis edits JAMA+AI, Howell runs clinical strategy at Google, and the conversation runs about twenty minutes across search behavior, model safety, physician error, the future of journals, and career advice. Most interviews of this kind are a press release read aloud by two people. This one is not, because Perlis keeps asking the second question.
What follows is an assessment of coverage and craft. Where a checkable number appears, I checked it. Six of them hold up better than I expected, and one does not hold up at all.
Four of them are worth naming, because an interviewer with a platform relationship to his subject (Google publishes in JAMA, JAMA licenses content to an AI search company) could have skipped all four.
Perlis says the quiet part first and credits himself for it being easier to say from his chair than from Howell's. The framing is correct and underused. Several hundred million health questions a day makes Google the largest single medical reference in human history, and it has no professional body, no formulary committee, and no retraction process.
Where the answer stopsHowell answers with biography (a career in patient safety), volume (several hundred million questions), and process (the rater guidelines are public). Responsibility as a structural question goes unanswered. Nobody asks who is accountable when the summary is wrong.
This is the follow-up the piece is named after, and it lands because Howell had just finished describing links as the safeguard. If people do not follow them, the safeguard is decorative.
Where the answer stopsThree assertions, no figures, and a change of subject to pneumonia. Perlis lets it go. See claim 4 below, where the published numbers are the ones Howell did not supply.
Asked with the affiliation disclosed in the question itself ("wearing my JAMA hat", "what do I tell my boss"), which is the right way to handle it. The self-deprecation buys the question room.
Where the answer stopsHowell points at the JAMA and OpenEvidence agreement, then retreats into analogy (mobile, Mosaic, gopher) and closes with "I'm not smart enough to know what the end state will be." Gracious, and also a way of not saying that Google's summaries are the thing eating the click.
The best-constructed question in the interview. Perlis sets up Howell's two identities, notes the dinosaur skeleton in the Google lobby, and asks him to pick.
Where the answer stopsHowell answers the half he can win (peer-reviewed output) and then reframes the other half as refrigerators. Perlis interrupts to say nobody wants to look things up on their refrigerator, which is the funniest moment in the transcript and also the moment the question dies.
Google has said this publicly since about 2013 and reaffirmed it in 2017 and again recently in the context of AI search. In 2007 the company's figure was 20 to 25 percent, so the number has moved in the direction you would expect as the index matured.
What is missingIt is self-reported, unaudited, and has not budged in thirteen years, which is a long time for a measured quantity to sit on a round number. Google has never published what counts as a query (normalization, spelling variants, voice, Lens) and the denominator is not disclosed. Howell's riff about 52 characters raised to the thirtieth power is fine arithmetic and does not bear on whether the 15 percent is measured or curated.
The order of magnitude is consistent with the other number Google has given out, which is that roughly 7 percent of daily searches are health-related. Against current search volume that arrives at several hundred million, so Howell's figure is internally coherent.
What is missingIt does not reconcile with Google's own headline claim, made by a prior health executive in 2019 and repeated ever since, of more than one billion health questions a day. Both figures are still in circulation and they cannot both be right under the same definition. Neither has a published methodology, and "related to health in some way" is doing an unknown amount of work.
The study exists and the result is real. In the Med-PaLM 2 human evaluation, 15 physicians from the United States, the United Kingdom and India judged 1,066 consumer medical questions with answers blinded and order randomized. Model answers were preferred on eight of nine axes, including better alignment with medical consensus (72.9 percent) and lower likelihood of harm. Only "inclusion of irrelevant content" favored the physicians, and that difference was not significant.
What is missingHowell describes it as error rates. The study measured preference. Those are adjacent, not identical, and the authors flag three reasons the gap flatters the model. Physicians answered consumer questions cold, with no clinical scenario and no communication context. Each produced exactly one answer. Model answers were more than twice as long (median 794 characters against 337.5), which the authors themselves name as a likely driver of preference. This is a writing exercise, not care.
Google did build citations into AI Overviews from the start, and Howell is right that this was a decision made up front rather than bolted on. In May 2026 Google added five more link surfaces.
What is missingThe number. Google has declined to release AI Overview click data for two years, Search Console still does not separate AI Overview clicks from ordinary search clicks, and publishers cannot A/B test the feature. The independent evidence on the volume question runs hard the other way. Pew examined 68,879 searches by 900 US adults in March 2025 and found users clicked a traditional result in 8 percent of visits when a summary was present against 15 percent when it was not, clicked a link inside the summary in 1 percent of visits, and ended the session entirely in 26 percent of visits against 16 percent. A pre-registered randomized experiment on 1,065 Chrome users in early 2026 found that switching the summaries off raised organic clicks 38 percent, dropped zero-click searches from 72 percent to 54 percent, and left satisfaction scores nearly unchanged.
One caveat in Howell's favor, and it matters. Fewer clicks does not logically refute greater variety among the clicks that remain. Diversity is a distribution claim and nobody outside Google has the data to test it. The problem is that this is true by construction: the claim is unfalsifiable from outside, was offered in answer to a question about whether people click at all, and sat next to two other assertions ("people like it", "people ask more questions") whose closest independent test found no satisfaction difference.
Supported, and any hospitalist reading this already believed it. Of 22,889 patients who read an ambulatory note, 21.1 percent reported a mistake and 42.3 percent of those judged it serious. Among the very serious ones, diagnosis (27.5 percent) and medical history (23.9 percent) led. Howell's example (a note advising continued care of the right toe on post-op day three from a below-knee amputation) is the copy-forward failure mode exactly.
What is missingThat study measures patient-perceived mistakes in notes patients chose to read, not an adjudicated error rate across all documentation, so it is the right direction and the wrong instrument for a baseline. The larger issue is rhetorical. Howell answers a question about model safety by moving the comparator to human error, which is a fair and necessary point that also ends the conversation. Human and model errors are not distributed alike and do not fail alike at scale. One bad note harms one patient. One bad summary pattern reaches several hundred million questions a day.
Google does publish seriously in health, including in Nature, JAMA and Lancet, and the volume is plausibly in that range. Pointing an interviewer at the public list is the right instinct.
What is missingThe page Howell names states no total. It mixes blog posts with peer-reviewed citations behind "Load More" buttons, so the figure cannot be checked from the source he offered. The comparative half of the claim is weaker still, attributed only to unnamed "groups that aggregate the impact of companies" on the literature. That is the claim doing the persuasive work and it is the one with no citation.
Also checked, and fine. The search quality rater guidelines are genuinely public and the current edition runs 182 pages, so "I don't know, 170 pages" is honest approximation. The JAMA Network and OpenEvidence did sign a multi-year content agreement in June 2025, though it is a content licensing deal rather than a publishing one. Gopher (1991) and NCSA Mosaic (1993) are correctly placed, with two small slips: gopher was a contemporary of the early web rather than something before the internet, and Mosaic popularized inline images rather than inventing them.
Coverage is the harder test for a twenty minute interview, and this is where the piece is thinnest. Five subjects sit directly under the premise and none of them come up.
- The business model. Search is an advertising product. A conversation about what the world's largest medical reference owes its users never touches what it is paid to do, or what appears above the summary.
- Liability and correction. Journals retract. Formularies get revised. Guidelines carry a version and a date. What is the correction path when an AI Overview gives harmful advice, who initiates it, and is there any public record that it happened?
- The rater guidelines as governance. Howell offers 182 pages of quality criteria as the transparency artifact. Those criteria were written to evaluate websites. Nobody asks how much of that framework governs a generated summary, which has no site, no author, and no expertise signal to rate.
- Who is not searching. The whole conversation assumes a user with a phone, a browser, and English. A patient safety executive is the right person to ask what happens to the summary in Spanish, or at a sixth grade reading level, or for a condition whose literature is thin.
- The regulator. The FDA governs clinical decision support. Consumer medical answers at this scale sit deliberately outside that. Whether they should is the policy question of the decade for health information, and it does not surface once.
The closing question (walk me through a hospital in ten years and tell me how we know you succeeded) is a good one, and Howell's answer is the most human thing he says. He describes the nurse who taps you on the shoulder and asks whether you are sure you want to do that, and hopes AI can be that. Every clinician who has been saved by that tap knows exactly what he means. The tap works because the nurse is standing there, can be wrong, and will be in the room when it turns out badly. That is the hard part, and it is the part the interview never gets to.
Perlis conducts the interview a specialty journal should conduct. He names Google as the world's default medical reference, asks the follow-up, and discloses his own conflict inside the question. What he does not do is press when an answer arrives without a number, and every soft spot in the transcript is at that seam.
Howell is the most credible person Google could put in the chair, and his best material is the material where he gives something up. The physician baseline point is real. The admission that he is not smart enough to know the end state is real. The claim about link diversity is the one that arrives with no number attached, and it is the only one anyone at Google could settle tomorrow.
Sources
The interview: Perlis R, Howell M. "Maintaining Safety and Trust When Patients Engage Google." JAMA+AI Conversations, September 2026. edhub.ama-assn.org
AI Overview click behavior: Pew Research Center. "Google users are less likely to click on links when an AI summary appears in the results." 22 July 2025. pewresearch.org
Randomized field experiment: Agarwal S, Sen A. Indian School of Business and Carnegie Mellon. SSRN working paper, April 2026 (not peer reviewed). Summarized at Search Engine Journal
Google's withheld click data: "Google Adds More AI Search Links, Still No Click Data For SEOs." Search Engine Journal, May 2026. searchenginejournal.com
Model vs physician answers: Singhal K et al. "Toward expert-level medical question answering with large language models." Nature Medicine. nature.com
Documentation error baseline: Bell SK et al. "Frequency and Types of Patient-Reported Errors in Electronic Health Record Ambulatory Care Notes." JAMA Network Open. 2020;3(6):e205867. jamanetwork.com
Rater guidelines: Google General Guidelines, 11 September 2025, 182 pages. guidelines.raterhub.com
The 15% figure: "Google reaffirms 15% of searches are new, never been searched before." Search Engine Land. searchengineland.com
Health question volume: "Google receives more than 1 billion health questions every day." Becker's Hospital Review. beckershospitalreview.com
JAMA and OpenEvidence: "OpenEvidence and the JAMA Network sign strategic content agreement." June 2025. openevidence.com
Google health publications: Google for Health research publications index. health.google
Howell biography and title: Google Research people directory. research.google
Perlis biography: Mass General Brigham researcher profile and the MGH Psychiatry announcement of his JAMA+AI appointment. researchers.mgh.harvard.edu, mghpsychnews.org