What Adam Is Reading
Do People Click Them?
JAMA+AI puts Google's chief clinical officer on the record about being the world's default medical reference. The questions are the right ones. The answers arrive without numbers.
Single-source review · JAMA+AI Conversations podcast · 14 sources · September 2026
The interviewer Roy Perlis, MD, MSc

Editor in chief of JAMA+AI since the platform launched in October 2024. Psychiatrist at Massachusetts General Hospital, where he directs the Center for Quantitative Health, holds the Ronald I. Dozoretz Chair, and serves as associate chief for research in psychiatry. Professor of psychiatry at Harvard Medical School. His lab runs machine learning against large clinical databases alongside patient-derived cellular models, and his group reported the first common genetic variant associated with major depressive disorder (Nature Genetics, 2016). He is not a bystander to the subject matter, which is part of why the questions land.

The interviewee Michael D. Howell, MD, MPH

Chief health officer at Google. (The episode bills him as chief clinical officer, the title he held previously; his Google research profile now carries the broader role, which Karen DeSalvo held before she retired.) Pulmonary and critical care physician. Before Google he was chief quality officer at University of Chicago Medicine, with associate professorships at Harvard Medical School and the University of Chicago, and he wrote a textbook on healthcare delivery science. Patient safety and quality is the tradition he names as his own, and it shows in the places where he is most candid.

Roy Perlis asks Michael Howell whether people actually click the links. It is the sharpest question in the interview, it is the one question with a published answer, and Howell answers it three times without giving a number.

That sentence is a criticism of the answer, not of the interview. The interview is good. Perlis edits JAMA+AI, Howell runs clinical strategy at Google, and the conversation runs about twenty minutes across search behavior, model safety, physician error, the future of journals, and career advice. Most interviews of this kind are a press release read aloud by two people. This one is not, because Perlis keeps asking the second question.

What follows is an assessment of coverage and craft. Where a checkable number appears, I checked it. Six of them hold up better than I expected, and one does not hold up at all.


The questions Perlis actually asked

Four of them are worth naming, because an interviewer with a platform relationship to his subject (Google publishes in JAMA, JAMA licenses content to an AI search company) could have skipped all four.

"Google is de facto the go-to for medical information... How do you think about that responsibility?"

Perlis says the quiet part first and credits himself for it being easier to say from his chair than from Howell's. The framing is correct and underused. Several hundred million health questions a day makes Google the largest single medical reference in human history, and it has no professional body, no formulary committee, and no retraction process.

Where the answer stopsHowell answers with biography (a career in patient safety), volume (several hundred million questions), and process (the rater guidelines are public). Responsibility as a structural question goes unanswered. Nobody asks who is accountable when the summary is wrong.

"So the links are there, but do people click them?"

This is the follow-up the piece is named after, and it lands because Howell had just finished describing links as the safeguard. If people do not follow them, the safeguard is decorative.

Where the answer stopsThree assertions, no figures, and a change of subject to pneumonia. Perlis lets it go. See claim 4 below, where the published numbers are the ones Howell did not supply.

"What do you think happens to medical journals?"

Asked with the affiliation disclosed in the question itself ("wearing my JAMA hat", "what do I tell my boss"), which is the right way to handle it. The self-deprecation buys the question room.

Where the answer stopsHowell points at the JAMA and OpenEvidence agreement, then retreats into analogy (mobile, Mosaic, gopher) and closes with "I'm not smart enough to know what the end state will be." Gracious, and also a way of not saying that Google's summaries are the thing eating the click.

"How do you reconcile [try first] with being trained to be very cautious?"

The best-constructed question in the interview. Perlis sets up Howell's two identities, notes the dinosaur skeleton in the Google lobby, and asks him to pick.

Where the answer stopsHowell answers the half he can win (peer-reviewed output) and then reframes the other half as refrigerators. Perlis interrupts to say nobody wants to look things up on their refrigerator, which is the funniest moment in the transcript and also the moment the question dies.


The checkable claims
1
"15% of what gets typed into the search box every day has never been typed in before"
What holds up

Google has said this publicly since about 2013 and reaffirmed it in 2017 and again recently in the context of AI search. In 2007 the company's figure was 20 to 25 percent, so the number has moved in the direction you would expect as the index matured.

What is missing

It is self-reported, unaudited, and has not budged in thirteen years, which is a long time for a measured quantity to sit on a round number. Google has never published what counts as a query (normalization, spelling variants, voice, Lens) and the denominator is not disclosed. Howell's riff about 52 characters raised to the thirtieth power is fine arithmetic and does not bear on whether the 15 percent is measured or curated.

Solid
2
"Several hundred million questions a day that are related to health in some way"
What holds up

The order of magnitude is consistent with the other number Google has given out, which is that roughly 7 percent of daily searches are health-related. Against current search volume that arrives at several hundred million, so Howell's figure is internally coherent.

What is missing

It does not reconcile with Google's own headline claim, made by a prior health executive in 2019 and repeated ever since, of more than one billion health questions a day. Both figures are still in circulation and they cannot both be right under the same definition. Neither has a published methodology, and "related to health in some way" is doing an unknown amount of work.

Mostly Solid
3
Blinded physicians rated model answers above physician answers on accuracy and likelihood of harm
What holds up

The study exists and the result is real. In the Med-PaLM 2 human evaluation, 15 physicians from the United States, the United Kingdom and India judged 1,066 consumer medical questions with answers blinded and order randomized. Model answers were preferred on eight of nine axes, including better alignment with medical consensus (72.9 percent) and lower likelihood of harm. Only "inclusion of irrelevant content" favored the physicians, and that difference was not significant.

What is missing

Howell describes it as error rates. The study measured preference. Those are adjacent, not identical, and the authors flag three reasons the gap flatters the model. Physicians answered consumer questions cold, with no clinical scenario and no communication context. Each produced exactly one answer. Model answers were more than twice as long (median 794 characters against 337.5), which the authors themselves name as a likely driver of preference. This is a writing exercise, not care.

Mostly Solid
4
"People click on a wider diversity of links than they did when it was just the 10 blue links"
What holds up

Google did build citations into AI Overviews from the start, and Howell is right that this was a decision made up front rather than bolted on. In May 2026 Google added five more link surfaces.

What is missing

The number. Google has declined to release AI Overview click data for two years, Search Console still does not separate AI Overview clicks from ordinary search clicks, and publishers cannot A/B test the feature. The independent evidence on the volume question runs hard the other way. Pew examined 68,879 searches by 900 US adults in March 2025 and found users clicked a traditional result in 8 percent of visits when a summary was present against 15 percent when it was not, clicked a link inside the summary in 1 percent of visits, and ended the session entirely in 26 percent of visits against 16 percent. A pre-registered randomized experiment on 1,065 Chrome users in early 2026 found that switching the summaries off raised organic clicks 38 percent, dropped zero-click searches from 72 percent to 54 percent, and left satisfaction scores nearly unchanged.

One caveat in Howell's favor, and it matters. Fewer clicks does not logically refute greater variety among the clicks that remain. Diversity is a distribution claim and nobody outside Google has the data to test it. The problem is that this is true by construction: the claim is unfalsifiable from outside, was offered in answer to a question about whether people click at all, and sat next to two other assertions ("people like it", "people ask more questions") whose closest independent test found no satisfaction difference.

Embellished
5
Physicians make documentation errors at a meaningful baseline rate
What holds up

Supported, and any hospitalist reading this already believed it. Of 22,889 patients who read an ambulatory note, 21.1 percent reported a mistake and 42.3 percent of those judged it serious. Among the very serious ones, diagnosis (27.5 percent) and medical history (23.9 percent) led. Howell's example (a note advising continued care of the right toe on post-op day three from a below-knee amputation) is the copy-forward failure mode exactly.

What is missing

That study measures patient-perceived mistakes in notes patients chose to read, not an adjudicated error rate across all documentation, so it is the right direction and the wrong instrument for a baseline. The larger issue is rhetorical. Howell answers a question about model safety by moving the comparator to human error, which is a fair and necessary point that also ends the conversation. Human and model errors are not distributed alike and do not fail alike at scale. One bad note harms one patient. One bad summary pattern reaches several hundred million questions a day.

Solid
6
"North of 150, probably closing on 200" health AI publications, comparable to pharma and device companies
What holds up

Google does publish seriously in health, including in Nature, JAMA and Lancet, and the volume is plausibly in that range. Pointing an interviewer at the public list is the right instinct.

What is missing

The page Howell names states no total. It mixes blog posts with peer-reviewed citations behind "Load More" buttons, so the figure cannot be checked from the source he offered. The comparative half of the claim is weaker still, attributed only to unnamed "groups that aggregate the impact of companies" on the literature. That is the claim doing the persuasive work and it is the one with no citation.

Mostly Solid

Also checked, and fine. The search quality rater guidelines are genuinely public and the current edition runs 182 pages, so "I don't know, 170 pages" is honest approximation. The JAMA Network and OpenEvidence did sign a multi-year content agreement in June 2025, though it is a content licensing deal rather than a publishing one. Gopher (1991) and NCSA Mosaic (1993) are correctly placed, with two small slips: gopher was a contemporary of the early web rather than something before the internet, and Mosaic popularized inline images rather than inventing them.


Breadth: what nobody raised

Coverage is the harder test for a twenty minute interview, and this is where the piece is thinnest. Five subjects sit directly under the premise and none of them come up.

The closing question (walk me through a hospital in ten years and tell me how we know you succeeded) is a good one, and Howell's answer is the most human thing he says. He describes the nurse who taps you on the shoulder and asks whether you are sure you want to do that, and hopes AI can be that. Every clinician who has been saved by that tap knows exactly what he means. The tap works because the nurse is standing there, can be wrong, and will be in the room when it turns out badly. That is the hard part, and it is the part the interview never gets to.

So What

Perlis conducts the interview a specialty journal should conduct. He names Google as the world's default medical reference, asks the follow-up, and discloses his own conflict inside the question. What he does not do is press when an answer arrives without a number, and every soft spot in the transcript is at that seam.

Howell is the most credible person Google could put in the chair, and his best material is the material where he gives something up. The physician baseline point is real. The admission that he is not smart enough to know the end state is real. The claim about link diversity is the one that arrives with no number attached, and it is the only one anyone at Google could settle tomorrow.

Assessment of a published podcast transcript. Six empirical claims checked against primary sources: four hold, one is unverifiable as stated, one is contradicted on the part that can be tested. Verdicts reviewed adversarially by two independent models with authorship stripped.

Sources

The interview: Perlis R, Howell M. "Maintaining Safety and Trust When Patients Engage Google." JAMA+AI Conversations, September 2026. edhub.ama-assn.org

AI Overview click behavior: Pew Research Center. "Google users are less likely to click on links when an AI summary appears in the results." 22 July 2025. pewresearch.org

Randomized field experiment: Agarwal S, Sen A. Indian School of Business and Carnegie Mellon. SSRN working paper, April 2026 (not peer reviewed). Summarized at Search Engine Journal

Google's withheld click data: "Google Adds More AI Search Links, Still No Click Data For SEOs." Search Engine Journal, May 2026. searchenginejournal.com

Model vs physician answers: Singhal K et al. "Toward expert-level medical question answering with large language models." Nature Medicine. nature.com

Documentation error baseline: Bell SK et al. "Frequency and Types of Patient-Reported Errors in Electronic Health Record Ambulatory Care Notes." JAMA Network Open. 2020;3(6):e205867. jamanetwork.com

Rater guidelines: Google General Guidelines, 11 September 2025, 182 pages. guidelines.raterhub.com

The 15% figure: "Google reaffirms 15% of searches are new, never been searched before." Search Engine Land. searchengineland.com

Health question volume: "Google receives more than 1 billion health questions every day." Becker's Hospital Review. beckershospitalreview.com

JAMA and OpenEvidence: "OpenEvidence and the JAMA Network sign strategic content agreement." June 2025. openevidence.com

Google health publications: Google for Health research publications index. health.google

Howell biography and title: Google Research people directory. research.google

Perlis biography: Mass General Brigham researcher profile and the MGH Psychiatry announcement of his JAMA+AI appointment. researchers.mgh.harvard.edu, mghpsychnews.org