Artificial IntelligenceBigTech CompaniesNewswireQuick ReadsTechnology

Meta’s ex-news chief Campbell Brown on who controls AI narratives

▼ Summary

– Campbell Brown’s company, Forum AI, evaluates foundation model performance on complex “high-stakes topics” like geopolitics and mental health.
– Forum AI uses world-class experts to architect benchmarks and trains AI judges to reach roughly 90% consensus with those human experts.
– Brown founded Forum AI after realizing ChatGPT would become the primary information funnel and that accuracy was not a priority for AI companies.
– Evaluations of leading models revealed left-leaning political bias and failures like missing context and straw-manning arguments.
– Brown believes enterprise demand for liability management, not idealism, will drive AI to optimize for truth and accuracy.

Campbell Brown has spent her career chasing accurate information, first as a renowned TV journalist, then as Facebook’s first and only dedicated news chief. Now, watching AI reshape how people consume information, she sees history threatening to repeat itself. This time, she’s not waiting for someone else to fix it.

Her company, Forum AI, evaluates how foundation models perform on what she calls “high-stakes topics” , geopolitics, mental health, finance, and hiring. These are subjects where “there are no clear yes-or-no answers, where it’s murky and nuanced and complex,” she explained recently at a StrictlyVC evening in San Francisco with TechCrunch’s Tim Fernholz.

The approach is straightforward: find the world’s foremost experts, have them design benchmarks, and then train AI judges to evaluate models at scale. For geopolitics, Brown has recruited a heavyweight panel including Niall Ferguson, Fareed Zakaria, former Secretary of State Tony Blinken, former House Speaker Kevin McCarthy, and Anne Neuberger, who led cybersecurity in the Obama administration. The goal is to get AI judges to roughly 90% consensus with those human experts , a threshold she says Forum AI has already reached.

Brown traces the origin of Forum AI, founded 17 months ago in New York, to a specific moment. “I was at Meta when ChatGPT was first released publicly,” she recalled. “I remember really shortly after realizing this is going to be the funnel through which all information flows. And it’s not very good.” The implications for her own children made the moment feel almost existential. “My kids are going to be really dumb if we don’t figure out how to fix this,” she thought.

What frustrated her most was that accuracy didn’t seem to be anyone’s priority. Foundation model companies, she said, are “extremely focused on coding and math,” whereas news and information are harder. But harder, she argued, doesn’t mean optional.

When Forum AI began evaluating the leading models, the findings weren’t encouraging. She cited Gemini pulling from Chinese Communist Party websites “for stories that have nothing to do with China,” and noted a left-leaning political bias across nearly all models. Subtler failures abound too, she said, including missing context, missing perspectives, and straw-manning arguments without acknowledgment. “There’s a long way to go,” she said. “But I also think that there are some very easy fixes that would vastly improve the outcomes.”

Brown spent years at Facebook watching what happens when a platform optimizes for the wrong thing. “We failed at a lot of the things we tried,” she told Fernholz. The fact-checking program she built no longer exists. The lesson, even if social media has turned a blind eye to it, is that optimizing for engagement has been lousy for society and left many less informed.

Her hope is that AI can break that cycle. “Right now it could go either way,” she said. Companies could give users what they want, or they could “give people what’s real and what’s honest and what’s truthful.” She acknowledged the idealistic version , AI optimizing for truth , might sound naive. But she thinks enterprise may be the unlikely ally here. Businesses using AI for credit decisions, lending, insurance, and hiring care about liability, and “they’re going to want you to optimize for getting it right.”

That enterprise demand is also what Forum AI is betting its business on, though turning compliance interest into consistent revenue remains a challenge. Much of the current market is still satisfied with checkbox audits and standardized benchmarks that Brown considers inadequate.

The compliance landscape, she said, is “a joke.” When New York City passed the first hiring bias law requiring AI audits, the state comptroller found more than half had violations that went undetected. Real evaluation, she said, requires domain expertise to work through not just known scenarios but edge cases that “can get you into trouble that people don’t think about.” And that work takes time. “Smart generalists aren’t going to cut it.”

Brown , whose company last fall raised $3 million led by Lerer Hippeau , is uniquely positioned to describe the disconnect between the AI industry’s self-image and the reality for most users. “You hear from the leaders of the big tech companies, ‘This technology is going to change the world,’ ‘it’s going to put you out of work,’ ‘it’s going to cure cancer,’” she said. “But then to a normal person who’s just using a chatbot to ask basic questions, they’re still getting a lot of slop and wrong answers.”

Trust in AI sits at extraordinarily low levels, and she thinks that skepticism is, in many cases, justified. “The conversation is sort of happening in Silicon Valley around one thing, and a totally different conversation is happening among consumers.”

(Source: TechCrunch)

Topics

ai information accuracy 95% high-stakes topics 90% expert benchmarking 88% ai political bias 85% ai in enterprise 82% ai regulation compliance 80% social media lessons 78% ai truth optimization 75% foundation model gaps 73% ai misinformation risks 70%