BigTech CompaniesBusinessDigital MarketingNewswireTechnology

Why Marketing Mix Modeling Remains a Challenge

▼ Summary

– Open-source MMM platforms like Robyn, Meridian, and PyMC-Marketing have eliminated high consulting costs, but still require significant domain expertise to produce trustworthy results.
– Data access is the most common implementation blocker, requiring two to three years of consistent weekly data across channels and a lengthy data archaeology process.
– AI assistants can help with scripting but cannot navigate critical judgment calls, such as selecting model solutions or configuring adstock parameters.
– Human expertise is essential for encoding business context, including channel carryover, saturation curves, anomaly handling, and interpreting results.
– A practical first step is to experiment with Robyn’s demo script and sample data before applying MMM to your own data.

Marketing mix modeling is more accessible than ever before, yet most teams still struggle to move from interest to implementation. After multiple discussions with marketing leaders exploring MMM, the same refrain emerged: “We believe in the concept, but we don’t know how to start.”

The reality is that viable open-source MMM platforms have dramatically lowered the financial barrier to entry. They have not, however, lowered the level of expertise required to produce results that are both trustworthy and actionable.

Open-source MMM has shifted the starting line

Adoption is accelerating fast. Nearly half (46.9%) of U. S. marketers plan to increase MMM investment over the next year, and they ranked MMM as the most reliable measurement methodology (27.6%). The open-source revolution is real, with three production-grade libraries now covering the full methodological spectrum.

Robyn (Meta, R) offers automated hyperparameter search via Nevergrad, Pareto frontier model selection, and built-in decomposition and response curve plots. It is the most approachable entry point and highly customizable , the one I use most. Meridian (Google, Python/TensorFlow) provides Bayesian inference with geo-level priors and principled uncertainty quantification. It is more rigorous but comes with a steeper learning curve. PyMC-Marketing (PyMC Labs, Python) is the most flexible option, offering a full probabilistic model closest to academic-grade Bayesian MMM , but it demands the most statistical fluency.

This generation of tools has eliminated the $150,000 to $500,000 consulting gate that was once the only path into MMM. Any team with R or Python expertise and relatively clean historical data can now run a model in-house.

The critical caveat is this: “Free tool” does not mean “free model.” The software is free. The domain expertise required to configure it correctly , a hugely important part of the process , is not.

A crowded vendor landscape with an interesting power dynamic

The SaaS layer built on top of open-source MMM has proliferated quickly. It helps to distinguish a few tiers.

Data-layer-first vendors like Rockerbox and Northbeam started as attribution and data collection platforms, then added MMM. Their edge is data pipelines and speed, not modeling depth or customization. Measurement-first vendors like Measured, Analytic Partners, Ekimetrics, and Nielsen Gracenote offer more rigorous modeling at a higher price point, with enterprise-grade capabilities.

One point deserves attention. Google’s open-sourcing of Meridian was a generous contribution to the field and, simultaneously, a strategic one. When a walled garden funds and packages the measurement methodology used to evaluate its own channels, it is worth maintaining healthy skepticism about model priors and default assumptions, even with transparent code. The practical question when evaluating vendors is: who owns your data layer, and does that create conflicts in the modeling layer?

Challenge 1: Data access is the silent MMM killer

This is the most underappreciated implementation blocker. A well-specified MMM needs two to three years of weekly data as a baseline , enough to capture at least two full seasonality cycles and a meaningful range of spend variation. It requires consistent channel-level spend granularity, not just “digital,” but search, social, display, and video broken out separately. Offline channels like TV, OOH, radio, events, and direct mail typically live in different systems, owned by different teams, and often use incompatible time granularities. External covariates such as macro indicators, competitor activity, pricing data, and product launch calendars are also essential.

For B2B specifically, longer sales cycles and lower conversion volumes make the data requirements even more demanding. You often need more history. In practice, what blocks most MMM projects is the six-week data archaeology exercise that precedes model building. Finance owns revenue. The brand team owns TV. The agency owns digital spend. The spreadsheet someone built in 2021 is the only record of trade promotions. The model is only as good as the data archaeology that precedes it, and nobody tells you that in the vendor demo.

Challenge 2: You still need to roll up your sleeves

AI assistants have meaningfully lowered the syntax barrier. They can scaffold a Robyn run, generate a Meridian config, or help debug a PyMC model. What they cannot yet do is navigate the judgment calls that make an MMM trustworthy. You must choose where to sit on a Pareto frontier of hundreds of model solutions, balancing NRMSE and DECOMP. RSSD tradeoffs. You need to know when Nevergrad’s optimizer has meaningfully converged versus landed in a local minimum. You must configure adstock transformation parameters such as Weibull shape and scale or geometric decay to match realistic channel dynamics. And you must diagnose why a model assigns an implausible contribution to a channel, and decide whether to address it with a prior, a data correction, or a variable exclusion.

In other words, vibe coding your way to an MMM will produce a model that appears to work but is wrong in ways you will not catch. The scripting is not the hard part. The domain expertise required to validate the output includes running channel-specific incrementality experiments to calibrate your MMM.

Challenge 3: The human expertise layer is not optional

Even when the tooling matures to the point where AI can run a competent default MMM, the irreplaceable human contribution is encoding business context , things no model can infer from the data alone. Your TV buy has a four-week carryover. Your paid search has a three-day carryover. Your branded awareness campaign has a decay that spans months. This information is not found in the data. It is in the minds of the channel experts. You also need to know when a channel is likely approaching diminishing returns before the model tells you so, and question the results when the model suggests otherwise. Factors like COVID troughs, product launches, pricing shifts, and macro disruptions need to be modeled explicitly or flagged as structural breaks. AI does not know your client had a pricing crisis in Q3 2022. A modeled TV contribution of 40% for a brand spending $2 million on TV may “feel wrong” and warrant investigation. That intuition is earned, not computed. Finally, the most technically correct model is worthless if you cannot explain why it recommends shifting 15% of the search budget to CTV in terms a CMO and CFO will act on.

Lay the groundwork before you build a model

The best place to begin is understanding what data you need to fuel the model and who needs to help contextualize and translate that data into effective marketing decisions. Neither is easy or fast, but both are essential if you want to get meaningful insights from your model, regardless of whether you choose an open-source or subscription-based platform. A practical first step is to download Robyn’s demo script and experiment with the sample data before applying it to your own.

(Source: Search Engine Land)

Topics

mmm adoption 95% open source mmm 93% data access challenges 90% domain expertise 88% vendor landscape 86% model validation 84% adstock and carryover 82% saturation curves 80% bayesian mmm 78% data granularity 76%