Matt Butts, Head of Marketing Science at Samsung Ads Europe, joins That’s What I Call Marketing to discuss marketing science, incrementality, connected TV measurement and why rigorous testing matters more than a positive result. This episode explains how marketers can move beyond convenient metrics, design better experiments and connect advertising activity to meaningful business outcomes. Matt also explores how changing television behaviours are reshaping media planning, audience measurement and the role of connected TV.
In this episode, we cover:
– Why marketers often measure metrics without questioning whether they matter
– The difference between basic A/B testing and genuine incrementality testing
– Why the quality of the test matters more than whether the result is positive
– How marketing scientists translate complex analysis into commercial decisions
– How Samsung Ads measures viewing across linear television, streaming and gaming
– Why reported reach can hide significant audience duplication
– How incremental reach can reduce media waste and identify missed audiences
– The role of connected TV data in advertising planning and measurement
– Why marketers need to communicate measurement differently to CMOs, CFOs and media teams
– How rigorous measurement helped one advertiser move from zero investment to a seven-figure commitment
Matt argues that marketing science should not simply validate decisions that have already been made. Its role is to challenge assumptions, identify what would have happened without the advertising and give marketers evidence they can confidently use to make better investment decisions.
A useful listen for marketers interested in marketing science, advertising effectiveness, connected TV, incrementality, media measurement, experimentation and commercial impact.
Timestamps
01:16 How Matt found his way into marketing science
02:19 How advertising measurement has changed
03:27 Are marketers measuring things without knowing why?
04:27 Why measurement assumptions must be tested continually
05:02 Do marketers know how to test properly?
06:00 The limitations of basic A/B testing
06:17 Why incrementality is the missing part of marketing testing
07:18 The importance of statisticians, data scientists and translation
08:13 Matt’s journey to Samsung Ads
08:18 What Samsung Ads does
09:00 How television viewing behaviour has changed
10:18 Balancing audience precision, relevance and scale
11:02 Relevance without intrusive personalisation
12:19 Samsung Ads’ Total View measurement capability
12:36 Audience duplication, incremental reach and missed audiences
13:40 Why platform reach figures can be misleading
14:06 What a Head of Marketing Science actually does
14:40 Building advertiser-specific measurement playbooks
15:16 Using measurement to improve future advertising investment
15:23 How to explain incrementality to senior business leaders
15:41 Why marketers need to understand marketing science
17:00 How measurement feeds into marketing mix models
17:33 A real example of fixing incomplete advertising data
19:00 How a geo test led to a seven-figure investment
19:43 Why negative test results should not frighten marketers
20:40 Combining scientific rigour with commercial thinking
21:51 What comes next for connected TV measurement
22:00 Connecting television and mobile data
23:30 Why marketing measurement must keep pace with human behaviour
That’s What I Call Marketing is the podcast for marketers who care about brand, B2B, creativity, effectiveness and the future of the profession.
Follow the show for more conversations with CMOs, marketing leaders, agency leaders, professors, authors, thinkers and practitioners.
Find more episodes at: https://www.thatswhaticallmarketing.com
Thanks to the Digital Voice for their partnership https://www.thedigitalvoice.co.uk/
","author_name":"Conor Byrne"}