Gradually, then suddenly(how to actually measure creative diversity)


Hi Reader -

“How did you go bankrupt?”
“Two ways. Gradually, then suddenly.”

That’s Hemingway. 1926.

Accounts are the same way. Some crash overnight, some bleed out over weeks while you sit there thinking everything’s fine. Same cause either way: staring at the wrong numbers while the whole thing quietly falls apart.

We've come close to the brink on 3 accounts. Each time, the warning signs were there for weeks. Each time, we nearly missed them.

The overnight crash. Account cruising at $10k/day with one ad doing all the heavy lifting. Dashboard looked beautiful. Then it slipped - and when one ad carries everything, “slipped” turns into “on fire” real fast.

The slow bleed. Subscription app where cost per trial was rock solid while ROAS quietly bled out. Dashboard said everything was fine. Dashboard was lying. Took statistical analysis to figure out what was actually happening. Yes, stats. We’re those people now.

The silent killer. Great ad, great metrics, a “winner” by every measure anyone bothers to check. Except downstream retention was garbage. A magnet for users who’d never pay. A win that was slowly poisoning the product.

Different symptoms, same disease: concentration.

And the annoying part is that concentration feels smart. Feels like focus. It’s actually a bomb with a timer you can’t see.

After these 3 near-misses seared into my mind the dangers of concentration in different flavors, I decided we'd make creative diversity a cornerstone of everything we do.

Not because Meta said 'Andromeda' - but creative diversity as insurance against things blowing up. And we track this in our key dashboards(even when, especially when Meta doesnt surface these by themselves) - that is how critical diversity is to everything we do. Here are just a few things we track.

  • Spend freshness. What percentage is going to ads from this month versus three months ago? If everything scaling is old, your pipeline is dead and you don’t know it yet.
  • Format mix. This is how we caught the slow bleed. Statics quietly took over, algorithm found worse users, cost per trial looked fine but the humans were garbage.
  • Message concentration. If one angle is doing 70% of the work, that’s not strategy. It’s a bet with a clock on it.
  • Velocity. No pipeline means concentration creeps back in. And then you’re right back where you started.
  • Placement distribution. Do we have a sufficiently diverse distribution across placements?

...and a LOT LOT more(below is a small subset of the metrics we track in our internal dashboards).


This is what we're looking at every week while most people are refreshing their ROAS and tweaking bid caps. Different view, different game.

This isn't optional for us. This is the work that actually moves the business forward. Not the sexy stuff: the stuff that keeps accounts alive when things get weird. And things always get weird eventually.

None of this is in ads manager. Unlikely it ever will be: Meta's pushing for automation and concentration, not diversification(notice how Meta reps talk about account consolidation in one breath and creative diversity in the next one? LOL).

Anyway, if you're spending over $50k/mo and want to scale in a way that diversifies your risks and creative, hit reply and say "DASHBOARD". (Or don't. Ads manager will still be there tomorrow).

Later,

Shamanth

PS: From the socials:

𝗡𝗼𝘁𝗲𝗲(AI notetaker) 𝗶𝘀 𝗴𝗲𝗻𝗲𝗿𝗮𝘁𝗶𝗻𝗴 ~𝟴𝟬𝗞 𝗱𝗼𝘄𝗻𝗹𝗼𝗮𝗱𝘀 𝗮𝗻𝗱 ~$𝟯𝟬𝟬𝗞 𝗶𝗻 𝗺𝗼𝗻𝘁𝗵𝗹𝘆 𝗿𝗲𝘃𝗲𝗻𝘂𝗲. I ran semantic analysis on 50 of their video ads.

2013, early advertiser on Facebook install ads.

I scaled an app to $1.5M/month in ad spend.

Everything we know about ChatGPT ads:

"You need to fight creative fatigue" - LinkedIn Bro

Welcome to Intelligent Artifice, your weekly dose of insights to help you win with performance marketing in a Generative AI world.

Intelligent Artifice features hard won insights from the front-lines of performance marketing in a Generative AI world - delivered straight into your inbox. For free.

Read more from Welcome to Intelligent Artifice, your weekly dose of insights to help you win with performance marketing in a Generative AI world.

Hey Reader - Client calls us. ROAS is down. Nobody knows why. Welcome to subscription apps. It's fun here. Here's the thing. You only see trials. That's it. That's what Meta shows you. Whether those trials become paying customers? That data lives in some other system. Shows up days later. Sometimes weeks. So when ROAS tanks, you're staring at a dashboard that's basically shrugging at you. 🤷🏻♂️ But wait. It gets even more fun. Even when that conversion data finally rolls in, you can't just say...

Hey Reader - I've scaled multiple products to $100k/day in ad spend. You know what's funny? All that stuff everyone argues about on Twitter? All those LinkedIn bro 'hacks'? Cost caps vs bid caps. CBO settings. The latest targeting hack. Nobody at $100k/day is having those conversations. They're playing a completely different game. Here's what that game actually looks like. 1. They're always testing the next channel before they need it. Meta and Google are great until they're not. Algorithm...

Hey Reader - 2-year-olds don’t care about 0.2x ROAS. And unfortunately, 0.2x ROAS doesn’t care about 2-year-olds either. Last Saturday morning, my kid had just woken up. Still in bed. Eyes barely open. But he already knew. Saturday morning meant adventure time with Papa. “OUT,” he said. He wasn’t asking. He was ordering me. I was on my laptop. The screen glowed in the quiet room. 0.2x ROAS. Account bleeding. Ads that showed early promise had died. Nothing we tested had staying power. We’d...