Look at this image…
I A/B tested a ChatGPT Studio Ghibli version of me.
Surprisingly, people like my BJUTIFUL face less than GPT’s cartoon 🥲
5.64% CTR vs 4.87% CTR
Is that a lot?
No.
I recently made a 2min change that got me 10x more views
↳ 3.92% CTR vs 6.64% CTR
↳ 2:06 AVD vs 2:27 AVD
DM/reply “DATA”
if you want to see that specific change I made & I’ll send you the screenshot.
Anyways…
For the nerds who care about statistical significance…
This is the AI prompt you can use for your own thumbnails:
Given these two CTRs — [CTR_A]% from [Impressions_A] impressions and [CTR_B]% from [Impressions_B] impressions — tell me how many impressions I need (per variant or total) to detect a statistically significant difference at a 90% confidence level with a two-tailed test.
In my example:
Given these two CTRs — 5.64% from 7467 impressions and 4.87% from 7438 impressions — tell me how many impressions I need per variant to detect a statistically significant difference at a 90% confidence level with a two-tailed test.
The answer: the video needs ±5,000 more impressions in total for it to be statistically significant.
BUT…
Honestly.
I make choices based on results that seem DIRECTIONALLY correct.
In fact
It’s a MUST for small channels
Due to lack of data.
The path to $10M starts with choosing 5.64% over 4.87%.
It starts with split testing everything.
It starts with making assumptions.
It starts with the desire.
Because if I’ve found one thing to be absolutely true
It is this:
My desire to make $200k+ revenue/month,
Was the root reason I made € 224.383,44 revenue in 1 month.
What you truly,
deep down,
desire.
Is what you’ll get,
eventually,
given enough time.
Of course, with obvious exceptions like,
“injuries” for athletes,
DNA for arts,
and so on.
For me… My desire wasn’t revenue.
But I only realized AFTER seeing that this is what I was constantly striving for.
May you see what you’ve been striving for all along.
So, you may stop wasting the limited time you have here on earth,
If it turns out not to be the thing you actually wanted.
PS: Here are 70+ Free tools I use for my videos & social media👇
