ALPHA

FAMILIAR VS YOUTUBE AUTO-DUBBING · 50 DUB PAIRS · 5 LANGUAGES · AUGUST 2026

Tested more accurate than YouTube auto-dubbing.

Familiar 01 · THE VOICE +182.9%

Familiar sounds 182.9% more like the real speaker0.399 vs 0.141 speaker resemblance · 31 exactly aligned dubs

Familiar0.399
YouTube0.141
THEIR AUTO-DUB SPEAKS IN A STRANGER'S VOICE
Familiar 02 · THE MEANING −70.3%

Familiar made 70.3% fewer translation errors; changed or lost important ideas43 vs 145 of 528 important source ideas · 50 whole dubs reviewed

YouTube145
Familiar43
CRITICAL MEANING FAILURES: YOUTUBE 12 · FAMILIAR 0
Familiar 03 · THE LAUGHS 0.998

Laughter and reactions keep their shapevs 0.236 shape correlation · 14 event lanes · loudness error 0.11 vs 3.36 dB

Familiar0.998
YouTube0.236
Familiar 04 · THE SCENE

Keeps the music, the ambience, the scene under the dub.

+232.6% more background-sound error · YouTubethe noise bed: music, effects, and room ambience · same clips

YouTube11.21 dB
Familiar3.37 dB
A usable YouTube Auto-Dub existed for 25 of 43 source clips — Familiar dubbed all 43 Frozen cohort · captured August 8, 2026 · complete delivered final audio only

SIX SYNCHRONIZED EXAMPLES · ORIGINAL · FAMILIAR · YOUTUBE AUTO-DUB

Hear the difference

Ali Abdaal

SpanishSource ↗
0:001:00

Ali Abdaal

FrenchSource ↗
0:001:00

Botez Sisters with Will Smith

FrenchSource ↗
0:000:15

Botez Sisters with Will Smith

KoreanSource ↗
0:000:15

Lindsay DeFranco

FrenchSource ↗
0:002:57

Lindsay DeFranco

KoreanSource ↗
0:002:57

FROZEN COHORT · EVERY METRIC WITH ITS OWN ELIGIBLE LANES

Final-audio results: Familiar vs YouTube Auto-Dub

50 SELECTED DUB PAIRS · ARABIC · SPANISH · FRENCH · HINDI · KOREAN

Nine measures, one cohort

Paired within source clip and language; 95% intervals resample source clips.

VOICE IDENTITY · SIM-O 182.9% higher speaker resemblance
Familiar0.399
YouTube0.141
  • SIM-o: source vs dubbed speaker embeddings, eligible turns only
  • higher = the dub still sounds like the same person
31 exactly aligned dubs · 16 paired source clips · paired 95% CI +0.213 to +0.314, excludes zero
SPOKEN MEANING · SOURCE-UNIT REVIEW YouTube: 237% more important source ideas changed or lost
YouTube145
Familiar43
  • 528 important spoken ideas reviewed across all 50 dubs
  • an idea fails only on a major or critical meaning failure
  • paraphrases + tiny reactions never count · CER/WER excluded
YouTube 145/528 (27.5%) · Familiar 43/528 (8.1%) · 70.3% fewer
SPOKEN MEANING · WHOLE-DUB SEVERITY YouTube: 12 critical failures Familiar: 0
YouTube12
Familiar0
  • critical = the review's most severe meaning grade
  • dubs with any important issue: YouTube 34/50 · Familiar 18/50
the same meaning review · 50 whole dubs
MUSIC AND AMBIENCE · SPEECH-FREE SPECTRUM YouTube: 232.6% more background-sound error
YouTube11.21 dB
Familiar3.37 dB
  • spectral error in verified speech-free regions: music, ambience, the scene
  • mean absolute error in dB, lower is better · Familiar 69.9% lower
31 exactly aligned dubs · 16 paired source clips · paired 95% CI −9.44 to −5.09 dB, excludes zero
LAUGHTER AND REACTIONS · EVENT SHAPE 0.998 vs 0.236 laughter/reaction shape correlation
Familiar0.998
YouTube0.236
  • the loudness envelope of each verified laugh or reaction, correlated vs the source
  • 1.0 = rises and falls exactly like the original
14 event-bearing lanes · 7 paired source clips · paired 95% CI +0.24 to +0.89, excludes zero
LAUGHTER AND REACTIONS · EVENT LOUDNESS 0.11 vs 3.36 dB laughter/reaction loudness error
Familiar0.11 dB
YouTube3.36 dB
  • the level miss on the same verified event regions
  • how far each laugh lands from the source level
14 event-bearing lanes · paired 95% CI −6.51 to −1.87 dB, excludes zero
EFFECTS AND BEAT TIMING · ONSET F1 1.000 vs 0.789 transient timing F1
Familiar1.000
YouTube0.789
  • missed + extra sound-effect and beat onsets, balanced as F1
  • Familiar kept every onset · reported descriptive: the interval touches zero
31 exactly aligned dubs · 95% CI 0 to +0.45
VOICE NATURALNESS · UTMOS +0.27 point estimate predicted naturalness (UTMOS)
Familiar2.12
YouTube1.85
  • model-predicted listening score · a diagnostic, not a human study
  • the interval is broad and crosses zero
50 whole dubs · 95% CI −0.19 to +0.61
COVERAGE · AVAILABILITY 43/43 vs 25/43 source clips with a usable dub
Familiar43/43
YouTube25/43
  • a usable YouTube Auto-Dub existed for 25 of 43 catalog source clips · Familiar all 43
  • the other 18 are reported unavailable, never scored as zero
availability is reported on its own; unavailable lanes never enter the scored metrics

METHOD + SOURCES · FROZEN ARTIFACT youtube-autodub-20260808-bb774ab9

How it was measured

PAIRING UNIT One source clip × one target language

Complete delivered final audio from both systems; nothing partial.

ALIGNMENT CONTRACT Same t=0 timeline, verified to 40 ms

Decode, channel conversion, resampling, one constant trim. No time warping, gain changes, denoising, or padding; uncertain lanes fail closed.

COHORTS PER METRIC 50 reviewed · 31 exactly aligned · 14 event-bearing

Each metric uses only its eligible lanes; the 50-lane selection is context, not a universal sample size.

THE SOURCE CLIPS · THE FROZEN 44-CLIP CATALOG · EACH LINK OPENS THE EXACT EXCERPT
#ClipSource + windowLength
01This Woman Made Up A Job!!😂😂Kill Tony ft.Jimmy Carr0:00–0:49 ↗49s
02Ali Abdaal - 01 - 00h03m16s - Why You’re Not Financially Free (Yet)3:16–4:16 ↗60s
03Ali Abdaal - 02 - 00h14m28s - i am begging you to try harry potter fan fiction14:28–15:28 ↗60s
04Binging with Babish - 01 - 00h07m36s - I Made EVERY Salsa7:36–8:36 ↗60s
05Binging with Babish - 02 - 00h11m04s - Recreating Bobby Hill’s Restaurant Menu | Binging with Babish11:04–12:04 ↗60s
06Botez Sisters - 00m20s-00m35s - Can I Beat Will Smith in 60 Seconds?0:20–0:35 ↗15s
07BotezLive - 01 - 00h04m48s - Japan Changed Us... | Botez Sisters ASIA VLOG4:48–5:48 ↗60s
08BotezLive - 02 - 00h07m59s - What ACTUALLY Happened At Mr Beast...7:59–8:59 ↗60s
09Bryce Crawford - 01 - 00h11m19s - Debating A “Gay” Pastor!11:19–12:19 ↗60s
10Bryce Crawford - 02 - 00h21m03s - Preaching the Gospel at the Pride Parade!21:03–22:03 ↗60s
11Ethan - 01 - 00h04m38s - I Ate Every Ramen (so you don't have to)4:38–5:38 ↗60s
12Ethan - 02 - 00h21m50s - I Flew to Japan Just for This21:50–22:50 ↗60s
13George Janko - 01 - 00h18m51s - HE TALKED TRASH—THEN FOUGHT MY BODYGUARD | EP. 16518:51–19:51 ↗60s
14George Janko - 02 - 01h02m01s - Reacting to Andrew Tate’s Arrest | EP. 1641:02:01–1:03:01 ↗60s
15Jacksfilms - 01 - 00h07m48s - Jack Douglass but the questions get Jack Doug-less good7:48–8:48 ↗60s
16Jacksfilms - 02 - 00h22m16s - Anthony Padilla but the questions get Anthony Badilla22:16–23:16 ↗60s
17Jay Shetty Podcast - 01 - 00h04m11s - High Achievers Manifest Using Science NOT Luck | Emily McDonald4:11–5:11 ↗60s
18Jay Shetty Podcast - 02 - 00h12m13s - #1 Brain Doctor: Do THIS The Moment You Wake Up (Most Get It Wrong) | Dr. Daniel Amen12:13–13:13 ↗60s
19Jeff Nippard - 01 - 00h08m17s - How Ripped Can I Get My Brother In 100 Days?8:17–9:17 ↗60s
20Jeff Nippard - 02 - 00h08m10s - 7 Things That Helped My Shoulders Grow8:10–9:10 ↗60s
21Johnny Chang - 01 - 00h04m30s - Why You Need To Run To Christ4:30–5:30 ↗60s
22Johnny Chang - 02 - 00h15m39s - Destroy The Old You15:39–16:39 ↗60s
23Kallaway Marketing - 01 - 00h05m56s - Everything I Learned Growing From 0 to 2M+ Followers in 3 Years5:56–6:56 ↗60s
24Kallaway Marketing - 02 - 00h13m28s - 5 Claude Skills To Grow Faster Than 99% of People on Social Media13:28–14:28 ↗60s
25Larry Wheels - 01 - 00h04m39s - Is this the MOST dangerous Martial Art?4:39–5:39 ↗60s
26Larry Wheels - 02 - 00h10m51s - The Biggest Bodybuilder You Never Heard of10:51–11:51 ↗60s
27Podcast - 00m20s-00m48s - Michelle Obama: We Still Go High0:20–0:48 ↗28s
28The Diary Of A CEO - 01 - 00h19m51s - Ray Dalio: I Predicted The 2008 CRASH, I Know What Comes Next!19:51–20:51 ↗60s
29The Diary Of A CEO - 02 - 01h09m47s - Vitamin D Expert: The Supplement World Is Giving The WRONG Advice!1:09:47–1:10:47 ↗60s
30Xander Budnick - 01 - 00h10m08s - 5 Days Alone with the Wilderness10:08–11:08 ↗60s
31Xander Budnick - 02 - 00h17m48s - I Climbed to the Highest Point on Earth (Higher than Everest)17:48–18:48 ↗60s
32xQc - 01 - 00h07m45s - Tony Romo Mouths Off to Cops in OWI Arrest | xQc Reacts7:45–8:45 ↗60s
33xQc - 02 - 00h24m21s - xQc Reacts to the FUNNIEST TikToks & Videos From Chat!24:21–25:21 ↗60s
34001 I "Cheated" Until the Arcade Banned Me - Early 01m55s1:55–2:55 ↗60s
35003 01 Cooking Pizza with Matt Damon and Tom Holland - Early 01m42s1:42–2:42 ↗60s
39Living Raised with Christ | Ps Sam Picken29:03–34:03 ↗300s
44Triangle sound test0:00–1:09 ↗69s
45MTS - Teams Skipping Frontier-Model Security Scans Are Delinquent0:00–1:25 · non-YouTube source85s
46Jimmy Yang 10s3:47–3:58 ↗11s
49Paul Graham - Why AI Can't Replace Founders54:23–55:15 ↗52s
50Lindsay DeFranco - Running for Georgia State House District 470:12–3:09 ↗177s
51Frozen - Elsa Flees From Arendelle Clip (HD)0:00–3:30 ↗210s
52Frozen - Meeting Olaf Clip (HD)0:00–2:17 ↗137s
53Shrek 2 - I Need a Hero - Jennifer Saunders0:00–4:37 ↗277s

A frozen black-box study of the captured cohort — not a claim about every video, language, region, or future platform version. Captured August 8, 2026.