The Zipf Mystery

  zhlédnutí 18,969,305

Vsauce

Před 5 lety

The of and to. A in is I. That it, for you, was with on. As have ... but be they.
RELATED LINKS AND SOURCES BELOW!
tweetsauce
electricpants
WordCount.org www.wordcount.org/
How many days have you been alive? www.beatcanvas.com/daysalive.asp
random letter generator: www.dave-reed.com/Nifty/randSeq.html
Dictionary of Obscure Sorrows: csposts.info
Word frequency resources:
[lemmatized] en.wikipedia.org/wiki/Most_common_words_in_English
www.uow.edu.au/~dlee/corpora.htm
www.wordfrequency.info
www.anc.org/data/anc-second-release/frequency-data/
www.titania.bham.ac.uk/docs/
www.kilgarriff.co.uk/bnc-readme.html#raw
en.wiktionary.org/wiki/Wiktionary:Frequency_lists
ucrel.lancs.ac.uk/bncfreq/
[PDF] www.wordfrequency.info/files/entries.pdf
[combined Wikipedia and Gutenberg] www.monlp.com/2012/04/16/calculating-word-and-n-gram-statistics-from-a-wikipedia-corpora/
corpus.byu.edu/coca/files/100k_samples.txt
corpus.byu.edu/
corpus.leeds.ac.uk/list.html
books.google.co.uk/books?id=ja1_AAAAQBAJ&dq=word+frequency+coca&lr=
www.ling.helsinki.fi/kit/2009s/clt231/NLTK/book/ch01-LanguageProcessingAndPython.html
Great Zipf's law papers:
colala.bcs.rochester.edu/papers/piantadosi2014zipfs.pdf
www.ling.upenn.edu/~ycharles/sign708.pdf
arxiv.org/pdf/cond-mat/0412004.pdf
www-personal.umich.edu/~mejn/courses/2006/cmplxsys899/powerlaws.pdf
Zipf’s law articles and discussions:
www.theatlantic.com/magazine/archive/2002/04/seeing-around-corners/302471/
io9.com/the-mysterious-law-that-governs-the-size-of-your-city-1479244159?.Ej9760cOTJCPS_Bq4mjoww.0
plus.maths.org/content/os/latestnews/may-aug08/food/index
judson.blogs.nytimes.com/2009/05/19/math-and-the-city/?em
plus.maths.org/content/mystery-zipf?src=aop
www.datasciencecentral.com/profiles/blogs/why-zipf-s-law-explains-so-many-big-data-and-physics-phenomenons
en.wikipedia.org/wiki/Zipf%27s_law
books.google.co.uk/books?id=f8GrzlnMSm8C&pg=PA62&redir_esc=y#v=onepage&q&f=false
arxiv.org/pdf/0802.4393v1.pdf
www.pnas.org/content/108/9/3526.full
lewisdartnell.com/language_page.htm
wugology.com/zipfs-law/
other Zipf’s law PDFs
ftp.iza.org/dp3928.pdf
arxiv.org/pdf/1402.2965.pdf
arxiv.org/pdf/1104.3199.pdf
www.lel.ed.ac.uk/~jim/zipfjrh.pdf
www.ncbi.nlm.nih.gov/pmc/articles/PMC2834740/#pone.0009411-Mandelbrot1
polymer.bu.edu/hes/articles/pgs02a.pdf
in untranslated language: arxiv.org/pdf/0808.2904.pdf
pages.stern.nyu.edu/~xgabaix/papers/zipf.pdf
www.hpl.hp.com/research/idl/papers/ranking/ranking.html
statweb.stanford.edu/~owen/courses/306a/ZipfAndGutenberg.pdf
arxiv.org/pdf/1310.0448v3.pdf
www.kornai.com/Papers/glotto5.pdf
Zipf’s law slides:
www.slideshare.net/guest9fc47a/nlp-new-words
Pareto Principle and related ‘laws’:
www.squawkpoint.com/2013/03/pareto-principle/
billyshall.com/blog/post/paretos-principle
en.wikipedia.org/wiki/Pareto_principle
Random typing and Zipf:
www.longtail.com/the_long_tail/2006/09/is_zipfs_law_ju.html
health 80/20: archive.ahrq.gov/research/findings/factsheets/costs/expriach/expriach1.html
Principle of least effort:
en.wikipedia.org/wiki/Principle_of_least_effort
en.wikipedia.org/wiki/Satisficing
www.pnas.org/content/100/3/788.full.pdf [PDF]
csiss.org/classics/content/99
self organized criticality:
journal.frontiersin.org/article/10.3389/fnsys.2014.00166/full
Hapax Legomenon:
campus.albion.edu/english/2011/02/15/hapax-legomenon/
www.dailywritingtips.com/is-that-a-hapax-legomenon/
en.wikipedia.org/wiki/Hapax_legomenon
[PDF] www.aclweb.org/anthology/J10-4003
www.wired.com/2012/01/hapax-legomena-and-zipfs-law/
oed.hertford.ox.ac.uk/main/content/view/402/450/index.html#_ftn1
oed.hertford.ox.ac.uk/main/content/view/36/166/index.html
Learning curve: en.wikipedia.org/wiki/Learning_curve
Forgetting curve:
www.trainingindustry.com/wiki/entries/forgetting-curve.aspx
en.wikipedia.org/wiki/Forgetting_curve
Experience curve effects: en.wikipedia.org/wiki/Experience_curve_effects
Forgetting
and zipf's law: act-r.psy.cmu.edu/wordpress/wp-content/uploads/2012/12/37JRA_LS_PS_1991.pdf
public.psych.iastate.edu/shacarp/Wixted_Carpenter_2007.pdf
marshalljonesjr.com/youll-remember-less-than-001-of-your-life/
en.wikipedia.org/wiki/Forgetting
www.reddit.com/r/Showerthoughts/comments/3gu9qk/it_only_takes_three_generations_for_you_to_be/
music from:
csposts.info
www.audionetwork.com

Komentáře
Cameron Goodall
Cameron Goodall Před 4 hodinami
there is no way "school" is uses more than "no"
blocboy jb
blocboy jb Před 6 hodinami
The Bible was written by man bc it follows ziffs law
Matt Garrelts
Matt Garrelts Před 7 hodinami
we bouta get quizzacious
Andrej Ajnik
Andrej Ajnik Před 11 hodinami
This is Benford's law
Andrew Zeitler
Andrew Zeitler Před 12 hodinami
The absent reason putatively guide because transaction regretfully milk besides a overrated territory. aboard, tranquil skirt
Dennis Garage
Dennis Garage Před 15 hodinami
Sounds very similar to Benford's law also. There seems to be a more primary factor causing the occurrence of this throughout various systems. Living in a simulation becomes more plausible the more you realize the patterns.
Lu Bu
Lu Bu Před 16 hodinami
I think this all comes down to usefulness and meaning. The could be used to pinpoint any other word while sauce is so specific that it isn’t used as much because the explanation is direct and intentional. The is what exactly? but sauce is sauce.
Jacob Packman
Jacob Packman Před 16 hodinami
80% of my stories are filled with um and 20% of my stories are actually told
John Heggerty
John Heggerty Před 16 hodinami
Dude, after 2 video spirals on your channel I'm not ashamed to admit that although chunks of the content my idiot brain has no way to comprehend it. But the way you present and explain the info, what I end up being able to fathom, blows my mind! Love your content.
Shard FloofFox
Shard FloofFox Před 17 hodinami
Bruh
Drooby Dooby Doo
Drooby Dooby Doo Před 22 hodinami
We live in a simulation.
Tuckster04
Tuckster04 Před dnem
Who else tried to count the amount of times he said "the"
Edward Trevino
Edward Trevino Před dnem
This 80/20 split forecasted Tfues contract
Aljulanda Almaghadari
Aljulanda Almaghadari Před dnem
It indicates that there is one creator of the universe.. The One and Only God
cant run
cant run Před dnem
All I see is FRACTALS.
Kjonesey ‘
Kjonesey ‘ Před dnem
3:03 wow
Elise Visser
Elise Visser Před dnem
80 percent of my test is about 20 percent of what we had to study
Doby Adoby
Doby Adoby Před dnem
*s a u c e*
a a
a a Před dnem
Meanwhile: German *der die das die den die das die dem der dem den des der des der*
Ryan Cooper
Ryan Cooper Před dnem
since this cideo was published, Quizzaciously has gone from 1 result, to 17,500 results. Proving your point that the more something is used, the more it be used again.
Nooby-kun
Nooby-kun Před dnem
2:08 normal people: wow people really like sauce. me being a weeb: ( ͡° ͜ʖ ͡°)
Cedrick Narsiso
Cedrick Narsiso Před dnem
Zipf's Law is just the algorithm that God put into a lot of shit after a long day of developing the " everything"
toastboii
toastboii Před 2 dny
Vsauce always makes me feel philosophical
E
E Před 2 dny
my grandma did a funny dance on the floor and i dont know why vsauce help
papinbala
papinbala Před 2 dny
in the beginning was the word, and the word was with God and the word was God
James Taylor
James Taylor Před 2 dny
Is this proof that we’re in a simulation?
pizzasmithdude
pizzasmithdude Před 2 dny
This law explains why you can never solve the problem of inequality in every single measurement of socio-economic status.
Mark Prins
Mark Prins Před 2 dny
I think that Zipf was correct. Speaking more than ten languages myself, I've come to the theory that language is just a way to transfer thoughts. In doing so you will need a (rare) specific word and several (common) words to describe how people should interpret the specific word.
Lady Ymir
Lady Ymir Před 2 dny
"[...] in *the* english language. About one in every 16 words you encounter on a daily basis is *the* ." son of a...
Deconstruct//Recreate
Deconstruct//Recreate Před 2 dny
Hapax Legomenon derives from the Greek Άπαξ λεγόμενον which literally means “ said once”.
Brave Cat
Brave Cat Před 2 dny
so then what happens when 99% of the wealth is with 1% of the people. such a huge imbalance im sure Cthulu will come and have to balance that out. or maybe thats why the sun is freaking the fuck out and is about to spit a micro nova at us.
KUWALDA
KUWALDA Před 2 dny
michael saying "80 percent and..." so much fucked me over ngl
Akyllia
Akyllia Před 2 dny
It is funny how the Pareto principle is relevant today. Here in Quebec, Canada, they said that 20% of the people at risk of contracting the COVID-19 virus (mostly people over 65 years old) represent 80% of the people hospitalized in our hospitals! I didn't know about that principle then!
Qwerty
Qwerty Před 2 dny
too bad i can't check out wordcount since flash player is dead
Mr. E
Mr. E Před 2 dny
Kinda puts the kibosh on the whole conservative assertion that the wealthy have what they have because they "deserve it". Seems more likely that they're just lucky beneficiaries of some cosmological constant that had little to nothing to do with their effort. This of course begs the question: if you're no more entitled to wealth or power than the next person, *why do we constantly accept systemic wealth and power inequality?*
Will It Snap?
Will It Snap? Před 3 dny
"Zipf-y"
Junovah Hunziil
Junovah Hunziil Před 3 dny
Vsauce Say "I want" and then everything after it without (The)
Complex God
Complex God Před 3 dny
What a video!!!
Scott Keselowski
Scott Keselowski Před 3 dny
Video must be old. The most common word now is literally :p
fewbronze games
fewbronze games Před 3 dny
everyone use the second most used word as much as possible
Itchy Eyes McRealize
Itchy Eyes McRealize Před 3 dny
This can't be right ....
Joe Blackmore
Joe Blackmore Před 3 dny
I know use quizatiously once at least a day I no speel
The Failed_safe
The Failed_safe Před 3 dny
Well order is the last thing that you'd think chaos would do, so thats exactly what it did
Hugo Le Roy
Hugo Le Roy Před 3 dny
Have you forgotten this video now that 5 years have passed?
SoftAlexandra3 Plays
SoftAlexandra3 Plays Před 3 dny
He got us in the first half, not gonna lie.
Helpful Sysops
Helpful Sysops Před 3 dny
0:26 This is a really very good Poem.
Robin
Robin Před 3 dny
"The" dont exist in my language. You change the word instead that wold be after "the".
Sander Bouwhuis
Sander Bouwhuis Před 3 dny
1. Interesting, which language is that? 2. Languages don't necessarily agree on the order. Inuits probably have many words that are frequently used like snow/white/cold, while the Bedouin probably have very few words like that. On the other hand, Bedouins probably have and use many words related to yellow/sand/hot, while the Inuits probably use these rarely if at all.
Ethereal Sky Daddy
Ethereal Sky Daddy Před 3 dny
This is like the Fibbonaci Sequence.
Sebastian Solis
Sebastian Solis Před 4 dny
What if we tend to use more words than others because some might feel repetitive? If someone puts "the" 30 times in an essay it will certainly look better than if they put "furthermore" also 30 times in it.
tdchewy
tdchewy Před 4 dny
Your science is flawed as only a few letters on their own are actually words. F or Q are not words for example, they are letters.
[GD] Goose
[GD] Goose Před 4 dny
After the intro his percentage when the up to 7%
Cattu Doggu
Cattu Doggu Před 4 dny
Im scared of this \ line now
Mag Magnet
Mag Magnet Před 4 dny
14:08 imagine this in a bernie sanders voice LOL
Jayleigh
Jayleigh Před 4 dny
Okay but Vilfredo Pareto has to be the coolest name ever
Double A-AA
Double A-AA Před 4 dny
every time micheal says the word "the" I go: "Micheal stop! STOP! You're killing me!"
Eric Young
Eric Young Před 4 dny
me: how is this possible? Vsause: yes
Benjamin Coffman
Benjamin Coffman Před 4 dny
V-sauce. Really? "Its like if you take a snowball and roll it down a snowy hill." Yes my genius friend, the snowball effect.
Benjamin Coffman
Benjamin Coffman Před 4 dny
Still love you Michael :p
Liam Binsfeld
Liam Binsfeld Před 4 dny
Haha the
Eye Master 3.14
Eye Master 3.14 Před 4 dny
So, quizzaciously is a fun word, but can it beat fabaceous (Adv. of the nature of the bean)?
InsteadImAwake
InsteadImAwake Před 5 dny
Quizzaciously
qwzerty_
qwzerty_ Před 5 dny
That intro is what makes time continue
Bernice Gardner
Bernice Gardner Před 5 dny
The better quart enzymatically whistle because flugelhorn likely shade under a onerous care. boring, mushy link
Ultimate Flan
Ultimate Flan Před 5 dny
11:27 top ten anime plot twists
afeelfortheflow with Manic
afeelfortheflow with Manic Před 5 dny
This guy is extraordinary
Magic Beans
Magic Beans Před 5 dny
AAAAAAAA! Vsauce is making me interested in math! NOOOOO What do I do lol
Cielo
Cielo Před 5 dny
so if i study onlky 20% of most used words & grammar i can learn 80% of a language 🤑
A1 Helix
A1 Helix Před 6 dny
This is like almost actual proof we are in a simulation
Vivek Saraswat
Vivek Saraswat Před 6 dny
Since there are an infinite causes and effect pairs, I believe every arbitrary combination like 30/70 or 50/50 will also have infinite occurences (there may not be anything special about 20/80). If someone shows that the popularity or frequency of a particular combination, say 20/80, is more compared to the rest of the possibilities, then it would be something weird. Listing a 100 examples which follows 20/80 principle from an infinite more total examples does not lead me to believe that this combination is special. Nice video though, as always 😉.
Thomas Beasley
Thomas Beasley Před 6 dny
We broke the law!!! Only 9 percent of plastic is recycled 91 percent is in landfills or is litter.
{DavidDoesn'tKnow}
{DavidDoesn'tKnow} Před 6 dny
80% of my life is boring but 20% is more boring.
THE JACK HQ
THE JACK HQ Před 6 dny
We have the Illuminati all figured out now 😏. They thought they could pull the Zipf over our eyes. Not so much anymore.
Hugo Petrarolha
Hugo Petrarolha Před 6 dny
4:23 George Zipf é a cara do jornalista Augusto Nunes.
Eli Phelps
Eli Phelps Před 6 dny
Vilfredo Pareto
Emlar Tubbs
Emlar Tubbs Před 6 dny
i didnt understand any of that
RainMan
RainMan Před 7 dny
Of all the stuff I have 20% is useful, 80% is junk..
DynaBlox
DynaBlox Před 7 dny
the word "um" is used more than "the
Harvey YFBY
Harvey YFBY Před 7 dny
80% of my code sucks and 20% of my code sucks whats the problem then
yash Payal
yash Payal Před 7 dny
It made me sure that I am living in a stimulation: (
Cesar Arizpe
Cesar Arizpe Před 7 dny
80% of micheals hair is on 20% of his head
God
God Před 7 dny
maybe because we all run in one ai program
Carla Macias
Carla Macias Před 8 dny
How can you not translate the unknown language, all ya gotta do is figure out what's used the most then that must be the word "the" and so on.
jisdaboss1
jisdaboss1 Před 8 dny
All this tells me is that life is actually just a lot of annoying math problems I don't want to do
That Guy
That Guy Před 8 dny
Why do I only watch vsauce at 5 in the morning
Jonathan Shedd
Jonathan Shedd Před 8 dny
Zipfs law seems like an Easter egg the creators of the world put in when they were designing us, in the simulation, we're just part of a simulation created by other beings and they made things like zipfs law intentionally for us to eventually find. Imagine the things we don't yet know, or even better imagine the things we think we know but are just based off of speculation
BFB-DanceySteve
BFB-DanceySteve Před 6 dny
Speculation? Oh, you mean like speculation as in there must be a creator
Alex Wall
Alex Wall Před 8 dny
He is so quizacious
Tarik Tezcan
Tarik Tezcan Před 8 dny
Someone should do this for the 3 holly books. Just for fun.
Dead Man
Dead Man Před 8 dny
Cycloid ... 🙌🏽
Asif Molvi
Asif Molvi Před 8 dny
@Vsauce
Asif Molvi
Asif Molvi Před 8 dny
@vsauce please make a video of benfords law
xxxgammaxxx
xxxgammaxxx Před 8 dny
I got through about half of this video.
billy watkins
billy watkins Před 9 dny
That was until this new generation. Now it seems that every other word is "like".
T. L.
T. L. Před 9 dny
80% of my life has been wasted on 20% success.
DJ matexx
DJ matexx Před 9 dny
Zipf's law treats statistics quizzatiously.
Parallax WR
Parallax WR Před 9 dny
80 percent of diamonds are mined by 20 percent of players
The Tattoo Trunk Show with Scott Hill
The Tattoo Trunk Show with Scott Hill Před 9 dny
I vote that we all copy paste the word sauce over and over and throw off the whole Zipf thing off. It will be Anarchy. Cats living with dogs. I’m an evil genius. sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce sauce I said off twice just for fun.
Paige Bell
Paige Bell Před 9 dny
This just proves whoever is running the simulation got lazy on some details lol
Axel de Water
Axel de Water Před 9 dny
I almost clicked on another video when he did the fake ending.
SandyRiverBlue
SandyRiverBlue Před 9 dny
I'm curious what effect the application of anti-trust laws has on these distributions. We know that when we apply these laws it tends to improve the economy and the quality of life for the customers of these companies. But if businesses tend toward this equilibrium of unfairness then a more heavy handed a approach might be warranted.
Wallijacanero
Wallijacanero Před 9 dny
"Even so, they have made me" I love this sentence. I lost my grandfather almost a month ago and he was the one who was truly passionate about studying. He had inspired me to continue my studies after high school and I am still passionate about studying. I've been thinking a lot of him during this month, but I realized I was and am not able to remember much things about him as I would like to. Probably this link doesn't make sense, but that sentence Michael said here makes me feel better about it. Thank you.
Ana Burke
Ana Burke Před 9 dny
The decisive development comparably tease because pail similarly return round a lewd bead. scandalous, deadpan hardboard
The Banach-Tarski Paradox
24:14
Vsauce
zhlédnutí 32M
The Brachistochrone
25:57
Vsauce
zhlédnutí 12M
AKO PRIVOLAŤ KAŽDÉHO PSA | výcvik psa
8:12
When Will We Run Out Of Names?
10:53
Vsauce
zhlédnutí 11M
Math Magic
19:31
Vsauce
zhlédnutí 10M
Spooky Coincidences?
14:45
Vsauce
zhlédnutí 23M
Illusions of Time
31:08
Vsauce
zhlédnutí 4,4M
How Earth Moves
21:37
Vsauce
zhlédnutí 23M
Travel INSIDE a Black Hole
10:45
Vsauce
zhlédnutí 29M
The Riemann Hypothesis, Explained
16:24
Quanta Magazine
zhlédnutí 719K
The Lost Colony of Roanoke
27:53
LEMMiNO
zhlédnutí 3,1M
Why do prime numbers make these spirals?
22:30
3Blue1Brown
zhlédnutí 2,7M
Supertasks
21:09
Vsauce
zhlédnutí 10M
AKO PRIVOLAŤ KAŽDÉHO PSA | výcvik psa
8:12
Vybalujeme a PEPCO HAUL I mamavlog
27:58
Kate and family
zhlédnutí 20K
Annoying Things We Can All Relate To
11:12
SSSniperWolf
zhlédnutí 4,6M
The New Goonzquad Headquarters Part 61
23:12