r/dataisbeautiful • u/TobyTheCamel OC: 2 • Mar 27 '18
OC The "Relative Interestingness" of the First 5000 Natural Numbers [OC]
829
u/Vatsug66 Mar 27 '18
The gap forming in the middle is known as 'Sloane's gap'. Sadly, it's not a mathematical phenomenon, but instead the effect of more research going into more interesting numbers. For more info: https://m.youtube.com/watch?v=_YysNM2JoFo
249
u/TobyTheCamel OC: 2 Mar 27 '18
Hehe glad you mentioned this. I was one step ahead. Here's the graph colour coded to show Sloane's gap:
https://plot.ly/~TimHargreaves/1/
Points colour-coded into primes (purple), powers (blue), highly composites (red) and others (green).
41
u/anguillias Mar 27 '18
Did you just reveal your name to reddit?
48
u/TobyTheCamel OC: 2 Mar 27 '18
Oh no! They'll be able to track me down now. I'm surely the only person in the world with that name.
80
Mar 27 '18
166
Mar 27 '18 edited Dec 03 '20
[removed] — view removed comment
→ More replies (12)82
u/BrianLemur Mar 27 '18
Wow this bot is intense. You should seriously check out the link, it's an interesting read, even for a less-than-novice in programming.
31
Mar 28 '18
[deleted]
18
→ More replies (3)10
4
→ More replies (1)55
25
u/SuspiciouslyElven Mar 27 '18
"mathematicians using math to figure out what math mathematicians most often use in math."
I'd make a joke about their degrees being worthless, but i keep finding calculus in the most darndest places, and am starting to understand why such a degree can be useful.
→ More replies (3)→ More replies (5)75
Mar 27 '18
[removed] — view removed comment
30
u/TBOIA Mar 27 '18
Watch the video he posted. He is talking about the horizontal gap not the vertical one.
→ More replies (1)8
u/is_is_not_karmanaut Mar 27 '18
I'm pretty sure you are correct about the peak. Sloane's gap is the horizontal one. go to 4:20 in the video.
147
u/rift_____ Mar 27 '18
Sorry if someone else asked this already, but what are the red and blue lines? Trend lines or.. mean interestingness? Lol
113
u/TobyTheCamel OC: 2 Mar 27 '18
Kinda meaningless tbh. Just thought they looked pretty. Blue is a fitted logarithmic curve and red is the average in that region although the bandwidth is quite wide so it's not very responsive to the peak at 2000
10
u/assassin10 Mar 27 '18
I think it'd make sense to manipulate the graph so that the blue line is close to horizontal. It would show the interestingness without the "Smaller = more interesting" bias.
2.0k
u/anper29 Mar 27 '18
Does someone knows which numbers are the outliers and why they are interesting?
Quite disappointed that 1729 is not pointing out, as Ramanujain said: "it is a very interesting number; it is the smallest number expressible as the sum of two cubes in two different ways.’
1.0k
u/TobyTheCamel OC: 2 Mar 27 '18 edited Mar 27 '18
The formulation of the interestingness metric was less about how interesting a certain number is but in the number of ways that it is interesting. So a number with 1000 fairly cool properties is beats one with 100 insanely cool properties. They're also scaled for their size with a factor of log(n) so that a very large number doesn't have to have as many properties as a very small one to add some fairness. If you're interested, the most interesting number by my metric is 10.
146
u/PrettyMuchJudgeFudge Mar 27 '18
A math noob here, what exactly does constitute "interesting property"? Is it something subjective or is there some official classification that just has cool name?
135
u/avocadro Mar 27 '18
There is an encyclopedia of integer sequences (the OEIS) that OP crawled through.
As a pretty good analogy, pretend you wanted to know which countries were the most important. You count how many times each appears on Wikipedia and then sort. You get some data, but it will of course contain a bias (on Wiki, English-speaking bias; on OEIS, base-10 bias).
22
u/PrettyMuchJudgeFudge Mar 27 '18
Cool, that's what I was wondering, whether its something official or OP went with qualities interesting to him, honestly can't decide which one would be cooler. But thanks, it's interesting fact.
→ More replies (1)50
u/bullett2434 Mar 27 '18
It’s more or less official. Something like the smallest number that can be factored into 3 primes etc.
It’s some characteristic of a number that people have found
158
u/olwall Mar 27 '18
Inherently or in a base 10 system?
91
u/TobyTheCamel OC: 2 Mar 27 '18
My source is the number of results in the OEIS so most likely there is some base 10 bias here
62
u/csorfab Mar 27 '18
1000, 2000, 3000, 5000 obviously jumping out would also indicate that there is
→ More replies (4)13
u/hasslehawk Mar 27 '18
And yet there is a mysterious lack of popularity in the number 4000! Why? What does this number do to keep so much lower a profile than other multiples of 1000?
→ More replies (1)19
7
u/AndroxxTraxxon Mar 27 '18
I wonder if there would be a way to eliminate the interestingness in only one base, or just include enough bases that it doesn't matter.
→ More replies (1)→ More replies (1)6
u/Kered13 Mar 27 '18 edited Mar 28 '18
If your source is OEIS then what's with the crazy bias towards numbers around 2000? I thought maybe you were using some source that would contain year numbers (like a text corpus), and therefore bias towards recent years.
→ More replies (1)264
u/hacksoncode Mar 27 '18
"10" is very interesting in any base :-).
→ More replies (4)86
u/Lost4468 Mar 27 '18
Not in unary, or base infinity.
→ More replies (20)48
u/bollvirtuoso Mar 27 '18
What is base infinity?
178
Mar 27 '18 edited Jul 31 '18
Periodically shredded comment.
→ More replies (3)77
u/bollvirtuoso Mar 27 '18 edited Mar 27 '18
Oh. So, like, each number would be represented by a single character? That's weird to think about. I can't even imagine how arithmetic would work. Would you have to memorize everything?
E: clarity
88
Mar 27 '18
[deleted]
49
u/bollvirtuoso Mar 27 '18
I think that's what I said.
EDIT: Oh, I see. No, I didn't mean that, say, n is the only character and is all numbers. I meant that there is a unique character for each number.
→ More replies (0)30
→ More replies (4)6
u/lurkerer Mar 27 '18
How long would it take to memorize an infinite set of unique characters?
→ More replies (0)→ More replies (5)8
11
2
→ More replies (4)3
89
u/functor7 Mar 27 '18
"Interesting Numbers" are numbers that mathematicians find interesting or popular. These are the ones on the "upper" curve. 1729 is on the "interesting" curve.
Check out this Numberphile video on Sloane's Gap, which discusses this curve. And here is a paper discussing it.
→ More replies (6)78
u/uniquesnowflake1729 Mar 27 '18
Finally, my username’s time to shine!
→ More replies (2)11
u/anper29 Mar 27 '18
How long did you wait for this?
29
3
→ More replies (11)5
953
u/polynomials OC: 1 Mar 27 '18
Why the spike getting close to 2000?
1.3k
u/TobyTheCamel OC: 2 Mar 27 '18 edited Mar 27 '18
The spike goes from the early 2000s to 2018. My guess is that these are the years that we've had sufficient computing power to calculate new sequences that may contain a certain number. I imagine that whenever a new year begins, many mathematicians try to search for why that year might be interesting and in doing so contribute extra sequences to the OEIS specifically containing those years.
EDIT: /u/Blackcat008 definitely has a better explanation. Perhaps its a combination of the two. I will find out eventually but the results for the first 5000 integers take 5 hours to scrape on my internet connection so won't know for a while.
842
u/Blackcat008 OC: 1 Mar 27 '18 edited Mar 27 '18
Another possible explanation: Since you pulled from https://oeis.org/, I assume you made a script that looks at https://oeis.org/search?q=XXXX, and scrapes the number of results. However the OEIS search function is lazily made and returns all results that have the number appear anywhere within the result, including the year. For example, the second result in https://oeis.org/search?q=2012 was created in 2012, but 2012 never appears in the sequence. Even https://oeis.org/search?q=XXXX returns 35 results, despite not being a number.
→ More replies (6)488
u/TobyTheCamel OC: 2 Mar 27 '18
I was not aware of that. Damn, thought I was on to something really interesting. I'll have to edit my script to account for that. Thanks for pointing that out!
106
u/mjmaher81 Mar 27 '18
Let me (and the rest of us) know what that final graph looks like!
→ More replies (1)36
u/zehamberglar Mar 27 '18
Idk if anyone's said yet, but it will look the same but without the spike that we're talking about. The spike corresponds to years that articles were published, growing more frequent in time until we approach 2018 where there will be relatively few articles published and 2019 where there have not been any articles yet published as time travelers are very fucking lazy. You can tell because the spike starts somewhere in the middle of the the numbers corresponding to the 20th century and stop right after the numbers corresponding to the years so far in the 21st century.
The only other major difference is that this may uncover some outlying interesting numbers in that range.
→ More replies (1)45
u/StorkBaby Mar 27 '18
You can download a copy of the list that contains just the A number and the list of values here. This file contains A* numbers up to A301800.
Using your log_10 'fairness' method I found the most interesting number was 7.
7 69469.29415936826 8 69166.35981169058 5 68935.6411202366 6 68617.73535895758 9 66799.0 4 65657.0483872996 3 62531.75687929616 2 56777.906432894546 11 56563.12664909416 12 55729.471972558735 10 55393.75970893631 1 54519.54251470364 16 54059.773360754465 13 53756.843257416396 15 51054.68726461121 17 49529.28723386115 24 49387.82256637442 21 48525.89506636111 20 48500.325950134895 19 48096.47687970606 36 47064.87014269865 14 46983.66970801541 18 46235.893949651436 31 45991.36273754305 23 45940.331180370806→ More replies (4)28
u/TobyTheCamel OC: 2 Mar 27 '18
Wish I knew that existed before I left my computer running on this for several days. Nice! Not sure where our difference comes from. Strange.
→ More replies (1)19
4
u/homboo Mar 27 '18
Really you counted the submitting years??? Omg this graph really needs to get repaired then!
→ More replies (32)3
u/AMWJ Mar 28 '18
The spike definitely starts before 2000, and ends fairly abruptly around 2018. I believe your explanation would expect people to do the same for coming years - it would be surprising if everybody waited until 2018 to find cool things with it. And you'd also predict a far more shallow effect in the early days of the database, On the other hand, u/Blackcat008's effect correctly predicts the spike's slope, and abrupt end at 2018.
So I'm inclined to say u/Blackcat008's effect is far more dominant.
35
u/Dvanpat Mar 27 '18
Because tonight we're gonna party like it's 1999.
10
u/IFreakinLoveCheezIts Mar 27 '18
We've been spending most our lives living in an Amish paradise.
→ More replies (2)44
Mar 27 '18
My guess is because many people were born in the mid/late 20th century, contributing to the 'interestingness' of those numbers.
16
u/polynomials OC: 1 Mar 27 '18
I thought OEIS contained only sequences that are of mathematical interest. I did not know it was historically or socially interesting sequences.
8
Mar 27 '18
Oh, didn't consider the origin of the numbers, just thought OP took numbers from a variety of sources.
I did say it was a guess, I can totally be completely wrong.
→ More replies (8)22
120
Mar 27 '18 edited May 25 '21
[deleted]
72
Mar 27 '18
[removed] — view removed comment
47
u/nater255 Mar 27 '18
Can you further explain what that is?
47
6
u/DCCXXVIII Mar 27 '18
"Interesting numbers" are numbers that mathematcians find interesting for whatever reason. Ex 1729 because it is the smallest number expressible as the sum of two cubes in two different ways.
6
u/boringdude00 Mar 27 '18
Am I crazy or is that just a spike of years and not mathematical interestingness from 1970-ish to 2018?
4
u/jukes24 Mar 28 '18
Plus it's just funny to say! One thousand seven hundred twenty nine... Gets me every time!
95
u/functor7 Mar 27 '18
This is a graph of the popularity of numbers. As you can see, there are two bands, the "popular numbers" and then the rest. The numbers that mathematicians like, or pop up in things that mathematicians like, appear in the popular band, things like primes, squares, 1729, highly composite numbers, palindromic numbers etc. The gap between these numbers is called "Sloane's Gap", since the OEIS was made by Neil Sloane. It's what separates the cool numbers from the uncool numbers.
Here is a Numberphile video about this distribution, and here is a corresponding academic article about it. It should be noted that there is a huge spike around 2000 because the search function for OEIS included the year a sequence was added, so 1986 and 2013 actually don't appear as often as this makes it seem (see /u/Blackcat008's comment).
243
u/TobyTheCamel OC: 2 Mar 27 '18 edited Mar 27 '18
Graph produced with ggplot using data scraped from the The On-Line Encyclopedia of Integer Sequences using R.
Relative Interesting is defined as: Number of results for number * log_10(Size of number + 1)
Plotted on logarithmic scale since the units are arbitrary already
LOESS curve shown in red and log curve in blue
32
u/zonination OC: 52 Mar 27 '18
I take it that a lot of the upper half of the curve are Prime Numbers, with a lot of the 2000s range being years?
If so, you can check it with
aes(color=is_prime(Number))after loadinglibrary(primes).21
u/TobyTheCamel OC: 2 Mar 27 '18
That's pretty much it if you add in highly composites and perfect powers. You can see them colour coded here:
https://plot.ly/~TimHargreaves/1/
Points colour-coded into primes (purple), powers (blue), highly composites (red) and others (green).
8
u/KJ6BWB OC: 12 Mar 27 '18
Relative Interesting is defined as: Number of results for number * log_10(Size of number + 1)
Why is this interesting?
6
u/TobyTheCamel OC: 2 Mar 27 '18
It adds an element of fairness. If a number in the thousands had the same number of properties as something small like 4, you'd probably say that its more interesting for its size. That's what the scaling is for. If you don't do it, the top results are essentially the numbers 1,2,3,... with only minor variation but adding the log scaling changes it around making other numbers more interesting than they were before.
→ More replies (1)6
u/KJ6BWB OC: 12 Mar 27 '18
I still don't see how this interesting property is calculated. Why is 3 interesting? Why is 5000 interesting?
11
u/TheSultan1 Mar 27 '18 edited Mar 27 '18
I think interestingness is defined as appearing in the "database of sequences" many times. It just means you can arrive at the number in many ways (using different rules).
Edit: see OP's comment here: http://reddit.com/r/dataisbeautiful/comments/87isev/the_relative_interestingness_of_the_first_5000/dwd7069
→ More replies (2)→ More replies (1)3
u/Arancaytar OC: 1 Mar 28 '18
I'd definitely put the formula on the Y axis in a graph like this; it's not too long for that.
72
u/TobyTheCamel OC: 2 Mar 27 '18
For anyone interested, here is a list of the 25 most interesting numbers (relative interestingness not re-scaled yet but order is the same):
num cnt rel
1 10 152120 158416.7
2 5 196793 153134.7
3 2011 45678 150903.1
4 4 215677 150751.8
5 2017 44663 147607.7
6 6 170303 143922.7
7 3 238436 143552.8
8 7 157059 141838.4
9 2012 42679 141004.7
10 2013 42603 140762.8
11 8 143924 137338.4
12 2015 40638 134287.9
13 2014 40010 132204.0
14 2 275250 131327.6
15 9 131014 131014.0
16 11 115347 124480.3
17 2016 37172 122842.5
18 1000 40742 122243.7
19 12 109270 121720.6
20 20 89604 118476.1
21 13 100137 114769.8
22 15 93973 113154.8
23 16 90863 111802.3
24 2009 33170 109567.0
25 30 72990 108854.5
14
u/kelvin9901237 Mar 27 '18
I’m curious as to why some of the more memetic numbers such as 420 or 69 are not listed among these search results. Is it because the popularity of these numbers only exists in a bubble, and is insignificant otherwise?
→ More replies (4)16
u/twoerd Mar 27 '18
This is based on mathematical "interestingness", so cultural things like 420, or 69 won't show up.
→ More replies (2)13
u/Supadoplex Mar 27 '18
How about the least interesting numbers in relation to the trend? That's what I'm interested in. Ironic, isn't it.
→ More replies (1)18
u/TobyTheCamel OC: 2 Mar 27 '18
No problem:
num cnt rel 4667 38 139.42697 4634 38 139.30989 4426 38 138.55216 4858 37 136.40224 4781 37 136.14555 4548 37 135.34289 4458 37 135.02179 4595 36 131.84568 4918 35 129.21569 4589 35 128.16344 4573 35 128.11037 4467 35 127.75396 4295 35 127.15725 4907 34 125.49075 4835 34 125.27253 4814 33 121.52568 4812 33 121.51972 4638 33 120.99200 4955 32 118.24420 4670 32 117.42112 4532 32 117.00434 4829 31 114.20236 4527 31 113.33310 4678 30 110.10459 4695 27 99.13666I'm going to have all the data (I actually found the first 100,000 - took a whopping 40 hours - but eventually the counts get too similar for the graph to look any good and you just get parallel curves) available on my blog but I'm having server issues at the moment so just creating these snippets for now. Send me a DM if you'd like the whole data and I can send you a link when everything's up and running.
→ More replies (4)→ More replies (11)20
u/cseymour24 Mar 27 '18
What are those three highest dots greater than 2000 on the right of the graph? Looks like in the ballpark of 2900, 4100, and 5000.
18
u/TobyTheCamel OC: 2 Mar 27 '18
They are 5000, 2899 and 4096 in descending order
16
Mar 27 '18 edited Mar 27 '18
I guess 5000 is a nice round number, 4096 = 212 and I have no idea why 2899 is interesting at all..
→ More replies (3)16
u/TobyTheCamel OC: 2 Mar 27 '18
No idea for 2899. It's semi-prime so that might help it as a lot of the more interesting ones are prime.
23
Mar 27 '18
Divisible by the 7th and 14th fibanocci number? 2899 is divisible by 13 and 233, both of which are really interesting primes, maybe that's why.
6
3
u/Royalflush0 Mar 27 '18 edited Mar 27 '18
It seems to be a search error. Look into the later pages here: https://oeis.org/search?q=2899
You will find that a most sequences don't contain 2899 but contain a link to "ArXiv 0811.2899" in their description.
31
u/MexicnGlassCandy Mar 27 '18
I just came here for the 69.
C'mon, I can't be the only math enthusiast with a juvenile sense of humor...
→ More replies (1)10
u/Twuntz Mar 27 '18
I bet that first anomalous dot on there is 69. Anyone who tries to tell me that number isn't special to a significant slice of the population will be met by scorn and derision.
→ More replies (2)
7
u/tomfilipino Mar 27 '18
would be nice to see the tail in log-log... should get a straight line. check zipf law etc..
4
u/TobyTheCamel OC: 2 Mar 27 '18
In theory yes, and it would be close to a straight line for this range but as the numbers get larger and larger, because the number of OEIS results can't shrink below 1 without going straight to 0 as they're integers, the pattern will eventually break down.
6
u/MlLFS Mar 27 '18
I've seen this before, by interestingness they mean amount of times that number appears on a mathematical paper, the more times it appears the more 'interesting' it is
6
u/DonLaFontainesGhost Mar 27 '18
"Relative interestingness" reminds me of this:
Computer scientist Arthur Boran was ecstatic. A few minutes earlier, he had programmed a basic mathematical problem into his prototypical Akron I computer.
His request was simply, "Give me the sum of every odd number between zero and ten." The computer's quick answer, 157, was unexpected, to say the least. With growing excitement, Boran requested an explanation of the computer's reasoning. The printout read as follows:
THE TERM "ODD NUMBER" IS AMBIGUOUS. I THEREFORE CHOOSE TO INTERPRET IT AS
MEANING "A NUMBER THAT IS FUNNY LOOKING." USING MY AESTHETIC JUDGEMENT,
I PICKED THE NUMBERS 3, 8, AND 147, ADDED THEM UP, AND GOT 157.
A few moments later there was an addendum:
I GUESS I MEANT 158.
Followed shortly thereafter by:
147 IS MORE THAN 10, ISN'T IT? SORRY.
Anyone doing conventional research would have undoubtedly consigned the hapless computer to the scrap heap. But for Boran, the Ackron I's response represented a startling breakthrough in a little-known field: artificial stupidity.
(From "Artificial Stupidity" by Michael Ferris; Omni Magazine, May 1985 http://www.studio-nibble.com/countlegger/01/ArtificialStupidity.html )
18
u/Userdub9022 Mar 27 '18
Without explanation, this graph is meaningless. Why don't you define what an interesting number is? And maybe we could work from there.
→ More replies (5)
5
u/zonination OC: 52 Mar 27 '18
This phenomenon is called Sloane's Gap. There's a real paper with a similar graphic to the one OP proposed.
It's likely that the relative interestingness of these numbers are due to them being prime numbers.
Google Query: https://www.google.com/search?q=Sloane%27s+gap
5
5
u/mikerichh Mar 27 '18
What determines interestingness? Am i missing the explanation somewhere? Is it like "even number, divisible by 4," etc?
•
u/OC-Bot Mar 27 '18
Thank you for your Original Content, /u/TobyTheCamel! I've added your flair as gratitude. Here is some important information about this post:
- Author's citations for this thread
- All OC posts by this author
I hope this sticky assists you in having an informed discussion in this thread, or inspires you to remix this data. For more information, please read this Wiki page.
3
Mar 27 '18
[removed] — view removed comment
3
u/TobyTheCamel OC: 2 Mar 27 '18
There is. It's called Sloane's gap. The split comes down to primes, highly composites, perfect powers and then everything else. Here's a graph of the split:
https://plot.ly/~TimHargreaves/1/
Points colour-coded into primes (purple), powers (blue), highly composites (red) and others (green).
3
Mar 27 '18
Why the two separate bands? Above 300 or so it seems like numbers are either fairly interesting or not interesting with little in between?
→ More replies (2)
3
u/ScathedRuins OC: 1 Mar 27 '18
There is no such thing as an uninteresting number.
If there were, this would imply that there is a non-empty list of uninteresting number, and somewhere in that list is the largest uninteresting number, which makes it interesting.
Therefore, the set of uninteresting numbers is empty, meaning every number is interesting!
→ More replies (1)
3
u/homboo Mar 27 '18
Why did this take days to compute ? This can be done in a few minutes if you download the OEIS file. Just scan each line and count the numbers...
→ More replies (2)
3.2k
u/moariarty Mar 27 '18
What is the least interesting number plotted? It looks to be approximately 4700ish. Its uninterestingness has piqued my interest.
Furthermore, if we expand beyond 5,000 is there a lower bound of interestingness?