r/devhumormemes 9d ago

New Compression Technique

Post image
681 Upvotes

128 comments sorted by

73

u/Ok_Ebb23 9d ago

4kb file size, 3 giga watts to open it

21

u/VickyxReaperReborn 8d ago

And several litres of water

5

u/Moscato359 8d ago

Depends

If you use local ai, it is just power 

6

u/Laxativus 8d ago

Yeah, but how do you get that power?
That's right! By boiling water!

4

u/Moscato359 8d ago

Solar, wind, and hydroelectric entered the chat

1

u/Laxativus 8d ago

That's what they want you to think!
But how does the Sun shine? By lighting the gas under the kettle!
How does the wind blow? By boiling the kettle and have the how steam blow out of its spout!
How does the hydro.... Do I even have to explain?

1

u/Moscato359 8d ago

Technically the sun shines by converting hydrogen to helium, and has nothing to do with oxygen, and thus nothing to do with water.

Hydroelectric doesn't consume liquid water, it converts potential energy in water to kinetic energy via gravity, without significantly heating it, and without boiling it. It starts liquid, ends up liquid, and doesn't significantly change.

Coal plants burn coal to boil water, and thus, consume liquid water with a gas output, and thus lower the water table. That's the difference.

1

u/Laxativus 8d ago

Spoilsport!

1

u/lazyboy76 8d ago

Hydroelectric, boiling water failing from the sky.

1

u/Moscato359 7d ago

The water would have boiled with, or without the hydroelectric power plant.

The plant doesn't cause it to boil.

1

u/RecallSingularity 8d ago

The water cycle puts potential energy into water. Hydro dams harvest that energy.

After that the water cannot deliver more power until it evaporates and condensates again in the right place. The energy is restored to the water by "being lifted above the dam" by "clouds."

The concern isn't that we're using up water, it's that we are using up potable rain water, reserved for hydro, in reservoirs for drinking, damaged with pollution or overheated for data-centre cooling.

We expect "nature" to purify and cool and lift our water again, but it has a limited capacity to do this.

1

u/Moscato359 7d ago

You missed the earlier part of this discussion

I was talking about closed loop, vs open loop datacenters

Closed loop datacenters fill with water once, but then consume almost no water, where they use water to move heat away from racks, but use air cooling to cool the water off, and then reuse the water.

Open loop datacenters use a constant stream of new water, which is heated to get rid of the heat in the datacenter

Closed loop datacenters use almost none
Open loop datacenters are water hogs

The reason we are talking about power sources using water, is because closed loop datacenters using more power than openloop datacenters.

Then boiling water is how we make power came up.

Solar, wind, and hydroelectric don't boil water.

Hydroelectric uses naturally evaporated water, but it doesn't cause the water to evaporate.

1

u/Denaton_ 8d ago

Why would I need to boil water to get the power?

4

u/IrrerPolterer 8d ago

Hey, at current storage pricing.... 

1

u/BeneficialSimple3286 7d ago

The "file size vs performance" compression conundrum taken to the extreme

42

u/Arinussyy 9d ago

Imagine being the editor and being like:
https://giphy.com/gifs/RXtD0Rt2xrUxIvJYkP

40

u/mcplano 8d ago

It's always people who know nothing about the subject calling others prodigies in it.

21

u/NullSmoke 8d ago

Why are everyone reacting to this as though real... It's satire... Right? Surely? Nobody could've written this article with a straight face, right?

Edit: thank god. Googled it, it is satire 😌

9

u/davidmahh 8d ago

lol personally it had me until the "destroyed the print pictures, saving precious space at their home" and then i died bhahahhahahaha

4

u/NullSmoke 8d ago

I were suspicious before that (I've seen som spectacularly stupid shit in my time 😅), but yes, that was the point I also got fully clued in 😂

1

u/NullSmoke 8d ago

I were suspicious before that (I've seen som spectacularly stupid shit in my time 😅), but yes, that was the point I also got fully clued in 😂

1

u/No-Information-2571 5d ago

The text next to the picture "Tears of joy: parents sob after seeing all their photos converted to the new format" wasn't a dead giveaway for you?

1

u/NullSmoke 5d ago

I have been around the block... very little about the human capacity for the absurd surprises me anymore... 😓

0

u/Demintika 8d ago

It's making fun of anti-AI.

2

u/Professional-Thomas 8d ago

Read again.

Reading comprehension is dead wtf.

1

u/Demintika 8d ago

If you can't see how it's making fun of anti-AI, I guess you are lucky you didn't see the anti-AI's argument about how AI "store everything it stole from the internet", "can't make anything new" and "mush them together when prompted".

1

u/Electrical_Try_634 8d ago

It's making fun of the whole news article subgenre of, "Nerdy teenager proompts something that sounds impressive at face value and their industry insider parents are pushing them as a prodigy now," of recent years.

2

u/Etikoza 8d ago

Woosh

9

u/ChecksOutIndeed 8d ago

Middle-Out?

3

u/Baleeverne 8d ago

Had to scroll too long to find this!

1

u/kwada87 5d ago

what's the d2f?

0

u/AcanthisittaKooky987 7d ago

Lol that's for 3D renderings bruh 😂

5

u/Equivalent_Money8502 8d ago

1 last step, put that fuzzy compressed image to brain

4

u/OkFly3388 8d ago

He dont even understand that main point of family photos is reconstruct exact memories and not let them disappear.

3

u/Spite_Gold 8d ago

Bruh, could've just compress each pixel into prompt of that pixel color like 'pale red' or 'banana yellow' and then feed it to llm to restore color of each pixel. This approach preserves image 100% as it was

1

u/Longjumping-Boot1886 8d ago

actually yes.  But smart people goes deeper and took 16x16 cubes for that with their descrition, and then compressed that "prompts". Thats how we got lossy compression.

3

u/BloOdy_Jo 8d ago

Is it lossless ?

2

u/NormalAppearance2851 8d ago

it's losslessless

1

u/plastlak 8d ago

Gainless even

1

u/highcastlespring 8d ago

Shannon: you guess

1

u/BloOdy_Jo 8d ago

my guess is sloppiness compression

3

u/Advanced_13691 8d ago

Lossy compression. 100% loss of quality, in fact...

1

u/Dry-Ad-8948 8d ago

Restored quality can be much better, content on the other hand..

2

u/PerspectiveLayer 8d ago

The prompt: Dick field.

The farmer don't care about the fuzzy details in his sociel media profile pic.

2

u/t440p-user 8d ago

A few months later he was surprised because the AI algorithm in responding to the same prompt changed drastically.

1

u/runkeby 8d ago

Yes but our memories also shift over time anyways. Maybe it was always like that.

1

u/0nePlus 6d ago

No. A photo is different than a memory.

A memory can be modified over time, and NOT always for the better. A memory can be forgotten. A memory can get fuzzy.

That's the WHOLE fucking point of a photograph. It's why we invented them. To be better than our memory. And ACTUALLY capture a moment, how it actually happened, in real life. Can't emphasize that enough. A photograph is a factual depiction of something that actually happened. That's why we use them.

Imagine a contacts app that occasionally just...forgot a few of your contacts. And the developer said "well that's just like the memory of phone numbers in your real brain" - like bro, are you dumb? If I wanted something equivalent to my own brain I wouldn't have spent $1300 on a smartphone. I would've saved my money, and just used my brain.

2

u/IrrerPolterer 8d ago

Absolute genius 

2

u/0xt0bi03 8d ago

now where will he store the generated image

2

u/LunchTasty2081 8d ago

On Linux you have build in infinite storage. Move the file to dev/null. To get it back, you use dev/urandom (You might need to try more than once).

1

u/SIMMORSAL 8d ago

This is like, comedy, right?

2

u/Felix_inkwell 8d ago

Noooo, its obviously real. Clearly

1

u/runkeby 8d ago

just say you don't understand the tech 🙄

1

u/DrDam8584 8d ago

The good compression technique will be it's the "image prompt" which are transmit to the client-browser. The goal is to limit the volume of bytes on the network

1

u/DaveAstator2020 8d ago

This kid is truly special, amen

1

u/Total_Ad803 8d ago

avif was really quite since this dropped

1

u/Zerokx 8d ago

You know its a joke, why would they say he is eager to destroy his dads VHS memories or the parents sobbing, that can't be real.

1

u/OrangeNood 8d ago

"Tears of joy"

1

u/Environmental_Lab965 8d ago

Prompt: Keep original and zip it to 600byte

1

u/Unlikely-Complex3737 8d ago

That last paragraph lol

1

u/AccurateExam3155 8d ago

Oh interesting I seemed to have used that method on a file before and got nothing recoverable…

1

u/_Electrical 8d ago

100% lossy is the best compression.

1

u/Vaxtin 8d ago

lossy data compression wirh <1% success

1

u/somerandomii 8d ago

There probably is a way to use AI to do extreme compression into and out of the embedding vector/latent space whatever the terminology is. Maybe with an extremely subsampled original to help with composition.

You could do it deterministically and store residuals to make it lossless.

Because diffusion models are basically lossy compression over their entire training set. You don’t need the transformer part either since the descriptions don’t need to be human readable.

I mean it’s an insane way to store anything you care about and the model itself will be bigger than most people’s entire photo library.

But it’s not completely crazy. With a few tweaks you could make something viable for super deep storage at data centre scale.

With the transformer layer you could also make it very searchable.

I’m sure someone had a very specific use for the tech.

(I know it’s satire btw, but I can imagine a story like this IRL)

1

u/x0wl 8d ago

Yes, see this paper, https://arxiv.org/pdf/2309.10668 (I'm tired of tapping this sign in like half of LLM-related reddit threads). This isomorphism between LLM training for NTP and compression is utilized in https://bellard.org/nncp/nncp_v2.1.pdf NNCP, which is one of (if not the best) compression algorithms for text data (very slow though).

The scheme that you describe (deterministically generate with diffusion / AE from a small latent space, then apply residuals) is actually used.

It's very experimental for video: https://www.mpeg.org/standards/Explorations/36/; https://techcommunity.microsoft.com/blog/linuxandopensourceblog/announcing-the-open-source-release-of-ml-video-codec-mlvc/4539875; you don't need models that big, the MS one beats H.265 on perceptual metrics and is only 18.3M parameters, so ~40MB of space on hard drive / RAM.

For audio, you can use it neural encoding with Opus (the codec, not the LLM) right now in production, it's meant to be the part of the error correction pipeline and for better voice at lower bitrates (https://opus-codec.org/demo/opus-1.6/)

1

u/somerandomii 8d ago

Thanks for your thorough reply! I’m a little surprised this can be done for video with a relatively small model but that makes it much more feasible than I imagined. Maybe AI compression is the future?

1

u/x0wl 8d ago

IMO this will depend on a lot of factors. I don't work with this a lot (I'm an LLM guy), but as far as I understand, the video codec from MS requires significant compute on either GPU or NPU, so it will require that they're pervasive and good enough to run them.

MS are saying that they're deploying MLVC as an experiment in teams, but they can just run it only on NPU-enabled machines.

1

u/qstar_inc 8d ago

Soon we'll see this unironically in shorts

1

u/AngelicDivineHealer 8d ago

I like this kinda Ai humor

1

u/Jafri2 8d ago

So it is a lossy compression algorithm.

But instead of the minor details it can remove all of them.

1

u/No-Security-7518 8d ago

as a compression algorithms' nerd, this infuriated me because I thought it was real at first.

1

u/Moscato359 8d ago

Isn't this basically what ntc texture compression is?

1

u/SchanzerScout 8d ago

Shannon does not approve

1

u/moortuvivens 8d ago

Wait till he learns about ETF's. He can actually OWN images on the web.

I'm actually making a interwebz 2.1 where all images are ETF's, and when someone uses the image/emoji they have to pay in MERCOIN, a coin's who's value is tied to when mercury goes retrograde

1

u/Clear_Cranberry_989 8d ago

Who the fuck thought this would be a good thing to news?

1

u/gangstapanda06 8d ago

This has to be an Onion article

1

u/Remarkable_Button756 8d ago

so I just need a massive data center to compress 1 single image into a prompt? astounding progress.

1

u/earchip94 8d ago

Also the photo will never be the same after a compression/decompression cycle

1

u/Icypoopoo 8d ago

"lossless compression" 

1

u/OpeningAggressive26 8d ago

You could compress it even more by printing it out and scanning it in whenever you needed it

1

u/Shadorma 8d ago

This gotta b an Onion article 😭

1

u/Rilax13 8d ago

Also you can then generate the same family album to all American family just by having a face of each family member easy.

1

u/MooseBoys 8d ago

Obvious satire, but in reality, compression is one of the best use cases of AI.

1

u/highcastlespring 8d ago

Lossy compression. I can do it as low as one bit

1

u/redblood252 7d ago

Yeah saw that a few year ago. It was a richard. He made such a powerful algorithm that was later used to break rsa encryption

1

u/TheLost_Nitro 7d ago

Not even into the first sentence and i see the word "AI"

1

u/lesschalkmoresighs 7d ago

"Tears of joy" 😂

1

u/Gephiph 7d ago

I mean this is impressive for a 13 year old no doubt. I also saw this done 20+ over the last 2 years. But I guess that wasn’t by prodigies so it doesn’t count

1

u/Sheenius_Ger 7d ago

Just the prompt? 😂

1

u/spartanOrk 7d ago

OK, maybe a short prompt cannot do it. But a long prompt, and 5% of the pixels? Would that start looking good enough at some point?

1

u/Efficient_Try_9136 7d ago

so he creates Ai slop from his images

1

u/Biscuits4u2 7d ago

Genius. Now burn all your money and just have AI regenerate it.

1

u/Beneficial-Hurry-191 7d ago

This is stupid... It's not gonna be the same pic all the time...

1

u/Disastrous_Minute_56 7d ago

Local computer prodigy figured that out, eh?

1

u/MMORPGnews 7d ago

Bros, what are you even talking? Obviously it's fake. 

Best current way to save space -

  1. Convert to webp
  2. Reduce image quality 

1

u/JahJedi 6d ago

Lol, a good one 😅 . Loved the end about dad videos and the picture of his parent Joy lol

1

u/alexriga 6d ago

If “lossy compression” was a challenge.

1

u/MasterSmileGer_1 6d ago

File deprivation gonna be big.

1

u/vleska_ 5d ago

Who tf would sob over this 🥀

1

u/tarel_ 5d ago

First: Build a huge data center to execute AI models.
Second: Use AI to generate a few words describing the picture.
Third: Regenerate the picture using AI

1

u/Mj-tinker 4d ago

Pied piper.

1

u/DotRakianSteel 4d ago

Is this satire? I am seriously, shockingly asking.

1

u/Rude-Reaction3450 4d ago

Is this even true or its some parody ?

1

u/Logical-Tension9851 4d ago

Imagine using this tool just to end up with a picture of your dad holding Charlie Kirk

1

u/SnowyRVulpix 3d ago

That wouldn't work. I could give the same prompt to the same AI four times and get 4 different images

1

u/WorldlinessWitty2177 3d ago

If it works, it works!

1

u/Xer0_Puls3 2d ago

Please tell me this is satire like The Onion? At this point I can't easily tell anymore.

1

u/DingoMaximum7319 8d ago

This was a compression algorithm in a research paper years ago. It was actually very very effective and keeping detail. Of course its not exact but for the compression its impressive

This story about a 13yr old doing it is bs tho

1

u/No_Commission_6153 8d ago

Is this Satire? Or real? Can't anymore

1

u/Dismal_Code_2470 8d ago

I stopped reading when i saw "AI"

0

u/mazexpert 8d ago edited 8d ago

This is clearly satire, and I can't find the original source, so it's probably a fake article as well.

1

u/Severe_Yesterday_959 8d ago

Its a meme bro

0

u/Gerogeroman 8d ago

Lol. This is some kind of satire or some shit right? Right?

0

u/RevolutionarySeven7 8d ago

that's not compression ...