EUREKAR
Eurekar·TOP
捕捉真实世界的英语信号
24信息来源
13,843精选文章
168单词卡片
18照片图片
全部8,766口语2,186题库9,066免费1,238帖子4,786新闻6,579外刊291Books4Cards168图片18

Why haven't there been any significant advancements in compression in like 30 ye

为什么近 30 年来压缩技术没有取得任何重大进展

4chan /g/ · Anonymous · 2026-08-16 04:08 · 14 帖 · 原文 ↗

← 上一篇返回列表下一篇 →
#1 Why haven't there been any significant advancements in compression in like 30 ye / 为什么近 30 年来压缩技术没有取得任何重大进展
Anonymous · 2026-08-16 04:08

Why haven't there been any significant advancements in compression in like 30 years? New video codecs just find ways to make compression artifacts less perceptible but nobody is actually improving compression anymore. And lossless compression hasn't gotten better since the 90s. Is it just mathematically impossible for compression to get better or is there some technological breakthrough waiting to happen?

为什么近 30 年来压缩技术没有取得任何重大进展?新的视频编解码器只是找到了使压缩伪影不易被察觉的方法,但实际上没有人在改进压缩。自 90 年代以来,无损压缩一直没有变得更好。压缩变得更好是从数学上来说是不可能的还是有一些技术突破等待发生?

图片: https://i.4cdn.org/g/1786853319951496.jpg

↳ #2 No.109568816
Anonymous · 2026-08-16 04:16

>>109568780

i think the compression of any file is limited by its entropy, which is a measure formalized in information theory, and since this is a property of the file itself there's a hard limit on how good your algorithm can be. but i could be wrong since i didn't research it as much as i would have liked. if anyone knows i'd be fine with being lectured desu

我认为任何文件的压缩都受到其熵的限制,熵是信息论中形式化的度量,并且由于这是文件本身的属性,因此算法的性能受到严格限制。但我可能是错的,因为我没有像我希望的那样研究它。如果有人知道我会接受教训 desu

↳ #3 No.109568843
Anonymous · 2026-08-16 04:21

https://en.wikipedia.org/wiki/Kolmogorov_complexity#Compression

>Is it just mathematically impossible for compression to get better

>压缩变得更好在数学上是不可能的吗

Past a certain point, yes. The magic lays in determining that point.

过了某个点,是的。神奇之处就在于确定这一点。

↳ #4 No.109568879
Anonymous · 2026-08-16 04:27

>>109568780

Just check the quality of the programmers over time.

只要检查程序员随着时间的推移的质量即可。

↳ #5 No.109568893
Anonymous · 2026-08-16 04:30

What we need to do is start recording video so that the bits are all very early sequences found within pi. Then it will all compress really well.

我们需要做的是开始录制视频,以便这些位都是在 pi 中找到的非常早期的序列。然后一切都会压缩得很好。

↳ #6 No.109568997
Anonymous · 2026-08-16 04:48

>>109568843

Then drop math and use something else. Simple as.

然后放弃数学并使用其他东西。简单如。

NOTHING is impossible.

没有什么是不可能的。

↳ #7 No.109569114
Anonymous · 2026-08-16 05:10

for many kinds of compression we kinda just did most of the obvious stuff really quickly and most practical data compression uses require a balance between speed and ratio, so spending disproportionately more effort on tiny ratio bumps just doesn't make sense.

对于许多类型的压缩,我们只是很快地完成了大多数明显的事情,而且大多数实际的数据压缩用途都需要速度和比率之间的平衡,因此在微小的比率波动上花费不成比例的更多精力是没有意义的。

it's why modern algorithms like zstandard got popular quickly despite not even compressing as much as older formats, what makes zstandard so popular is because it has /good-enough/ ratios, meaning about as well as gzip, while being /way/ faster than gzip.

这就是为什么像 zstandard 这样的现代算法很快就流行起来,尽管它甚至没有像旧格式那样压缩,zstandard 如此受欢迎的原因是它具有/足够好/比率,意味着与 gzip 一样,同时比 gzip 更快/方式/更快。

it's like do you use zpaq and make the file 10% smaller but take 1000x more time to do it? probably not.

就像您使用 zpaq 并使文件小 10%,但需要花费 1000 倍的时间来完成?可能不会。

there is a theoretical maximum any file can be compressed to as well, so it's not a case of "not knowing what you don't know", either. actually reaching that maximum with any reasonable amount of time and complexity for any file is difficult. getting close enough faster is what most algorithms aim for since they have the most practical use

任何文件都可以压缩到理论上的最大值,所以这也不是“不知道你不知道的东西”的情况。实际上,对于任何文件来说,以任何合理的时间和复杂性达到该最大值都是很困难的。大多数算法的目标是更快地接近目标,因为它们具有最实际的用途

↳ #8 No.109569126
Anonymous · 2026-08-16 05:12

>>109569114

should add i'm just talking about general purpose lossless compression here (like zip/7z/xz/zstd/gz/etc).

应该补充一点,我只是在这里谈论通用无损压缩(如 zip/7z/xz/zstd/gz/etc)。

domain-specific lossless compression (like say flac) is a bit different, and lossy compression (h.264/av1/vorbis/mp3/etc) opens up many, many more options since those are as much subjective as they are mathematics.

特定领域的无损压缩(例如 flac)有点不同,有损压缩(h.264/av1/vorbis/mp3/等)提供了更多、更多的选择,因为这些选择与数学一样主观。

↳ #9 No.109569757
Anonymous · 2026-08-16 07:31

>>109568780

ANS powering your zstd compression format was invented in 2014, 12 years ago.

支持 zstd 压缩格式的 ANS 于 2014 年发明,距今 12 年前。

↳ #10 No.109569837
Anonymous · 2026-08-16 07:51

>>109569114

this and files have gotten bigger, what was tolerable compressing a 1GB file may not be tolerable compressing a 100GB file even with cpus getting faster

而且文件变得越来越大,压缩 1GB 文件可以容忍的程度可能无法容忍压缩 100GB 文件,即使 CPU 变得越来越快

↳ #11 No.109569919
Anonymous · 2026-08-16 08:12

>>109568997

Unless you find a better way to store the files than 1s and 0s you will not be able to fit more actual data into the same space, especially if the video isnt repetitive and its background changes a lot.

除非您找到比 1 和 0 更好的方法来存储文件,否则您将无法在同一空间中容纳更多实际数据,特别是在视频不重复且背景变化很大的情况下。

↳ #12 No.109569925
Anonymous · 2026-08-16 08:13

>>109568780

Because of low hanging fruits. You can't just keep compressing shit harder. It's like asking why we haven't found any bigger animals than the blue whale.

因为果实唾手可得。你不能只是继续更努力地压缩垃圾。这就像问为什么我们没有发现比蓝鲸更大的动物。

>inb4 seething

>等着看有人急眼

图片: https://i.4cdn.org/g/1786868015582255.jpg

↳ #13 No.109570329
Anonymous · 2026-08-16 10:14

LLM technology is literally compression. We just haven't used it widely as a compression algorithm yet.

LLM技术实际上就是压缩。我们只是还没有广泛使用它作为压缩算法。

↳ #14 No.109570349
Anonymous · 2026-08-16 10:19

>>109570329

dictionaries in compression has been a thing for ages. zstd supports dictionaries if you have data which benefits from it

压缩字典已经存在很多年了。如果您有可以从中受益的数据,zstd 支持字典

← 上一篇返回列表下一篇 →

(如果你觉得这篇文章有启发,可以点击这里付费)