Hacker News — vinext + Cloudflare Workers

new
past
show
ask
show
jobs
submit

▲Overfitted a 900KB Transformer to Compress a 100MB CSV into 7MB

8 points by spidy__ 2 days ago | 4 comments

tae0086 1 hours ago [-]

Neat approach. Since the 900KB model ships with the compressed file, is there a file size below which the model overhead just eats the gains? Curious where the crossover is.

7373737373 2 days ago [-]

What does it compress the full 1GB file to? http://prize.hutter1.net/

spidy__ 1 days ago [-]

I tried it on a enwik9 100 mb slice and was able to compress it to 20 mb + 900kb transformer so 21mb.

I know the top submission was able to get it to 13 mb.

Still trying some ideas to get better compression.

purple-leafy 18 hours ago [-]

That’s so awesome! I want to try something similar. I’ve been going crazy with compression work. I reckon I can beat that prize link

xunevega 1 days ago [-]

[flagged]

Rendered at 03:30:25 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.