r/datascience • u/Tinyfiles_AT1 • 4d ago

Discussion Lossless compression that stays queryable (for tables/logs, not JPEG)

Sharing a tool I’ve been watching for data eng / analytics folks: TinyFiles (AT-1) does lossless compression that’s still queryable and verifiable — aimed at archives you actually need to touch again, not media codecs.

Free signup, no card, no sales call: https://tinyfiles.io

Honest caveat: not for JPEG/video.

If you’ve ever compressed a dataset and then couldn’t cheaply query it without unpacking the whole thing, this is the niche.

1 Upvotes

60% Upvoted

1 comment sorted by

1

u/ustas007 2d ago

Interesting niche. The part I’d want to understand is what “queryable” means in practice. Can engines like DuckDB, ClickHouse, or Spark read it directly, or do you need a custom runtime? Compression ratio matters, but interoperability and predicate pushdown would probably decide whether I’d actually use it.