User:StefanoZacchiroli/Content deduplication

From Software Heritage Wiki
Jump to navigation Jump to search

Some experiments on deduplicating contents at sub-file granularity using Rabin fingerprints.

Linux kernel, Git repo

  • origin: git.kernel.org, on 2018-01-06
  • 1.653.941 content blobs, for a total of 19 GB (compressed)