Lib.rs

› Search #chunking #content-defined-chunking #deduplicate #rolling-hash

  1. fastcdc

    (content defined chunking) in pure Rust

    v3.2.1 26K #content-defined-chunking #chunking #cdc

  2. chunkrs

    A high-performance, deterministic, flexible and portable zero-copy streaming Content-Defined Chunking (CDC) and hashing infrastructure library. Bytes in → Chunks & hashes out

    v0.8.2 #fast-cdc #deduplicate #chunking

  3. hexz-cli

    CLI tool for managing Hexz snapshots and datasets

    v0.5.0 #snapshot #dataset #zstd #encryption #vm #compression #deduplicate #web-server #python-bindings #content-defined-chunking

  4. clast

    Content-Defined Chunking (CDC)

    v1.0.2 #content-defined-chunking #fast-cdc #chunking #cdc

  5. mincdc

    A very simple yet efficient content-defined chunking algorithm

    v0.1.0 #content-defined-chunking #algorithm #chunking #cdc

  6. firecloud-storage

    Chunking, compression, and local storage for FireCloud distributed storage

    v0.2.0 #decentralized #p2p #privacy #messaging

  7. webpub

    Static website publishing with content-based deduplication

    v0.1.4 #deployment #static-site #cdc

  8. gearhash

    Fast, SIMD-accelerated hash function for content-defined chunking

    v0.1.3 13K #gear #hash #fast-cdc #chunking

  9. fastcdc-alt

    FastCDC (content defined chunking) implementation in pure Rust with an alternative API to the original crate

    v0.2.2 #chunking #fast-cdc #cdc

  10. hash-roll

    Rolling hashes & Content Defined Chunking (cdc)

    v0.3.0 380 #rolling-hash #incremental #split #cdc

  11. casq_core

    A minimal content-addressed file store using BLAKE3. (library)

    v0.12.0 #content-addressable-storage #backup #file-system-tool #filesystem

  12. fast-cdc

    A safe place for all your data

    v0.1.0 #cryptography #place-for-data

    13. Try searching with DuckDuckGo or on crates.io.

  13. rdedup-cdc

    Content defined chunking (and rolling hash) algos

    v0.1.0 #content-defined-chunking #rolling-hash #rdedup #rollsum #algos

  14. asuran-chunker

    A general API for describing types that can break data in to chunks in repeatable ways

    v0.1.6 #data-chunks #api #chunker #repeatable #asuran