#cloud-storage

  1. object_store

    A generic object store interface for uniformly interacting with AWS S3, Google Cloud Storage, Azure Blob Storage and local files

    v0.13.1 3.6M #cloud-storage #google-cloud-storage #storage
  2. slatedb

    A cloud native embedded storage engine built on object storage

    v0.10.1 45K #storage-engine #object-storage #embedded-database #cloud-storage #disk-cache #compaction #embedded-storage #rocksdb #bloom-filter #sst
  3. cloud-copy

    copying files to and from cloud storage

    v0.7.0 1.3K #cloud-storage #azure-storage #google-cloud-storage #azure-blob-storage #copying #aws
  4. cloudreve-cli

    Command-line interface for Cloudreve API

    v0.5.1 #cloud-storage #file-upload #storage #cloud
  5. redacter

    Copy & Redact cli tool to securely copy and redact files removing Personal Identifiable Information (PII) across various filesystems

    v0.15.1 1.0K #cloud-storage #redact #dlp #pii
  6. dropbox-sdk

    Rust bindings to the Dropbox API, generated by Stone from the official spec

    v0.19.1 800 #sdk #dropbox #cloud-storage #cloud #storage #cloud-sdk
  7. icechunk

    Transactional storage engine for Zarr designed for use on cloud object storage

    v0.3.21 #cloud-storage #zarr #database #xarray
  8. scfs

    A convenient splitting and concatenating filesystem

    v0.10.5 600 #split #cloud-storage #filesystem #mount-points #concatenating #mirror #fuse #daemon #file-transfer #concatenation
  9. pikpaktui

    A TUI and CLI client for PikPak cloud storage

    v0.0.28 #cloud-storage #tui #pikpak
  10. files-sdk

    Rust SDK for the Files.com API

    v0.4.0 600 #cloud-storage #storage-api #filescom #cloud #api-bindings
  11. aliyun-oss-rs

    A non-official Rust SDK implementation for Alibaba Cloud OSS

    v0.3.0 #alibaba-cloud #cloud-storage #object-storage #oss #bucket #rust-sdk #storage-api #async-native-tls
  12. htsget-storage

    Storage interfaces and abstractions for htsget-rs

    v0.5.6 #htsget #amazon-s3 #bioinformatics #local-storage #htsget-rs #cloud-storage #storage-abstraction #local-filesystem #data-url #storage-interface
  13. firebase-admin-sdk

    Firebase Admin SDK for Rust, enabling interaction with Firebase services (Auth, FCM, Firestore, Storage, etc.) from a Rust backend

    v0.2.4 #firebase-cloud-messaging #authentication #firestore #crash-reporting #sdk #remote-config #cloud-storage #user-management #rust-backend #signed-url
  14. nu_plugin_cloud

    A nushell plugin for working with cloud storage services

    v0.2.11+0.110.0 #cloud-storage #amazon-s3 #google-cloud #nu-shell-plugin #save #ls #aws #rm
  15. vsb

    Very simple in configuring, but powerful backup tool

    v1.1.10 #cloud-storage #backup #deduplicate
  16. aqueducts

    Unified meta-crate for the Aqueducts data pipeline framework

    v0.11.1 1.6K #data-pipeline #cloud-storage #etl-data-pipeline #etl-pipeline
  17. cachepot

    sccache-like tool. It is used as a compiler wrapper and avoids compilation when possible, storing a cache in a remote storage using cloud storage.

    v0.1.0-rc.1 #cloud-storage #ccache #sccache
  18. rs-ali-oss

    Rust SDK for Alibaba Cloud Object Storage Service (OSS)

    v0.1.6 #cloud-storage #object-storage #oss #alibaba-cloud #sdk #cloud-sdk
  19. reqsign-google

    Google Cloud Platform signing implementation for reqsign

    v2.0.2 18K #cloud-storage #reqsign #google-service #signature #sdk #google-cloud-platform #api-request
  20. helios-sof

    complete implementation of the SQL-on-FHIR specification for Rust, enabling the transformation of FHIR resources into tabular data using declarative ViewDefinitions. It supports all major FHIR versions (R4…

    v0.1.33 #view-definition #csv #parquet #fhir-path #json #ndjson #query-parameters #json-output #cloud-storage #zip
  21. qiniu-download

    Qiniu Resource (Cloud) Download SDK for Rust

    v2.0.4 2.2K #cloud-storage #cloud-sdk #qiniu #qiniu-sdk #sdk
  22. reqsign-aliyun-oss

    Aliyun OSS signing implementation for reqsign

    v2.0.2 120 #aliyun-oss #alibaba-cloud #reqsign #assume-role #bucket #cloud-security #token-service #sts #cloud-storage #oidc
  23. qcloud

    A CLI to operate Tencent cloud object storage

    v0.1.15 950 #cloud-storage #cos #qcos #tengxunyun
  24. ossify

    A modern, easy-to-use, and reqwest-powered Rust SDK for Alibaba Cloud Object Storage Service (OSS)

    v0.2.0 #cloud-storage #object-storage #alibaba-cloud #oss #oss-sdk
  25. restic-123pan

    Restic REST API backend server using 123pan cloud storage

    v0.2.8 #rest #restic #cloud-storage #server-api #back-end-server #authentication
  26. reqsign-tencent-cos

    Tencent Cloud COS signing implementation for reqsign

    v2.0.2 120 #reqsign #tencent-cloud #cos #signature #sdk #cloud-storage
  27. qcos

    Provide basic interface encapsulation of Tencent Cloud Object Storage (cos)

    v0.1.15 800 #cloud-storage #tencent-cloud #cos #tengxunyun
  28. reqsign-huaweicloud-obs

    Huawei Cloud OBS signing implementation for reqsign

    v2.0.2 110 #huawei-cloud #cloud-storage #obs #reqsign #signature
  29. any-storage

    Virtual FileStore Abstraction for different Backends

    v0.3.2 420 #file-store #cloud-storage #file-storage #filesystem #async-file #storage-abstraction #file-metadata #async-stream #local-storage #file-access
  30. zesty-backup

    A flexible, multi-provider backup utility for cloud storage

    v1.0.2 #cloud-storage #backup #storage
  31. aws_utils_s3

    AWS S3 utilities for common operations like listing, uploading, downloading, and deleting objects

    v0.3.1 #cloud-storage #storage-utilities #aws #cloud #storage
  32. cloud-filter

    A safe and idiomatic wrapper around the Windows Cloud Filter API

    v0.0.6 #winapi #cloud-storage #cloud-sync #remote-storage #file-explorer #hydration #native-api #storage-api #safe-and-idiomatic
  33. instrumented-object-store

    Object Store instrumentation through tracing

    v52.0.0 542K #object-store #cloud-storage #instrumentation #storage #tracing
  34. reqsign-oracle

    Oracle Cloud signing implementation for reqsign

    v2.0.2 #reqsign #oracle-cloud-infrastructure #sdk #signature #http-request #cloud-storage #infrastructure-services #azure-storage
  35. cloud-file-storage

    Cloud file storage server based on the Rust hyperlane framework, supporting multiple file types for upload

    v0.0.6 300 #cloud-storage #cloud #image #storage
  36. planetary-transporter

    The task input and output transporter used by Planetary

    v0.1.0 #task-execution #planetary #task-executor #tes #cloud-storage #transporter #storage-api #api-service #kubernetes-cluster #container-image
  37. megalib

    Rust client library for Mega.nz cloud storage

    v0.8.2 #cloud-storage #mega #file-transfer #meganz
  38. nc2parquet

    High-performance NetCDF to Parquet converter with cloud storage support

    v0.1.1 #cloud-storage #net-cdf #parquet #climate #data-conversion
  39. cloud-storage

    uploading files to Google cloud storage, and for generating download urls

    v0.11.1 123K #google-cloud-storage #google #api-bindings #storage
  40. cloud-storage-signature

    A Cloud Storage signature utils

    v0.6.25 150 #cloud-storage #google-cloud-storage #google #storage
  41. zarr-datafusion

    Extending DataFusion to do SQL queries on Zarr data

    v0.1.0 #data-fusion #zarr #sql #apache-arrow #coordinates #sql-table #arrow-schema #infer #statistics #cloud-storage
  42. turbo-remote-cache-rs

    A remote cache server for turbo

    v0.3.4 140 #turbo #cache #object-storage #azure-storage #remote #self-hosted #storage-provider #cloud-storage
  43. recoco-utils

    Common utilities for ReCoco, an all-Rust fork of CocoIndex with greater flexibility

    v0.2.1 #re-coco #retry #shared #immutability #key #concurrency #greater #web-api #building-block #cloud-storage
  44. cos-rust-sdk

    腾讯云对象存储 COS Rust SDK

    v0.1.2 #sdk #cos #cloud-storage #tencent #cloud
  45. mega

    An API client library for interacting with MEGA

    v0.8.0 800 #cloud-storage #storage-api #cloud
  46. mega-cli

    A command-line tool for interacting with MEGA

    v0.1.3 180 #cloud-storage #storage-api #cloud
  47. planetary-orchestrator

    The Planetary task orchestrator service

    v0.1.0 #planetary #task-execution #task-executor #container-image #tes #storage-api #cloud-storage #api-service #container-storage #kubernetes-cluster
  48. avl-storage

    AVL Storage - S3-compatible object storage optimized for Brazil and LATAM

    v0.1.0 #object-storage #cloud-storage #brazil #cloud #storage
  49. cos_upload

    uploading files to COS (Cloud Object Storage)

    v0.1.2 200 #cloud-storage #cos #rust #upload
  50. object-store-hedging

    Read request hedging for object-store

    v0.1.0 #object-store #cloud-storage #cloud #storage
  51. llm-shield-cloud-azure

    Azure cloud integrations for LLM Shield - Key Vault, Blob Storage, Azure Monitor

    v0.1.1 #cloud-storage #azure #monitor #azure-cloud #secret-storage
  52. quickwit-metastore

    Quickwit's metastore

    v0.3.0 #metastore #postgresql #quickwit #storage #search #big-data #logging #cloud-storage #search-engine #diesel
  53. cloud_filter_opendal

    Cloud Filter Integration for Apache OpenDAL

    v0.0.11 850 #opendal #cloud #filter #apache #integration #cloud-storage #sync-engine #tokio-runtime
  54. files

    CDN Origin Server for Cloud Storage

    v2.2.3 #amazon-s3 #cloud-storage #cdn #wasabi
  55. llm-shield-cloud-gcp

    GCP cloud integrations for LLM Shield - Secret Manager, Cloud Storage, Cloud Monitoring

    v0.1.1 #cloud-storage #gcp #cloud-monitoring #secret-storage #cloud
  56. quickwit-cluster

    Quickwit's cluster membership

    v0.3.0 #quickwit #cloud-storage #search-engine #distributed-tracing #storage-engine #log-management #logging #sub-second
  57. quickwit-storage

    Quickwit's storage abstraction

    v0.3.0 #amazon-s3 #cloud-storage #quickwit #search-engine #storage-abstraction #distributed-tracing #logging #storage-engine #log-management #storage-api
  58. quickwit-doc-mapper

    Quickwit index configuration

    v0.3.0 #quickwit #cloud-storage #search-engine #distributed-tracing #search-indexing #convert-json #logging #search-index #storage-engine #log-management
  59. quickwit-directories

    containing all of the custom tantivy Directory used in quickwit

    v0.3.0 #quickwit #search-engine #cloud-storage #tantivy #directory-cache #distributed-tracing #storage-engine #full-text-search #proxy #google-cloud-storage
  60. quickwit-config

    Quickwit configuration

    v0.3.0 #cloud-storage #quickwit #search-engine #amazon-s3 #distributed-tracing #logging #storage-engine #log-management #search-indexing #sub-second
  61. extio

    unified asynchronous I/O abstraction layer for Rust. extio provides a single trait (Extio) that defines common interfaces for files, networking, databases, cloud storage, IPC…

    v0.1.0 #ipc #metrics-collection #async-runtime #cloud-storage #abstraction-layer #signature-verification #logging-metrics #pub-sub #object-storage #embedded-database
  62. rust_filen

    Rust interface for Filen.io API

    v0.3.0 #cryptography #file-metadata #encryption #file-upload #io-api #user-key #file-encryption #uuid #cloud-storage #public-key
  63. quickwit-telemetry

    Quickwit's telemetry

    v0.3.0 #quickwit #search-engine #cloud-storage #telemetry #distributed-tracing #storage-engine #logging #log-management #sub-second
  64. swissknife-cloud-sdk

    Cloud storage SDK - AWS S3, Google Cloud Storage, Azure Blob, Dropbox

    v0.1.1 #cloud-storage #azure-blob-storage #google-cloud-storage #dropbox #aws-sdk #amazon-s3
  65. quickwit-indexing

    Quickwit indexing

    v0.3.0 #quickwit #packager #indexer #uploader #logging #tantivy #cloud-storage #search-engine
  66. quickwit-proto

    Quickwit's protos

    v0.3.0 #search-engine #quickwit #cloud-storage #distributed-tracing #logging #storage-engine #log-management #sub-second
  67. quickwit-common

    Util crate of quickwit

    v0.3.0 #quickwit #search-engine #cloud-storage #amazon-s3 #distributed-tracing #logging #storage-engine #log-management #metrics #sub-second
  68. deltalake-core

    Native Delta Lake implementation in Rust

    v0.30.2 29K #delta-table #storage #data-lake #cloud-storage #delta-protocols #data-table
  69. Try searching with DuckDuckGo.

  70. zn

    CLI for Files (Cloud Storage)

    v1.0.2 #cloud-storage #cdn #wasabi #cli
  71. distore

    Discord as cloud storage

    v0.3.0 800 #cloud-storage #discord #storage #cloud #cli
  72. quickwit-aws

    working with AWS

    v0.3.0 #cloud-storage #quickwit #search-engine #distributed-tracing #aws #storage-engine #log-management #logging #sub-second
  73. cloud-storage-lite

    flexible Google Cloud Storage client

    v0.1.9 700 #google-cloud-storage #cloud-storage #google #storage #api-bindings
  74. rivven-core

    Core library for Rivven distributed event streaming platform

    v0.0.16 #encryption #storage-engine #cloud-storage #tls #event-streaming #prometheus #cold-storage #lock-free-queue #statistics #streaming-platform
  75. gfapi-sys

    This crates provides FFI bindings for Gluster's API

    v4.0.1 110 #gluster #ffi #level #build #directory #cloud-storage #safe-abstraction #media-streaming #api-interaction #declaration
  76. bsud

    bsud auto-scale BSU volumes on Outscale's cloud

    v0.1.4 #vm #block-storage #cloud-storage #block-device #outscale #auto-scale #pv #lvm #vg #logging
  77. yab2

    Backblaze B2 Client

    v0.1.0-alpha.3 #b2 #cloud-storage #backblaze #storage #cloud
  78. ibmcloud-cos

    client / SDK for interacting with IBM Cloud Object Storage

    v0.5.0 #cloud-storage #client #ibm-cloud #cos
  79. ocloud

    Command line utilities for a self-hosted cloud

    v0.1.3 #cloud #self-hosted #command-line-utilities #path #server #cloud-storage
  80. active-storage

    Active Storage facilitates uploading files to a cloud storage

    v0.1.1 #cloud-storage #active #uploading #facilitate #mirroring #disk-based #in-memory
  81. esdump-rs

    Dump Elasticsearch indexes to object storage

    v0.1.1 #data-storage #elasticsearch #cloud-storage #google-cloud-storage #index #opensearch #azure-blob-storage #concurrency #object-storage
  82. flowrider

    High-performance PyTorch-compatible streaming dataset with distributed caching for on-the-fly remote dataset fetching

    v0.1.1 #stream #distributed #pytorch #cache #dataset #fetching #stream-data #on-the-fly #cache-data #cloud-storage
  83. warm-fs

    File system warmer

    v0.2.0 #thread-pool #warmer #filesystem #system #amazon-s3 #block-storage #cloud-storage #cloud-providers
  84. xuid

    in Rust

    v1.1.0 120 #xbox #cloud-storage
  85. any-object-storage

    Any object storage libraries

    v0.1.2 #object-storage #cloud-storage #sdk #vendor #storage-api
  86. rlist-drivers

    cloud storage driver for rList

    v0.1.3 190 #cloud-storage #driver #rlist
  87. firebase-store

    Async Rust SDK for Firebase Cloud Storage, enabling secure file uploads, downloads, and management

    v0.1.0 #cloud-storage #firebase #cloud
  88. list_with_depth

    List objects from object_store with the given prefix and depth

    v0.1.1 #object-store #cloud-storage #cloud #storage
  89. carbonado

    An apocalypse-resistant data storage format for the truly paranoid

    v0.6.0 1.7K #blockchain #storage #storage-formats #cloud-storage #p2p #bao #error-correction #paranoid #secp256k1 #unencrypted
  90. filebox

    Unified file (local, remote url, or cloud storage) box for easy easier management and manipulation

    v0.1.0-beta.0 #cloud-storage #file #wechaty
  91. quickwit-core

    Core crate of quickwit

    v0.3.0 #cloud-storage #search-engine #distributed-tracing #storage-engine #log-management #logging #sub-second
  92. file-box

    Unified file (local, remote url, or cloud storage) box for easy easier management and manipulation

    v0.1.0-beta.0 #cloud-storage #file #wechaty
  93. libdistore

    Distore

    v0.3.0 650 #distore #cloud-storage