Distributed Storage OpenSource List

Distributed ID

• Unique Id generator : Id generator based on Twitter’s Snowflake.

• Twitter Snowflake Official Repo

• Leaf : Distributed ID Generate Service.

Distributed Lock

• Redis Based Lock: Redlock-rb, Redlock-php, Redsync.go, Redisson.

Distributed Consensus

• liferaft : Consensus protocol based on raft, but only for saving lifes and works in node as well as in browers.

• Dragonboat : Dragonboat is a high performance multi-group Raft consensus library in Go.

Distributed Storage

Distributed FS

• 2020-JuiceFS : JuiceFS is a distributed POSIX file system built on top of Redis and S3.

Object Storage

• 2015-linx-server : Self-hosted file/code/media sharing website.

• Image Server : An image server toolkit in Go (Golang)

• Blb : Blb is a distributed object storage system designed for use on bare metal with spinning disks in cluster computing environments.

• BFS

• TFS

• fastDFS

• MogileFS

• 2019-MinIO : MinIO is a high performance object storage server compatible with Amazon S3 APIs.

• 2019-Dragonfly : An Open-source P2P-based Image and File Distribution System.

• 2020-Garage : An open-source distributed object storage service tailored for self-hosting.

Block Storage