alphaspirit - Fotolia
Decentralized data storage has emerged as a disruptor to traditional cloud storage and could represent a significant shift in the way organizations distribute and store data in the future. Numerous companies already offer decentralized storage options, some of which use blockchain technology to facilitate storage operations and validate transactions across a distributed network.
What is a decentralized storage network?
With decentralized storage, data is encrypted and stored across multiple locations, or nodes, that are run by individuals or organizations that share their extra disk space for a fee. Only the data's owner holds the private encryption key; storage providers cannot access the data. In many cases, the files are also sharded and spread across multiple locations, providing yet another layer of storage security.
Decentralized data storage products often use blockchain to track storage transactions. Blockchain is a distributed ledger technology that can automatically synchronize and validate storage transactions across distributed nodes. The blockchain ledger might record shard hashes, data locations, leasing costs or other transaction-specific information. Blockchain can also match users looking for storage with hosts that offer it.
What are the benefits of decentralized storage networks?
Decentralized storage networks can deliver many benefits. When an organization uses a decentralized network primarily for storage, the main benefit is cost. Decentralized storage networks act as a brokerage service between those who need storage and those who have extra capacity that they are willing to lease. As such, that storage tends to be inexpensive.
In many cases, decentralized storage networks are based on blockchain or similar technologies and deliver benefits such as data immutability, enhanced privacy and better overall security. Decentralized networks are resilient because the storage does not have a single point of failure.
Decentralized storage network vendors
Decentralized storage has been gaining traction in recent years and numerous options are already on the market. Most of these products rely on blockchain to support their storage strategies. However, blockchain and decentralized storage are not one in the same, and one can exist without the other. Here are seven decentralized data storage products to consider.
While some of the other decentralized data storage offerings focus primarily on privacy or on avoiding censorship and monitoring, Arweave is designed for data permanence.
Arweave itself is a blockchain-like peer-to-peer (P2P) storage protocol that offers extra storage capacities available on PCs acting as Arweave clients. The application that enables data storage and other functionality is called permaweb. The permaweb is an immutable environment for storing webpages and other types of data such as static files. Those who wish to store data are required to pay a one-time fee using AR tokens, which are available from most crypto exchanges.
Arweave is 100% community-operated and is designed to work only with Linux.
BitTorrent is one of the oldest and most well-known decentralized data storage networks. Founded in 2001, BitTorrent initially gained notoriety as a platform for sharing pirated media. Over time, however, BitTorrent evolved into an entire suite of products, including the BitTorrent File System (BTFS).
BTFS is a scalable decentralized storage system that is designed to reduce storage costs, improve fault tolerance and avoid government censorship. Like other distributed storage networks, BTFS relies on user nodes. One of the elements that distinguishes BitTorrent from some of the other networks, however, is that there are more than 100 million user nodes in place. Additionally, BTFS is blockchain-based and uses the TRON network. There are more than 1,000 full TRON nodes.
BTFS is a derivative of the InterPlanetary File System (IPFS) and is suitable for both file transfer and storage. Unlike the other decentralized data storage offerings, however, BTFS is designed in a way that enables users to remove any illegal or copyrighted media from their nodes.
Filecoin is widely known for having had one of the largest initial coin offerings of all time, raising $257 million in 2017. Filecoin is a P2P network service that uses blockchain and native cryptocurrency to deliver storage services.
The cryptocurrency, referred to as FIL, supports all transactions. Users pay FIL to store their files, and "miners," or storage nodes, earn FIL to store the files. The blockchain ledger records the transactions and provides proof that miners are storing files correctly. Filecoin is built on the IPFS, a P2P hypermedia protocol designed to address some of the limitations of using HTTP for distributed storage.
Filecoin pricing is not controlled by any single company; instead, it is an open market in which anyone can participate. Although this offers greater flexibility, it can make it difficult for organizations working within specific storage budgets, especially when trying to calculate "gas fees," which are charges for resources consumed by messages.
The Filecoin project is open source and encourages storage providers, consumers and developers to build apps on top of its file system. It is worth noting, however, that the Lotus nodes used by Filecoin are only supported on Linux and MacOS. Windows is not yet supported.
- MaidSafe and the Safe Network
MaidSafe is a small team of individuals who are building the Safe Network, an autonomous global network made up of storage nodes. Collectively, the software manages storage across the network, routing data and messages securely between the nodes. Nodes are clustered into sections that control the data stored within them. Section formation and data movement are all autonomous operations, without the need for centralized servers, agents or human oversight.
Anyone can join the network anonymously as a provider, subject to a resource test, and anyone can store data or access public information on the network. The Safe project also provides an API that developers can use to interact directly with the network.
Unlike Filecoin and other decentralized storage options, the Safe Network does not use blockchain or any type of public ledger, making it easier to scale the network while eliminating the need to synchronize ledger data across nodes. End users can use the client software to store data on the Safe Network. The software divides the data into a minimum of three segments, hashes and encrypts the segments, and then applies additional protections. Multiple copies of each segment are stored within a section to ensure redundancy.
Users pay in SafeCoin to store data. Hosts, or "farmers," receive SafeCoin for storing data. Those who need to store data can pay once, but store data forever. The Safe Network acts as a secure, universally accessible alternative to the World Wide Web. It has a goal to eliminate corporate and government tracking.
Like Filecoin, Sia uses blockchain to provide a decentralized data storage platform that encrypts and distributes files across a global P2P network. The Sia client software -- available for Windows, Linux and macOS -- breaks each file into 30 segments, which it then distributes to different hosts.
The software uses Reed-Solomon erasure coding to ensure redundancy and make it possible to recover a file from only 10 of its segments. The software also uses the open source Threefish algorithm to encrypt the segments before sending them to the storage hosts. Renters use Siacoin to purchase storage, and hosts use Siacoin as collateral when storing files.
Sia software is completely open source and includes an API that developers can use when building applications. Setting up Sia -- as either a renter or host -- is a straightforward, well-documented process, which makes it stand out from competitors.
Sia provides a decentralized storage marketplace in which storage providers compete for business. As a result, pricing is less predictable. According to Sia, 1 TB of storage should cost under $2 per month (paid with Siacoin), but renters should also be aware of additional costs, such as contract formation fees and bandwidth fees for uploading and downloading files.
- Storj and Tardigrade
Storj is one of Sia's top competitors and delivers similar services, including blockchain storage. However, there has been some confusion around Storj naming. Storj and Tardigrade refer to two different Storj Labs business areas. Storj focuses on the supply side and Tardigrade on the demand side. Node operators and hosts that offer storage participate in the Storj Network, which falls on the supply side. Users who purchase storage carry out transactions through the tardigrade.io website, which falls on the demand side. In other words, Storj node operators provide decentralized storage to Tardigrade customers.
Storj storage is S3-compatible, with data broken into smaller segments, encrypted using AES-256-GCM symmetric encryption and stored across the global network, like Sia. However, Storj breaks a file into 80 segments, and a customer can use any 30 of those segments to reconstitute the file. According to Storj Labs, Tardigrade storage is well suited to backups, archives, media content, hybrid cloud storage services, large file transfers, log files over 4 KB and database snapshots. Tardigrade also bills its service as decentralized cloud storage for developers.
Unlike other services, Tardigrade offers fixed pricing, making it easier to budget storage costs. The exact price depends on the amount of data the organization stores and downloads. For example, the free plan provides users with 150 GB of storage and up to 150 GB of bandwidth per month (50 GB per project). On the other hand, a pro plan costs $4 per terabyte of storage and $7 per terabyte of bandwidth.
The Utopia P2P network is designed to act as a tool for reclaiming online freedom and anonymity. It provides secure communications in a way that prevents government and third-party surveillance. Online communications are provided by Curve25519 high-speed elliptic curve cryptography, whereas local storage is encrypted with 256-bit AES.
Utopia supports two different cryptocurrencies -- Crypton and Utopia USD. Crypton is Utopia's preferred currency and is designed to be decentralized and untraceable, whereas Utopia USD is more stable because its value is tied to the U.S. dollar.
Utopia users store data in encrypted containers. Utopia defines an encrypted container as "encrypted, password protected storage of your Utopia data, such as your private key, uMails, uWallet, files, chat history, contacts and transactions history." Utopia is available on Windows, MacOS, Linux, iOS and Android.