Artur Marciniec - Fotolia
Why are object stores a good match for archival data storage?
Latency in object stores that stems from a large amount of metadata means the technology is better suited to non-transactional data.
Object storage is a software layer that sits on a commodity x86 server, which is why many vendors call it software-defined storage. The technology takes advantage of embedded storage inside that server, creates a node and then interlinks multiple nodes to create an object storage system across Ethernet.
Object stores, by definition, store data as objects. Even though it's writing to media, such as a hard disk drive or even flash -- in the form of blocks -- it interfaces to applications across TCP/IP using HTTP puts and gets, which are referred to as REST or a RESTful interface. Object storage adds a lot of metadata to every object. In fact, you have a lot of flexibility as to how you describe each object and the metadata stored with the data. This is in comparison to a file system, for example, where metadata is separated from the data and usually put in a database.
Due to that extra layer of processing, you have more metadata and process data between the application and the actual media you are writing to, which means you're adding latency. And because object storage tends to be slower than other types of storage, object stores are generally best suited for archival data storage, backup data and secondary data applications -- not frequently accessed applications or apps that have any kind of interactive or transactional requirement.
You could use object stores to replace large, secondary storage arrays and file-based storage arrays. Additionally, you can replace tape libraries, because object storage makes a highly resilient, highly durable, active archive and even a passive cold archive.
Object storage use cases aside from production data
Archival data storage, big data top list of object store use cases
Unstructured data growth pushes object stores beyond the cloud
Dig Deeper on Storage architecture and strategy
Related Q&A from Marc Staimer
NFS vs. CIFS vs. SMB: What are the differences?
There are stark differences among file sharing protocols NFS, CIFS and SMB. Compare access, application deployment, configuration and security, among... Continue Reading
How do storage scalability and elasticity differ?
Storage elasticity is less well known than scalability, but it helps admins with efficiency and cost. Both elasticity and scalability are key to ... Continue Reading
What is eventual consistency in object stores?
Eventual consistency in object stores can be an issue because object storage is spread over many nodes and up-to-date data may not always be ... Continue Reading