10 data storage issues and how to overcome them
Don't overlook or ignore these 10 data storage issues -- including those related to staff, security and cost -- as they could disrupt operations without the proper planning.
Data storage is perhaps one of the most ubiquitous elements in information technology. As artificial intelligence assumes a greater role in all aspects of IT, many challenges facing storage professionals must be considered. This article examines several of the most prominent issues and also offers a list of additional issues that must not be overlooked to ensure a robust data storage environment.
10 data storage issues
1. The role of AI
While the following issues are no less important, AI has quickly become an integral part of IT operations. As such, one challenge for organizations has become how to successfully make use of AI tools.
The key is finding out how AI can optimize data storage strategies and processes. For example, AI can enhance the use of tiered storage by analyzing data usage and storage patterns, then moving data into high-use or low-use tiers as needed. In addition, it can quickly identify potential malware that could impact storage resources, facilitate data compression and deduplication as well as automate various management functions such as data cataloging and cleaning. AI can examine storage trends and recommend when a change in the technology might be warranted. It can quickly transform data storage activities from reactive to proactive.
2. Protecting stored data
Data protection is among the top concerns of CIOs, CTOs and CISOs. Threats of cybersecurity breaches, particularly with ransomware, create data storage challenges for IT leaders. While network perimeter security is the first line of defense for data storage security, the potential always exists that employees with sufficient privileges or external threat actors could access secure data, use it, and possibly corrupt or destroy it.
Accessing stored data requires various techniques, such as the zero-trust security model with strong authentication methods to ensure the correct permissions. Security concerns are especially true if the company uses third-party storage. Encryption for data at rest and in transit is an important strategy to keep critical data safe. Backing up data to more than one storage location, such as a cloud vendor or alternate data center, provides an added layer of data security.
3. Choosing the right storage hardware and software
On-site data storage requires equipment racks, storage servers, storage devices (e.g., network-attached storage, RAID technology), power systems, network connectivity and a suitable operating environment that includes backup power and redundant HVAC systems. IT also needs adequate floor space for storage equipment racks and may also need a raised floor. Managed data storage, especially using the cloud, can reduce or eliminate the need for hardware and save money on floor space.
From a software perspective, many data storage products and services can manage available disk space and deliver effective storage management. These products can be applications in server OSes, standalone storage applications and even freeware that can handle small to medium storage requirements at a lower cost. The key is to know current and longer-term storage requirements, along with corollary activities such as data archiving and data recovery, before implementing a storage hardware, software or networking platform.
4. Finding experienced data storage professionals
Finding and retaining suitably qualified and experienced data storage employees is one of the most significant challenges. Lack of staffing means it might be necessary to reassign data storage duties to IT generalists or to an external resource, such as a cloud vendor that will manage the infrastructure.
Find employees who have a solid background with no security issues. When organizations use third-party data storage services, such as cloud-based storage, it must then worry about misconfigurations or management.
Search firms are an important source of qualified candidates. An organization's human resources department is a key partner to IT leadership. Candidates can also emerge from internal transfers and recommendations from staff. A succession planning program is an important strategy because it identifies and prepares candidates to take on new responsibilities, such as in data storage management.
5. Data protection and data management
The principal goal for data storage is to be able to access the data when needed, without fear that the data has somehow been altered, deleted, corrupted or stolen. This is especially important with the emergence of data protection standards and regulations. Perhaps the most significant is the EU General Data Protection Regulation (GDPR), which levies stiff penalties for noncompliance.
To alleviate these data storage issues and ensure compliance with regulatory requirements, acquire and deploy data protection and management software applications. This will ensure that stored data is available in its original form when needed. If an organization doesn't plan to access data for a while, it can archive data for future retrieval, such as for e-discovery required by litigation. Further, if IT no longer requires data, or it has been eclipsed by newer data versions, various applications can help destroy the data -- and even the storage device. AI greatly enhances data protection activities by automating the scanning and threat analysis process.
6. Scalability of storage resources
Storage media must be able to adapt to new business requirements. Storage components must be able to scale upward or downward. Storage capacity can be enhanced by updating or replacing device components, reconfiguring storage systems, and deploying off-site storage systems such as cloud storage or using an alternate data center.
Ease of scale is an important benefit of third-party storage, with no customer investments needed for additional racks, floor space, storage devices or software. Admins can confirm the need for scalability during the ongoing process of assessing short- and long-term data storage requirements. AI can help here by analyzing storage trends and recommending when a change is advisable.
7. Managing and optimizing costs
Storage costs can be a large portion of an IT department budget. The cloud continues to grow in popularity because it can reduce or eliminate key overhead and capital expense costs. Cloud users must carefully weigh the costs associated with cloud storage versus in-house storage.
An organization that uses the cloud might need less equipment, floor space, power and staff than one that primarily uses on-site storage. Use of open source storage software and refurbished equipment can also keep costs under control.
8. Ensuring access to data in a disaster situation
Disruptive events that impact data storage, such as a cyberattack, could threaten access to data as well as the data’s integrity. Ensure that the organization can quickly and securely recover data and technology resources needed to run the business following the onset of a disruptive event. Secure data storage is increasingly important in the event of security breaches, especially ransomware attacks.
Access to data in a disaster recovery situation is an important part of IT operations. Organizations might store backup data on-site, off-site or a combination of the two. Frequently testing data access and retrieval in an emergency is an important part of that strategy.
9. Consistent data storage testing
Testing and troubleshooting help identify glitches or bugs in any of the storage infrastructure. Failure to regularly test and verify that IT properly stores data could cause storage problems in a real disaster event. It could also be a potential compliance issue when dealing with data protection regulations.
Testing, especially when using tools with AI capabilities, increases the likelihood of identifying and fixing data storage issues and optimizes performance to prevent a major disaster. This is especially important when the organization uses cloud storage for all or part of its storage requirements.
10. Data storage patching
Patching is one of the most important IT activities, as it ensures all infrastructure elements run optimally and use the most current software releases. Failure to keep data storage infrastructure elements properly patched could result in a system failure or interruption at a highly inopportune time.
When using third-party storage, the vendor must provide updates on its patching activities to its customers.
Additional data storage issues to address
The above issues are among the most important for IT storage professionals to address. Table 1 lists more issues and why they are important.
Summary
As noted in this article, IT leaders and data storage professionals face many significant challenges in the course of managing storage infrastructures. Robust and proactive storage strategies, use of AI and related tools and well-trained employees all contribute to successful data storage management.
Paul Kirvan, FBCI, CISA, is an independent consultant and technical writer with more than 35 years of experience in business continuity, disaster recovery, resilience, cybersecurity, GRC, networking and technical writing.
