Data Management
Top Stories
-
Opinion
31 Jul 2026
AI value comes from continuous learning, not automation
The companies pulling ahead in AI aren't doing it by deploying more tools. Rather, they're building the data foundations that make intelligence reusable, scalable and reliable. Continue Reading
-
Tip
31 Jul 2026
Integrate structured and unstructured data for better AI outputs
For AI agents to give the most accurate, informed responses, organizations must provide them with all the facts. Even those that are hidden in an old email or customer claim. Continue Reading
-
Feature
30 Nov 2018
Don't let blockchain complexity bog down business applications
Enterprise blockchain applications that run in a controlled environment don't require some of the components of cryptocurrency networks, explains expert David Teich. Continue Reading
-
News
30 Nov 2018
Amazon Timestream, QLDB aim to grab more DBMS users for AWS
Built-for-purpose databases target general ones, especially in the cloud. At re:Invent 2018, AWS added time-series and transaction ledger databases to expand its line. Continue Reading
-
Podcast
27 Nov 2018
Microsoft Azure SQL Database and Oracle 19c start to rev
A new Microsoft Azure SQL Database Managed Instance service seeks to span the gap between cloud and on-premises systems. Meanwhile, Oracle also has cloud plans of the data kind. Continue Reading
-
Tip
20 Nov 2018
Trifacta data prep tool helps blend disparate data sources
Handling diverse data sources usually consumes precious developer time. That led healthcare CRM company SymphonyRM to hand the data prep task to business analysts. Continue Reading
-
Tip
16 Nov 2018
How data duplication in healthcare is diagnosed
Electronic health record systems have helped reduce duplicate patient data in hospitals -- but they haven't cured the problem. Find out how organizations are addressing the issue. Continue Reading
-
Tip
15 Nov 2018
5 FAQs on SQL Server containers and how to manage them
Running SQL Server in containers creates new challenges for database administrators. The answers to these questions can guide you through some of them. Continue Reading
-
Tip
15 Nov 2018
The Power BI-PowerShell cmdlet cheat sheet
DBAs can manage Power BI data sets, workspaces and reports with PowerShell. Using the two tools together makes for a more efficient and effective workflow. Continue Reading
-
Definition
13 Nov 2018
Azure Data Studio (formerly SQL Operations Studio)
Azure Data Studio is a Microsoft tool, originally named SQL Operations Studio, for managing SQL Server databases and cloud-based Azure SQL Database and Azure SQL Data Warehouse systems. Continue Reading
-
News
06 Nov 2018
IBM-Red Hat deal highlights changes due in data processing
The IBM acquisition of Red Hat marks a watershed in computer architecture. The duo says it can rebuild data applications in new ways. This news analysis explores what's coming. Continue Reading
-
Feature
31 Oct 2018
The most useful new features in Microsoft SQL Server 2019
SQL Server 2019 includes welcome new features, particularly updates to its indexing and high availability capabilities and added SQL Server on Linux functionality. Continue Reading
-
Tip
31 Oct 2018
How to build a master data index: Static vs. dynamic indexing
Expert David Loshin explores the differences between static and dynamic indexing in master data management systems, and which queries each approach can support. Continue Reading
-
Tip
31 Oct 2018
How deterministic and probabilistic matching work
Expert David Loshin explores the benefits and challenges of the two classes of record matching in master data management systems: deterministic matching vs. probabilistic matching. Continue Reading
-
Quiz
30 Oct 2018
SQL vs. NoSQL: What do you know about the database designs?
The decision to use a SQL database or a NoSQL database can be made wisely only if the ins and outs of both are understood. See how well you know the database architectures. Continue Reading
-
Feature
23 Oct 2018
Neo4j graph database targets AI use cases, performance
The Neo4j graph database is poised for use in AI applications, in which understanding data can stymie efforts. Recent updates target AI needs and performance issues. Continue Reading
-
Tip
16 Oct 2018
11 features to look for in data quality management tools
As the need for quality data has increased, so have the capabilities of data quality tools. Learn how collaboration, data lineage and other features enable data quality. Continue Reading
-
News
12 Oct 2018
MarkLogic Data Hub Service aims to ease cloud use of NoSQL DBMS
MarkLogic rolled out a cloud-service version of its NoSQL database management system, a move designed to make the technology more cost-effective for cloud users. Continue Reading
-
Feature
11 Oct 2018
Cloud buoys data microservices -- for on-premises systems, too
Data in a microservices architecture is percolating anew. This news analysis looks at IBM Cloud Private for Data and other means to harmonize data in public and private locations. Continue Reading
-
News
04 Oct 2018
Cloudera-Hortonworks merger narrows Hadoop users' options
Hadoop users will have fewer choices as big data rivals Cloudera and Hortonworks unite. But the new company may be more competitive with AWS and Google. Continue Reading
- E-Zine 01 Oct 2018
-
Podcast
27 Sep 2018
Big data platform broadens place in analytics architecture
Big data platforms stumbled a bit getting out of the prototyping stage. But a view from the Strata Data Conference in New York sees broader use in the offing. Continue Reading
-
Answer
27 Sep 2018
What is an enterprise data strategy?
Defining a data strategy can help focus an organization's data management initiatives -- but it isn't the same as data governance. Expert Anne Marie Smith explains why. Continue Reading
-
Tip
27 Sep 2018
The gradual evolution of master data management software
Master data management began with a bang, then hit roadblocks due to complexity. Now, MDM is shifting toward more pragmatic projects tied to data governance. Continue Reading
-
Feature
26 Sep 2018
Mining equipment maker uses BI on Hadoop to dig for data
BI on Hadoop is still new, but moving BI to data is trending. A data scientist working with IoT data at Komatsu sees the importance of getting big data to the right people. Continue Reading
-
Opinion
21 Sep 2018
5 trends driving the big data evolution
The speedy evolution of big data technologies is connected to five trends, including practical applications of machine learning and cheap, abundantly available compute resources. Continue Reading
-
Tip
17 Sep 2018
4 strategies to beat the SQL Server 2008 support cutoff
The looming end of SQL Server 2008 extended support should spur database teams into action. Consider these four options to extend security updates or migrate your aging SQL Server systems. Continue Reading
-
News
13 Sep 2018
Containers key for Hortonworks alliance on big data hybrid
Hortonworks is joining with Red Hat and IBM to work together on a hybrid big data architecture format that will run using containers both in the cloud and on premises. Continue Reading
-
Answer
12 Sep 2018
What is the best structure for data governance programs?
The optimal approach to a data governance framework includes a program team, a data governance council and stewards. Expert Anne Marie Smith explains what role each group plays. Continue Reading
-
News
07 Sep 2018
Big data tooling rolls with the changing seas of analytics
Hadoop data tooling is expanding. A view holds that Hadoop is moving from alternate data warehousing to a full-fledged big data analytics offering. Continue Reading
-
News
04 Sep 2018
Graph processing gives credit analysis firms an edge
A graph database startup's parallel loading, processing and querying combine to deliver real-time data for fintech firms that offer fast credit evaluations online. Continue Reading
-
Tip
30 Aug 2018
SQL Server high availability best practices in the cloud
The cloud isn't immune to system failures. You can increase database uptime and prevent data losses with these high availability best practices for SQL Server in the cloud. Continue Reading
-
Answer
30 Aug 2018
5 to-dos for your GDPR compliance checklist
It's never too late to fine-tune your GDPR strategy. Expert Anne Marie Smith suggests a current state analysis of your PII protections, drafting a data privacy policy and more. Continue Reading
-
News
16 Aug 2018
Chief data officer skills tested by AI tech blitz
A reporter's notebook from a recent MIT symposium provides insights on chief data officer needs, as the AI wave starts to hit CDOs and affects them more than most other tech trends. Continue Reading
-
Feature
16 Aug 2018
Open source RDBMS uses spurred by lower costs, cloud options
Open source technologies have become more capable alternatives to mainstream relational databases for cost-conscious users -- and the cloud makes them more accessible. Continue Reading
-
Tip
16 Aug 2018
2 ways to attach SQL Server database files to Linux containers
SQL Server files can be stored outside of Docker containers in host directories or volumes. Here's how to set up SQL Server on Linux databases and attach them to containers. Continue Reading
-
Tip
15 Aug 2018
Why data quality tools matter in today's organizations
Data is everywhere -- but is it good? Data quality tools could answer that question and help save time and money. So why don't more organizations use the technology? Continue Reading
-
Tip
09 Aug 2018
GDPR checklist items data managers might have overlooked
Now that the General Data Protection Regulation has been implemented, it's a good time for organizations to make sure they haven't missed any GDPR best practices. Continue Reading
-
News
08 Aug 2018
Confluent Platform 5.0 aims to mainstream Kafka streaming
Confluent Platform updates seek to bring data streaming with Apache Kafka to a wider audience. A new GUI and user-defined functions are part of the 5.0 release. Continue Reading
-
Feature
02 Aug 2018
Open source DBMS software gains foothold in enterprise IT
Open source databases are increasingly making their way into corporate IT environments, says Gartner analyst Merv Adrian in a Q&A. But some care is required. Continue Reading
-
Feature
31 Jul 2018
How to manage data and the GDPR right to be forgotten
The General Data Protection Regulation requires organizations to delete personally identifiable information if customers ask -- which can be a challenge. Experts offer four tips. Continue Reading
-
Tip
24 Jul 2018
How to attach databases to custom SQL Server containers
Deploying SQL Server in Docker containers for production applications typically requires custom containers. Here are guidelines on how to attach databases to them. Continue Reading
-
News
19 Jul 2018
Focus, scope and spotting opportunity are key to role of CDO
Chief data officers and experts see the CDO role as changing to a more strategic orientation -- especially finding key opportunities in vast troves of data. Continue Reading
-
Tip
19 Jul 2018
Good data quality for machine learning is an analytics must
As companies add machine learning applications, they need to really understand -- and be able to improve -- their data. That's where data quality initiatives come in. Continue Reading
-
Tip
17 Jul 2018
Six sample databases for SQL Server and how to find them
SQL Server sample databases are useful for test and dev, but they can be difficult to parse. Use this SQL database sample overview to decide which to use and how to access them. Continue Reading
-
News
16 Jul 2018
Chief data officer role: Searching for consensus
The chief data officer role is about many things -- regulations, innovation, AI and more. Consultant Randy Bean discussed the matter ahead of an MIT symposium on the topic. Continue Reading
-
Tip
16 Jul 2018
A quick tutorial on SQL Server maintenance plans
SQL Server maintenance plans get a bad rap, but for DBAs who need a simple way to maintain databases, Microsoft's built-in tools are a good place to start. Continue Reading
-
Tip
13 Jul 2018
How graph data modeling can help evaluate database tools
Mapping data to a graph model can be challenging, but these steps can help you create prototype applications -- which then can aid in evaluating graph databases. Continue Reading
-
Feature
09 Jul 2018
eHarmony hooks up with Redis NoSQL database for hot storage
The Redis key-value store finds use in a system to match would-be romantic partners on dating site eHarmony, which employs a variety of NoSQL databases to make love click online. Continue Reading
-
Tip
06 Jul 2018
When to choose an S3 big data environment over HDFS storage
Selecting a storage service for big data in the cloud can be challenging. Expert David Loshin explains usage patterns that could lead organizations to Amazon Simple Storage Service. Continue Reading
-
Podcast
02 Jul 2018
Hadoop data governance services surface in wake of GDPR
GDPR influence is touching a Hadoop big data world that was immune to many privacy considerations until now. This podcast features the rise of Hadoop data governance for data lakes. Continue Reading
-
Tip
02 Jul 2018
The benefits of columnar storage and the Parquet file format
What's behind Apache Parquet's growing popularity? It may be the file format's columnar storage orientation, which leads to benefits including improved query performance. Continue Reading
-
Tip
28 Jun 2018
Four first steps for customer data management
Forrester's Mike Gualtieri details how to develop a unified plan to manage customer data that gives business users what they need to manage CRM programs. Continue Reading
-
News
27 Jun 2018
MongoDB 4.0, Stitch aim to grow NoSQL apps in cloud, on-prem
NoSQL vendor MongoDB upgraded its database software with ACID support, while also releasing a serverless platform intended to simplify application development. Continue Reading
-
Tip
27 Jun 2018
Three factors for protecting sensitive data in the GDPR era
Data privacy is a hot topic nowadays thanks to GDPR and the Facebook data scandal. But how do data security, access control and data protection differ? Continue Reading
-
Answer
26 Jun 2018
What's the difference between DDL and DML?
What's the difference between DDL and DML? Get the answer and see examples of data manipulation language and data definition language commands for SQL databases. Continue Reading
-
News
25 Jun 2018
Hadoop data lake architecture tests IT on data integration
Hortonworks users talk about building Hadoop data lakes to support new applications -- and the challenges their teams face on ingesting and refining data for end users. Continue Reading
-
News
18 Jun 2018
Hortonworks cloud options grow via Google, Microsoft, IBM
Hortonworks now supports Google Cloud Storage and has also broadened cloud deals with Microsoft and IBM, aiming to increase cloud uses of its big data platform. Continue Reading
-
Tip
18 Jun 2018
What goes into a customer analytics data integration framework
Customer data integration is a minefield for IT teams to navigate. But incorporating a set of core technical functions into an integration architecture can ease the process. Continue Reading
-
Tip
18 Jun 2018
Data integration techniques to help keep BI data consistent
Data integration processes that aren't managed properly can create inconsistent data in BI and analytics applications. Here are some steps to avoid that problem. Continue Reading
-
Feature
07 Jun 2018
Google Cloud data lake fuels cloud payment processing flow
To create a cloud payment processing system, Global Payments first had to deploy a data lake in the Google Cloud. Getting quick user feedback was another early step. Continue Reading
-
Tip
05 Jun 2018
Why Spark DataFrame, lazy evaluation models outpace MapReduce
Learn how the Spark DataFrame execution plan works and why its lazy evaluation model helps the processing engine to avoid the performance issues inherent in Hadoop MapReduce. Continue Reading
-
Podcast
01 Jun 2018
Starburst finds new worlds to conquer with SQL query engine
Relational databases may have hit a wall of late, but the SQL query engine seems poised for wider growth. Starburst, a retro startup of sorts, is among those looking to take it wider still. Continue Reading
-
Opinion
24 May 2018
GDPR compliance requirements drive new winds of data privacy
Hello, GDPR. May 25 is the witching hour for enforcement of the EU's much-discussed GDPR compliance requirements -- and it's a harbinger of more changes to come. Continue Reading
-
Tip
24 May 2018
Six data risk management steps for GDPR compliance
By layering data risk management processes into your data governance framework, you can ensure the personally identifiable information your company stores meets GDPR compliance rules. Continue Reading
-
Feature
22 May 2018
AP uses data.world platform to spread data journalism
Data journalism reporters need tools that deliver quick context for stories on deadline. A data collaboration platform from data.world helps the Associated Press meet such needs. Continue Reading
-
Feature
11 May 2018
GPU databases bring greater parallelism to big data processing
GPU databases offer a new way to process data. 451 Research analyst James Curtis discusses where they fit in big data applications, particularly for parallel processing. Continue Reading
-
Feature
08 May 2018
CockroachDB database wagered on for scalability boost, GDPR
CockroachDB is an open source distributed database designed for processing on a global scale, a need that online gambling company Kindred Group hopes it can meet. Continue Reading
-
Tip
19 Apr 2018
Why running SQL Server on Docker is no longer frowned upon
Microsoft now lets SQL Server databases run in Docker containers, a capability that depends on using volumes to store data in a persistent way outside the containers. Continue Reading
-
Feature
18 Apr 2018
What the Microsoft GDPR compliance toolkit offers for SQL Server
The set of GDPR compliance tools that Microsoft offers for SQL Server is designed to make it easier for users of the database software to adhere to the EU's new data rules. Continue Reading
-
Tip
16 Apr 2018
GDPR rules can spur broader steps to protect sensitive data
Companies need to make compliance with GDPR's requirements on managing personal data a priority, but they should also work to implement wider data protection efforts in the future. Continue Reading
-
Feature
09 Apr 2018
Data integrity protection spurs greater security spending
As hacking, ransomware and malware attacks mount, companies place big data protection and integrity among the primary reasons for increased spending on security software. Continue Reading
- 09 Apr 2018
- 09 Apr 2018
- 09 Apr 2018
- 09 Apr 2018
- 09 Apr 2018
-
Feature
09 Apr 2018
GDPR requirements put focus on data ethics, governance
The General Data Protection Regulation makes privacy paramount and reinforces the practice of good data governance. Will a new focus on data ethics be an important side effect? Continue Reading
-
Opinion
09 Apr 2018
U.S. data protection laws fall short in the age of big data
Data breaches and a history of data abuse led the EU to adopt GDPR, but it might take massive scale data security crises for the U.S. to legislate similar data protection laws. Continue Reading
-
Feature
09 Apr 2018
IT teams take big data security issues into their own hands
Data security needs to be addressed upfront in deployments of big data systems -- and users are likely to find they have to build some security capabilities themselves. Continue Reading
-
Feature
09 Apr 2018
Information architecture applied to big data streaming, AI
New technologies challenge data professionals, but taking a step back helps with hurdles. In this interview, consultant William McKnight takes a measured look at data streaming, GDPR and AI. Continue Reading
-
Feature
06 Apr 2018
Cloud workloads, data lakes challenge information architecture
Data management options are expanding; cloud workloads are an example. That means changing your approach to information architecture, says data management expert William McKnight. Continue Reading
-
Tip
30 Mar 2018
GDPR mandates push data quality improvement into IT spotlight
Data quality issues cost companies significant amounts of money in lost revenue and added expenses, and their impact will only get bigger when the EU starts enforcing its GDPR law. Continue Reading
-
Podcast
29 Mar 2018
Kubernetes container orchestration gets big data star turn
The new thing in big data is Kubernetes container orchestration. While it's still early, there are signs of activity, which are cited in this edition of the Talking Data podcast. Continue Reading
-
Feature
21 Mar 2018
Kubernetes gains momentum in big data implementation process
Big data vendors and users are looking to Kubernetes-managed containers to help accelerate deployments and enable more flexible use of computing resources. Continue Reading
-
Podcast
21 Mar 2018
IT, others focus efforts as GDPR implementation date looms
The EU's General Data Protection Regulation is meant to bring better data privacy to bear in the age of big data. How GDPR implementation will proceed remains to be seen. Continue Reading
-
News
15 Mar 2018
Streaming tool from StreamSets eyes data in motion for GDPR
StreamSets software for inspecting big data brings governance to data in motion. Such capabilities may find more use as the European Union's GDPR deadline looms. Continue Reading
-
Answer
14 Mar 2018
What does the GDPR definition of personal data include?
The definition of personal data in the EU's GDPR data protection rules is broad enough to include any type of data that can be used to directly or indirectly identify a person. Continue Reading
-
Feature
27 Feb 2018
Data expert: GDPR deadline is an opportunity, not a burden
There is stress as the EU's General Data Protection Regulation compliance deadline nears, but the GDPR privacy movement is a good thing for data policies, advises consultant Daragh O Brien. Continue Reading
-
Podcast
22 Feb 2018
Google TPUs open up on cloud; LinkedIn intros Hadoop Dynamometer
In big data news, we find Google TPUs, or Tensor Processing Units, offered as a cloud service, while LinkedIn is open sourcing a Hadoop test simulator called Dynamometer. Continue Reading
-
Definition
21 Feb 2018
TensorFlow
TensorFlow is an open source framework developed by Google researchers to run machine learning, deep learning and other statistical and predictive analytics workloads. Continue Reading
-
Feature
16 Feb 2018
Hyperledger Fabric offers path to enterprise blockchain future
Blockchain arose from bitcoin, but it's looking to find a place in the enterprise. Frameworks like Hyperledger Fabric could smooth out the technology's rough side for business uses. Continue Reading
-
News
16 Feb 2018
MongoDB 4.0 takes ACID transactions to multi-document level
MongoDB is taking a deeper step into SQL-style processing waters with a 4.0 update that brings increased support for ACID-compliant transactions to its NoSQL database. Continue Reading
-
Tip
13 Feb 2018
Data analytics architecture must break down higher ed silos
Siloed data isn't only a problem for businesses. It's also a big issue for many large universities -- one that their data infrastructures need to resolve for effective analytics. Continue Reading
-
Feature
06 Feb 2018
Data catalog software takes open data initiative to the streets
Data catalog software from Alation helped San Diego's chief data officer open up the city's data to residents, as well as city planners and other government workers. Continue Reading
-
Opinion
02 Feb 2018
Data managers should study up on GPU deep learning
As GPU deep learning becomes more common, data managers will have to navigate several new layers of complexity in their quest to build or buy suitable data infrastructure. Continue Reading
-
Tip
01 Feb 2018
Three ways to turn old files into Hadoop data sets in a data lake
Hadoop data lakes offer a new home for legacy data that still has analytical value. But there are different ways to convert the data for use in Hadoop depending on your analytics needs. Continue Reading
-
Podcast
23 Jan 2018
How AI and IoT will influence data management in 2018
AI and IoT will alter the data management landscape in 2018, according to analyst James Kobielus. AI will need regular updates, and DevOps will become more prevalent as a result. Continue Reading
-
News
03 Jan 2018
Apache Hadoop 3.0 goes GA, adds hooks for cloud and GPUs
Is this the post-Hadoop era? Not in the eyes of Hadoop 3.0 backers, who see the latest update to the big data framework succeeding in machine learning applications and cloud systems. Continue Reading
-
Feature
21 Dec 2017
How SQL Server containers in Docker can ease database deployment
Docker containers can make the SQL Server deployment process more efficient and flexible. Here's what they are and how to get started on creating containers for SQL Server databases. Continue Reading
-
Answer
27 Oct 2017
Dimension tables vs. fact tables: What's the difference?
Fact tables and dimension tables are used together in star schemas to support data analytics applications. But they play different roles and hold different types of data. Continue Reading
-
Feature
19 Oct 2017
NewSQL databases rise anew -- MemSQL, Spanner among contenders
The NewSQL database was almost hidden when Hadoop and NoSQL arose. Now, as more big data teams move toward production uses, MemSQL, Cloud Spanner and similar products may get a second look. Continue Reading
