Enterprise data architecture best practices
Top Stories
-
Feature
06 Jan 2023
18 top big data tools and technologies to know about in 2023
Numerous tools are available to use in big data applications. Here's a look at 18 popular open source technologies, plus additional information on NoSQL databases. Continue Reading
-
Feature
28 Dec 2022
10 top data architect and data engineer certifications in 2023
Learn what it takes to achieve and accelerate a rewarding career in data architecture and choose from among some of the best data architect and data engineer certifications. Continue Reading
-
Feature
15 Dec 2022
8 data integration challenges and how to overcome them
These eight challenges complicate efforts to integrate data for operational and analytics uses. Here's why, plus advice on how to deal with them. Continue Reading
-
Tip
14 Dec 2022
Weigh the benefits and drawbacks of a hybrid data warehouse
Among other benefits, a hybrid cloud data warehouse can offer enhanced flexibility and scalability, as well as on-demand access to emerging analytics services. Continue Reading
-
Feature
05 Dec 2022
What is a data warehouse analyst?
Data warehouse analysts help organizations manage the repositories of analytics data and use them effectively. Here's a look at the role and its responsibilities. Continue Reading
-
Feature
05 Dec 2022
Evaluating data warehouse deployment options and use cases
There's still a place for data warehouses in data architectures. But first, ask whether your organization needs one and what type of technology platform is the best fit. Continue Reading
-
Feature
18 Aug 2022
Evaluating the different types of DBMS products
The various types of database software come with advantages, limitations and optimal uses that prospective buyers should be aware of before choosing a DBMS. Continue Reading
-
Answer
27 Jun 2022
DBMS keys: 8 types of keys defined
Here's a guide to primary, super, foreign and candidate keys, what they're used for in relational database management systems and the differences among them. Continue Reading
-
Answer
07 Jun 2022
Data lake governance: Benefits, challenges and getting started
A data lake that isn't well governed may become more of a swamp. Here are key benefits and challenges of data governance in a data lake, plus initial steps to take. Continue Reading
-
Answer
01 Jun 2022
How to build a data catalog: 10 key steps
A data catalog helps business and analytics users explore data assets, find relevant data and understand what it means. Here are 10 important steps for building one. Continue Reading
-
Tip
26 May 2022
Top benefits of data governance for businesses
Effective data governance provides a variety of benefits to organizations, including improvements in operational efficiency, data quality and business decision-making. Continue Reading
-
Feature
17 Feb 2022
Hadoop vs. Spark: An in-depth big data framework comparison
Hadoop and Spark are widely used big data frameworks. Here's a look at their features and capabilities and the key differences between the two technologies. Continue Reading
-
News
20 Jan 2022
Coalesce launches with data transformation platform
The CEO and co-founder of Coalesce gives insight into the startup's mission and the challenges organizations face with transforming data so that it's useful for data analysts. Continue Reading
-
Feature
11 Oct 2021
Data architect skills required, responsibilities and salaries
When considering a career as a data architect, learn about the required skills and education, plus job responsibilities, salary ranges and typical interview questions and answers. Continue Reading
-
Quiz
31 Aug 2021
Quiz: Test your understanding of the Hadoop ecosystem
This quiz will test your knowledge of Hadoops basics including framework, capabilities and related technologies. Continue Reading
-
Feature
17 Aug 2021
Bill Inmon's data warehouse approach tackles text analysis
Learn the fine points of a concept at the heart of 'The Textual Warehouse' a new book that aims to help organizations profit through textual analysis. Continue Reading
-
Tip
30 Jul 2021
7 data modeling techniques and concepts for business
Three types of data models and various data modeling techniques are available to data management teams to help convert data into valuable business information. Continue Reading
-
Tip
28 Jul 2021
Data architecture vs. information architecture: How they differ
Data architects collect the statistics and information architects put the numbers into context as they work symbiotically to bolster an enterprise's data and business strategies. Continue Reading
-
Tip
23 Jul 2021
9 steps to a dynamic data architecture plan
Learn the nine steps to a comprehensive data architecture plan, including C-suite support, data personas, user needs, governance, catalogs, SWOT, lifecycles, blueprints and maps. Continue Reading
-
Tip
22 Jul 2021
6 key components of a successful data strategy
These six elements are essential parts of an enterprise data strategy that will help meet business needs for information when paired with a solid data architecture. Continue Reading
-
Tip
20 Jul 2021
5 principles of a well-designed data architecture
Here are five core data architecture principles to help organizations build a modern architecture that successfully meets their data management and analytics needs. Continue Reading
-
Tip
16 Jul 2021
How to build a successful cloud data architecture
As enterprises vacate the premises and migrate their operations skyward, a cloud data architecture can provide the long-term flexibility to improve workflows, costs and security. Continue Reading
-
Feature
15 Jul 2021
Edge-to-cloud architecture turns key for digital initiatives
Enterprises pursuing digital transformation initiatives may need to reexamine their infrastructure architecture to bring compute and storage closer to data generated at the edge. Continue Reading
-
Tip
13 Jul 2021
Data modeling vs. data architecture: What's the difference?
Data modelers and data architects have distinctly different roles, but they work in a complementary fashion to help enterprises unlock and capitalize on data's business value. Continue Reading
-
Feature
11 May 2021
How to build an all-purpose big data pipeline architecture
Like a superhighway system and its many on- and off-ramps, an enterprise's big data pipeline transports infinite amounts of collected data from its sources to its destinations. Continue Reading
-
Tip
07 May 2021
6 essential big data best practices for businesses
These best practices can help businesses put their big data strategy on the right track to meet analytics needs and produce the expected business benefits. Continue Reading
-
Feature
27 Apr 2021
Data quality for big data: Why it's a must and how to improve it
As data volumes increase exponentially, methods to improve and ensure big data quality are critical in making accurate, effective and trusted business decisions. Continue Reading
-
Feature
15 Apr 2021
Who belongs on a high-performance data governance team?
Putting together a high-quality data governance team can be a challenge. Explore the necessary team members and best practices for a high-performing team. Continue Reading
-
Feature
09 Apr 2021
Why consider an augmented data catalog?
Automated and augmented data catalogs have been around for a few years, but adoption is still lagging. Find out why an enterprise may consider investing in the technology. Continue Reading
-
Tip
05 Apr 2021
Data warehouse environment modernization tools and tips
A data warehouse environment is made up of many tools and systems. Read on to learn the history of the modern data warehouse and how they're currently evolving. Continue Reading
-
Feature
31 Mar 2021
Why consider an open source data catalog
Enterprise data catalogs offer organizations plenty of benefits with metadata management and data organization. Find out why some enterprises choose open source data catalogs. Continue Reading
-
Feature
30 Mar 2021
How a DataOps pipeline can support your data
DataOps has created a lot of hype as a data management pipeline because of its focus on collaboration and flexibility. Read on to find out how these priorities support your data. Continue Reading
-
Feature
26 Feb 2021
Open source database migration guide: How to transition
Open source database transitions have been on the rise as they prove to be worthy competitors to commercial database options, but that transition requires strategy and user buy-in. Continue Reading
-
Feature
22 Feb 2021
The top 5 graph database advantages for enterprises
Graph databases offer plenty of advantages to organizations in the way they connect data points to each other. Read on to see what experts say the top advantages are. Continue Reading
-
Feature
12 Feb 2021
Do you need a data warehouse for business intelligence?
Some organizations have moved away from using data warehouses in their business intelligence strategies. Read on to find out how approaches to data storage for BI are changing. Continue Reading
-
Feature
22 Jan 2021
Data fabrics help data lakes seek the truth
Data fabrics can play a key role in aligning business goals with the integration, governance, reliability and democratization of information collected in massive data lakes. Continue Reading
-
Feature
23 Dec 2020
New data warehouse schema design benefits business users
The Unified Star Schema is a revolution in data warehouse schema design. Learn the benefits of this new architecture and read an excerpt from a new book about it. Continue Reading
-
Feature
21 Dec 2020
Data warehouse vs. data lake: Key differences
Data warehouses and data lakes are both data repositories common in the enterprise, but what are the main differences between the two and which is best for your data? Continue Reading
-
Feature
10 Dec 2020
The top 6 use cases for a data fabric architecture
Enterprise data fabric adoption has been on the rise as a way to ensure access and data sharing in a distributed environment. Here are the top use cases for data fabrics. Continue Reading
-
News
08 Oct 2020
Denodo Platform 8.0 expands data virtualization features
The updated platform from Denodo looks to help organizations via enhanced features that connect and query disparate sources of data across different environments. Continue Reading
-
Feature
28 Aug 2020
Investment in talent key for data quality in healthcare
Investing in training employees on proper data gathering and management practices is crucial for healthcare organizations seeking to ensuring data quality and patient care. Continue Reading
-
Feature
29 Jul 2020
Key to data management in oil and gas is stability
Ensuring quality data management and analytics comes from following best practices, proper commitment from your organization and sticking with the plan. Continue Reading
-
News
08 Jul 2020
SODA Foundation launches to unify open source data management
A new Linux Foundation-sponsored group will support open source data management and promote interoperability between applications and data sources, on premises or cloud-based. Continue Reading
-
Feature
10 Jun 2020
Choosing a modern data warehouse to fit your data needs
Choosing the right modern data warehouse for your enterprise data is a large task. Here are the key evaluation points to consider when choosing your platform. Continue Reading
-
Feature
26 May 2020
Benefits of a data catalog and why you need one
Data catalogs help across enterprises, from breaking down data silos to ensuring data privacy. A new book from Technics Publications explains the benefits of data catalogs. Continue Reading
-
Feature
14 May 2020
Building a strong data analytics platform architecture
A strong analytics platform is key to meeting demands in a data-driven business. Read on for the key components your platform architecture should include. Continue Reading
-
Feature
08 May 2020
Top -- and bottom -- 5 Apache Kafka use cases
Apache Kafka has many applications in big data, but what enterprise use cases are the best fit for the tool? Experts discuss where Kafka works best for your data. Continue Reading
-
Feature
29 Apr 2020
Building a database application the DIY way
Business users experience the trials, tribulations and exultations of building a DIY DBMS, especially when IT expertise is not readily available or costs are too high. Continue Reading
-
Tip
09 Apr 2020
Developing an enterprise data strategy: 10 steps to take
Consultants detail 10 to-do items for data management teams looking to create a data strategy to help their organization use data more effectively in business operations. Continue Reading
-
News
24 Feb 2020
Lessons learned from Credit Karma GraphQL architecture
Credit Karma's vice president of engineering explains why and how the personal finance service is using the GraphQL data query technology to support its growing business. Continue Reading
-
Feature
12 Feb 2020
Data governance metrics: Data quality, data literacy and more
Statistics on data quality are the most common metrics used to track data governance programs, but other types of data-related measurements also can be applied. Continue Reading
-
Tip
10 Feb 2020
6 best practices on data governance for big data environments
Efforts to govern big data must corral a mix of structured and unstructured data. That's a challenge for most organizations. These six action items will help. Continue Reading
-
Tip
28 Jan 2020
Should you host your data lake in the cloud?
On premises or in the cloud: What's the better place for your data lake? Here are some things to consider before deciding where to deploy a big data environment. Continue Reading
-
Answer
21 Jan 2020
What are the main features of data catalog software?
Data catalogs are curated data portals for self-service analytics users. Learn about the capabilities of data catalog tools, vendors that sell them and how catalogs work. Continue Reading
-
Feature
13 Jan 2020
Analytics demands add loftier goals to data warehouse strategies
As the concept of storing data and the technologies needed to do it evolve, companies with set goals in mind are building their data warehouses to maximize analytics outcomes. Continue Reading
-
Feature
17 Dec 2019
Data catalog management for analytics fraught with unique demands
Data catalogs for analytics applications demand detailed assessment of user needs, cross-functional teams, ready access, continuous improvement and a self-sustaining system. Continue Reading
-
Feature
06 Dec 2019
Top database cloud migration considerations for enterprises
Many organizations are switching to cloud databases and big data platforms. But understanding what option best meets your data needs is an important first step. Continue Reading
-
Tip
08 Oct 2019
7 steps to a successful data lake implementation
Flooding a Hadoop cluster with data that isn't well organized and managed can stymie analytics efforts. Take these steps to help make your data lake accessible and usable. Continue Reading
-
News
30 Sep 2019
Cloud database services multiply to ease admin work by users
The list of vendors offering managed cloud database services is growing rapidly, which gives IT teams more opportunities to offload management of database systems. Continue Reading
-
Feature
25 Sep 2019
Database management tools from third parties make natives restless
Third-party database performance tools offer attractive alternatives to management software from DBMS vendors, provided their capabilities include orchestration, governance and integration. Continue Reading
-
News
29 Aug 2019
Align enterprise data architecture, governance for 'quick wins'
Data management consultant Donna Burbank outlines how effective data governance hinges on the deployment of a comprehensive enterprise data architecture. Continue Reading
-
Feature
27 Aug 2019
10 Apache Kafka best practices for data management pros
How can data management teams most effectively deploy and use Apache Kafka in data pipelines and streaming applications? Here are some key guidelines to follow. Continue Reading
-
Guide
21 Aug 2019
GDPR, AI intensify privacy and data protection compliance demands
This guide covers the challenges data management teams face on data protection and privacy, particularly with the rise of GDPR and similar laws and the growing use of AI tools. Continue Reading
-
Feature
20 Aug 2019
Enterprise data marketplace aims to ease self-service chaos
Self-service data preparation can duplicate work and slow down analytics. One possible fix: an internal marketplace where users can 'shop' for data assets. Continue Reading
-
Feature
13 Aug 2019
Data management roles: Data architect vs. data engineer, others
Veteran data pro Michael Bowers differentiates between key data management positions, including their salaries and which ones can add the most business value. Continue Reading
-
Feature
02 Jul 2019
Container technologies promise more agility for big data apps
Along with the ability to provide greater agility and flexibility for big data applications, containers can play a role in IT strategy that drives real-time decision-making. Continue Reading
-
Feature
27 Jun 2019
Data modeling techniques to overcome common business challenges
In this interview, author and data modeling instructor Steve Hoberman discusses techniques for dealing with challenges that may arise in the data modeling process. Continue Reading
-
Tip
20 Jun 2019
Building leaner, meaner BI data sources
As business intelligence analysis and reporting platforms become increasingly important in the enterprise, so does the data that feeds them. Are your BI data sources up to par? Continue Reading
-
Tip
18 Jun 2019
Data virtualization benefits seen in unified views, IT agility
Through in-place integration, data virtualization platforms can provide wider access to data and simplify security and governance. But they come with some limitations. Continue Reading
-
Feature
14 Jun 2019
Data virtualization use cases cover more integration tasks
In a Q&A, Gartner analyst Mark Beyer discusses user adoption of data virtualization software and the wider data integration uses that the technology is now handling. Continue Reading
-
News
31 May 2019
MapR's future in jeopardy, layoffs loom
It's right there in a MapR letter to California's labor department: A leader in the Hadoop market is desperately seeking funding after poor sales of its promising data platform. Continue Reading
-
Feature
10 May 2019
Data virtualization layer feeds logical data warehouse, Agile BI
Indiana University is using data virtualization to combine data from various source systems for analysis, as part of an initiative to improve strategic decision-making. Continue Reading
-
News
01 May 2019
Snowflake CEO Bob Muglia replaced by former ServiceNow CEO
Frank Slootman, who led ServiceNow and Data Domain through successful IPOs, is the new chairman and CEO of cloud data warehouse vendor Snowflake, replacing former CEO Bob Muglia. Continue Reading
-
Feature
30 Apr 2019
Data model design tips to help standardize business data
Data models should be understandable to business users and kept to a reasonable scope, say the leaders of a data modeling initiative at England's Environment Agency. Continue Reading
-
News
30 Apr 2019
Snowflake CEO Bob Muglia talks cloud data warehouse evolution
In this Q&A, now-former Snowflake CEO Bob Muglia discusses the vendor's decision to embrace cloud data warehousing and how the industry is changing as more data moves to the cloud. Continue Reading
-
Feature
29 Apr 2019
Wayfair charts open source components course to growth
Teams at Wayfair mix new open source tools to power customer-facing apps. In such shops, tech leaders like Ben Clark must deftly maneuver an obstacle course of data components. Continue Reading
-
Feature
17 Apr 2019
4 factors to consider in a Hadoop distributions comparison
Examine the key characteristics necessary to evaluate in a Hadoop distribution comparison, focusing on enterprise features, subscription options and deployment models. Continue Reading
-
News
04 Apr 2019
Tools manage performance for big data cloud applications
Tools such as Unravel and Pepperdata offer a way to measure performance of big data cloud applications, which may aid companies with on-premises configuration issues. Continue Reading
-
News
21 Mar 2019
Machine learning approaches gain critical mass for data pros
Machine learning will bring change to analytics and data management, said data luminary Michael Stonebraker. Others agree managing such change will take special effort. Continue Reading
-
News
15 Mar 2019
Big data management practices gain attention amid risks
Many data professionals have yet to solidify traditional data management practices, but they have a new set of challenges to overcome to ensure data privacy and avoid misuse. Continue Reading
-
News
12 Mar 2019
Aerospike database garners Spark, Kafka connectors
Apache Kafka and Apache Spark connectors ease use of the Aerospike NoSQL data store in high-speed applications such as analytics that are becoming more broadly supported. Continue Reading
-
Feature
06 Mar 2019
Augmented data management draws more enterprise interest
With AI and machine learning, organizations are starting to augment their data management. This is changing the way enterprise users capture, govern and integrate data. Continue Reading
-
Feature
25 Feb 2019
Explore Hadoop distributions to manage big data
Discover the uses of Hadoop distributions and the first steps in evaluating these products, as well as how the merger of rivals Cloudera and Hortonworks affects the market. Continue Reading
-
Feature
29 Jan 2019
5 data management infrastructure technologies to evaluate
It's the start of a new year -- is your organization ready to face the data management challenges ahead? Here are five technologies to consider adopting. Continue Reading
-
Feature
23 Jan 2019
Advantages of graph databases: Easier data modeling, analytics
Graph databases are finding a place in analytics applications at organizations that need to be able to map and understand the connections in large and varied data sets. Continue Reading
-
News
22 Jan 2019
New Teradata CEO pursues cloud-based architecture
Cloud architecture, analytics and AI data processing are top innovation priorities for new Teradata CEO Oliver Ratzesberger. He talks about his goals in this Q&A. Continue Reading
-
Tip
11 Jan 2019
Why organizations need a solid data governance strategy
The flood of data flowing into data warehouses, data lakes and other systems makes effective data governance a must for successful business analytics initiatives. Continue Reading
-
News
28 Dec 2018
Data management trends for 2019: Governance, DataOps, cloud
Better data governance, increased cloud use and wider DataOps adoption head the list of trends for data management teams to plan for in 2019, IT analysts say. Continue Reading
-
News
18 Dec 2018
Datawatch Swarm on path to combine data prep, analytics
Datawatch plans to add analytics and data visualization tools to its Swarm data preparation platform, starting with integration capabilities in a Swarm 2.2 release. Continue Reading
-
Feature
30 Nov 2018
Don't let blockchain complexity bog down business applications
Enterprise blockchain applications that run in a controlled environment don't require some of the components of cryptocurrency networks, explains expert David Teich. Continue Reading
-
News
30 Nov 2018
Amazon Timestream, QLDB aim to grab more DBMS users for AWS
Built-for-purpose databases target general ones, especially in the cloud. At re:Invent 2018, AWS added time-series and transaction ledger databases to expand its line. Continue Reading
-
Tip
31 Oct 2018
How to build a master data index: Static vs. dynamic indexing
Expert David Loshin explores the differences between static and dynamic indexing in master data management systems, and which queries each approach can support. Continue Reading
-
Feature
11 Oct 2018
Cloud buoys data microservices -- for on-premises systems, too
Data in a microservices architecture is percolating anew. This news analysis looks at IBM Cloud Private for Data and other means to harmonize data in public and private locations. Continue Reading
-
News
04 Oct 2018
Cloudera-Hortonworks merger narrows Hadoop users' options
Hadoop users will have fewer choices as big data rivals Cloudera and Hortonworks unite. But the new company may be more competitive with AWS and Google. Continue Reading
-
Podcast
27 Sep 2018
Big data platform broadens place in analytics architecture
Big data platforms stumbled a bit getting out of the prototyping stage. But a view from the Strata Data Conference in New York sees broader use in the offing. Continue Reading
-
Tip
27 Sep 2018
The gradual evolution of master data management software
Master data management began with a bang, then hit roadblocks due to complexity. Now, MDM is shifting toward more pragmatic projects tied to data governance. Continue Reading
-
Feature
26 Sep 2018
Mining equipment maker uses BI on Hadoop to dig for data
BI on Hadoop is still new, but moving BI to data is trending. A data scientist working with IoT data at Komatsu sees the importance of getting big data to the right people. Continue Reading
-
News
13 Sep 2018
Containers key for Hortonworks alliance on big data hybrid
Hortonworks is joining with Red Hat and IBM to work together on a hybrid big data architecture format that will run using containers both in the cloud and on premises. Continue Reading
-
News
16 Aug 2018
Chief data officer skills tested by AI tech blitz
A reporter's notebook from a recent MIT symposium provides insights on chief data officer needs, as the AI wave starts to hit CDOs and affects them more than most other tech trends. Continue Reading
-
Feature
16 Aug 2018
Open source RDBMS uses spurred by lower costs, cloud options
Open source technologies have become more capable alternatives to mainstream relational databases for cost-conscious users -- and the cloud makes them more accessible. Continue Reading
-
News
08 Aug 2018
Confluent Platform 5.0 aims to mainstream Kafka streaming
Confluent Platform updates seek to bring data streaming with Apache Kafka to a wider audience. A new GUI and user-defined functions are part of the 5.0 release. Continue Reading
-
Feature
02 Aug 2018
Open source DBMS software gains foothold in enterprise IT
Open source databases are increasingly making their way into corporate IT environments, says Gartner analyst Merv Adrian in a Q&A. But some care is required. Continue Reading