Data warehousing
Data warehousing captures data from a variety of sources so it can be accessed and analyzed by business analysts, data scientists and other end users. One goal is to enhance data quality and consistency for analytics uses while improving business intelligence. Read how data warehousing provides these and other unique benefits to overall data management strategy.
Top Stories
-
Feature
25 Jan 2023
Data lake vs. data warehouse: Key differences explained
Data lakes and data warehouses are both commonly used in enterprises. Here are the main differences between them to help you decide which is best for your data needs. Continue Reading
-
News
20 Jan 2023
Snowflake acquires Mobilize.net tools to aid cloud migration
The vendor purchased SnowConvert, a set of tools designed to automate some of the onerous coding work required to migrate data out of on-premises databases to the cloud. Continue Reading
-
Feature
05 Dec 2022
What is a data warehouse analyst?
Data warehouse analysts help organizations manage the repositories of analytics data and use them effectively. Here's a look at the role and its responsibilities. Continue Reading
-
News
30 Nov 2022
AWS adds data quality, scalability services for cloud data
The cloud giant expanded its data portfolio with a series of features designed to help organizations more easily scale database and data warehouse deployments. Continue Reading
-
News
29 Nov 2022
AWS expands cloud data options with Amazon DataZone
The cloud computing giant at its AWS re:Invent 2022 conference introduced a series of new capabilities to help organizations better integrate and manage data across services. Continue Reading
-
News
28 Nov 2022
Alation Connected Sheets extends data intelligence platform
The data intelligence vendor's Connected Sheets lets spreadsheet users directly pull in data sets from a data catalog to improve data governance and visibility. Continue Reading
-
News
07 Nov 2022
Snowflake data cloud adds Python, multi-cloud collaboration
The cloud data vendor released preview updates to its platform to accelerate data queries, better support multi-cloud operations and boost developer productivity. Continue Reading
-
News
11 Oct 2022
Google grows data cloud capabilities for data management
The tech giant brings open source Apache Iceberg table format support to its BigLake data lake as it extends BigQuery support for unstructured data and Apache Spark. Continue Reading
-
Feature
23 Sep 2022
How Lufthansa is flying its data warehouse to the cloud
Moving from an on-premises data system to the cloud can be a complex operation. Lufthansa is looking to remove some of the complexity with virtualization. Continue Reading
-
News
15 Sep 2022
Google eases cloud database migration, improves Datastream
Google wants to make migrating to its new AlloyDB database easier for its users as well as provide new support for database migration from PostgreSQL. Continue Reading
-
News
30 Aug 2022
Alation adds Snowflake service, updates data catalog
The vendor launched the Alation Cloud Service for Snowflake designed to enable Snowflake users to more easily use Alation's data intelligence capabilities. Continue Reading
-
Tip
23 Aug 2022
Cloud database comparison: AWS, Microsoft, Google and Oracle
Here's a look at the rival cloud database offerings from AWS, Google, Microsoft and Oracle based on their product breadth, migration capabilities and pricing models. Continue Reading
-
News
17 Aug 2022
Cloudera users get fully managed data lakehouse platform
The vendor is expanding its set of offerings with the launch of CDP One, a service initially available only on AWS that enables serverless deployment in the cloud. Continue Reading
-
News
11 Aug 2022
GridGain, Apache Ignite founder talks in-memory databases
Nikita Ivanov details the origin of his company and discusses the growing need organizations have for real-time database processing capabilities to complete modern transactions. Continue Reading
-
Feature
09 Aug 2022
A look at Presto, Trino SQL query engines
The co-creator of the open source project at Facebook reflects on 10 years of growth as he helps lead one of its resulting tools into the future. Continue Reading
-
Tip
22 Jul 2022
On-premises vs. cloud data warehouses: Pros and cons
Data warehouses increasingly are being deployed in the cloud. But both on-premises and cloud data warehouses have pluses and minuses to consider, as explained here. Continue Reading
-
News
23 Jun 2022
Starburst acquires Varada to accelerate data lake queries
After a year of partnering, the data lake query vendor decided to acquire fellow Trino SQL query engine supporter Varada to help boost query performance. Continue Reading
-
News
14 Jun 2022
Yellowbrick 6 advances cloud data warehouse deployments
The data warehouse vendor is growing its hybrid data warehouse capabilities with version 6.0 of its namesake platform that is now enabled to run on AWS. Continue Reading
-
News
14 Jun 2022
Snowflake Data Cloud expands with Unistore Hybrid Tables
Snowflake adds more capabilities, including support for Apache Iceberg data lake tables and both transactional and analytics workloads, with Hybrid Tables. Continue Reading
-
Tip
24 May 2022
How to evaluate and optimize data warehouse performance
Organizations build data warehouses to satisfy their information management needs. Data warehouse optimization can help ensure that these warehouses achieve their full potential. Continue Reading
-
Tip
17 May 2022
6 key steps to develop a data governance strategy
Data governance shouldn't be built around technology, but the other way around. Existing infrastructure, executive support, data literacy, metrics and proper tools are essential. Continue Reading
-
Tip
13 May 2022
7 best practices for successful data governance programs
A comprehensive, companywide data governance program strengthens data infrastructure, improves compliance initiatives, supports strategic intelligence and boosts customer loyalty. Continue Reading
-
News
28 Apr 2022
Ocient Hyperscale Data Warehouse scales data operations
The data warehouse vendor is targeting enterprises that need to use a trillion rows of data or more for analysis, with hyperscale technology that is now ready for broader adoption. Continue Reading
-
News
21 Apr 2022
Databricks aims data lakehouse at media and entertainment
Gaming vendor Sega is using the data vendor's technology to unify its data for sales as well as game balancing to enable players to get the best experience. Continue Reading
-
News
12 Apr 2022
Arcion brings change data capture platform to the cloud
Getting data out of one system and into another in the right format as quickly as possible is a challenge the Arcion Cloud service is aiming to address for organizations. Continue Reading
-
News
06 Apr 2022
Google grows cloud capabilities with BigLake data lakehouse
Google is continuing to build out its cloud data services with a new approach that will serve as a central cloud service for unifying data across different clouds and formats. Continue Reading
-
News
05 Apr 2022
Databricks enables Delta Live Tables in data lakehouse
Databricks is looking to make it easier for users to build data pipelines to extract, transform and load data from any source using a Spark SQL data query. Continue Reading
-
News
24 Mar 2022
DataStax Astra DB integrates real-time data streaming
The database-as-a-service vendor advanced the change data capture capabilities of its cloud database with technology from its Apache Pulsar-based streaming service. Continue Reading
-
News
09 Mar 2022
Databricks extends data lakehouse platform to healthcare
Healthcare data exists in widely varying formats. Getting it into a data lake where it can be used for analytics and machine learning is a challenge Databricks is looking to meet. Continue Reading
-
News
08 Mar 2022
DataStax scales K8ssandra for cloud-native Cassandra
The real-time data vendor is out with a new release of its K8ssandra Kubernetes operator that enables organizations to deploy, configure and run the Apache Cassandra database. Continue Reading
-
News
02 Mar 2022
Dremio opens up data lakehouse with new engine
The data lakehouse vendor is expanding its cloud platform with a new SQL query engine and data metastore for data lakes that builds on top of the Apache Iceberg table format. Continue Reading
-
Feature
26 Jan 2022
NLP and AI boost the automated data warehouse
Businesses are working to automate as many elements of their data warehouses as they can through nascent tools like augmented analytics and natural language processing. Continue Reading
-
Tip
30 Dec 2021
Top 5 elements needed for a successful data warehouse
While conventional data warehouses may struggle to keep up with growing volumes of data, these five elements best give the ability to tap into valuable BI. Continue Reading
-
News
23 Nov 2021
American Airlines flies its data warehouse to the cloud
The pandemic hit American Airlines hard, but its management took an optimistic view, seeing at as an opportunity to use data more effectively to improve operations. Continue Reading
-
News
16 Nov 2021
Snowflake grows cloud data platform with unstructured data
The cloud data vendor's winter release updates its data platform with new capabilities to enable organizations to query and manage more data types across different environments. Continue Reading
-
News
27 Oct 2021
Informatica goes public again as data management grows
Informatica has transformed in recent years from an on-premises software vendor to a SaaS-based subscription model in the cloud as new services for data have emerged. Continue Reading
-
Tip
19 Oct 2021
The challenges of cloud data management
Cloud platforms are expanding rapidly, causing organizations to face new cloud management challenges keeping pace with cloud data management advancements. Continue Reading
-
News
14 Sep 2021
Snowflake aims at financial services with data cloud
Snowflake launches its new Data Cloud offering as it continues to expand the range of applications and capabilities for its customers, including Western Union and Capital One. Continue Reading
-
Tip
24 Aug 2021
6 strategies to tap into data warehouse BI
Data warehouse BI benefits include data storage, summarization and transformation and can be unlocked with these six strategies leveraging cloud architectures. Continue Reading
-
Feature
17 Aug 2021
Bill Inmon's data warehouse approach tackles text analysis
Learn the fine points of a concept at the heart of 'The Textual Warehouse' a new book that aims to help organizations profit through textual analysis. Continue Reading
-
News
10 Aug 2021
Kyligence 4.5 adds Clickhouse to Intelligent Data Cloud
The open source Clickhouse OLAP database joins the Apache Kylin analytical data warehouse in a new update that provides a platform for different types of data queries. Continue Reading
-
News
24 Jun 2021
Firebolt raises $127M to fuel cloud data warehouse efforts
Firebolt looks to grow in the cloud data warehouse market with a proprietary file format and a focus on enabling developers to build data-driven apps on top of cloud data lakes. Continue Reading
-
News
27 May 2021
Google Datastream advances change data capture in the cloud
At Google's Data Cloud Summit, a new service released in preview to enable users to capture data from other sources to bring into Google's cloud data and analytics services. Continue Reading
-
News
07 Apr 2021
Yellowbrick Manager embraces Kubernetes for data warehouse
Yellowbrick is building out a new unified control plane to help users manage distributed cloud data warehouse deployments. The vendor also advanced its data lake integration. Continue Reading
-
Tip
05 Apr 2021
Data warehouse environment modernization tools and tips
A data warehouse environment is made up of many tools and systems. Read on to learn the history of the modern data warehouse and how they're currently evolving. Continue Reading
-
News
26 Mar 2021
Presto users detail what's next for open source SQL engine
The open source Presto project is gaining adoption beyond just Uber and Facebook as the need to connect and query disparate sources of data continues to be in demand. Continue Reading
-
News
17 Mar 2021
Oracle Autonomous Data Warehouse updated with new data tools
Oracle is updating its cloud data warehouse platform with new tools that aim to enable users to more easily benefit from data analytics and machine learning predictions. Continue Reading
-
News
16 Feb 2021
Matillion raises $100M for ETL to enable data middleware
The co-founder and CEO of Matillion, talks about his company’'s latest round of Series D funding and how data will be the key to success for many organizations in 2021. Continue Reading
-
News
01 Feb 2021
Databricks fueling data lakehouse goals with $1B funding round
Databricks gets a major vote of confidence from big name investors, including Franklin Templeton, as it raises new funding to help it advance its cloud data management technology efforts. Continue Reading
-
News
21 Jan 2021
Kyligence builds out data cloud for OLAP and big data
Kyligence is advancing the Apache Kylin project with a cloud-native offering that can help organizations more efficiently execute and manage data queries against large data sets. Continue Reading
-
News
08 Jan 2021
Starburst raises $100M as PrestoSQL rebrands as Trino
Starburst is advancing its enterprise data platform with new funding that will help advance its cloud efforts around the open source Trino query engine formerly known as PrestoSQL. Continue Reading
-
Guest Post
17 Dec 2020
Apache Pulsar vs. Kafka and other data processing technologies
David Kjerrumgaard looks at how the distributed messaging platform Apache Pulsar handles storage compared to Apache Kafka and other data processing technologies. Continue Reading
-
News
15 Dec 2020
AWS expands cloud databases with data virtualization
At AWS re:invent 2020 the public cloud giant unveiled enhancements to its database and analytics portfolio, including the Babelfish project for migrating from SQL Server to PostgreSQL. Continue Reading
-
News
20 Nov 2020
Yellowbrick data warehouse update boosts workload management
Hybrid cloud data warehouse vendor updates platform with self-healing cluster capabilities and a "penalty box" feature to improve workload management. Continue Reading
-
News
17 Nov 2020
Snowflake builds out data cloud with Snowpark
Snowflake is continuing to grow the capabilities of its cloud architecture with new developer and security capabilities that aim to help users optimize information. Continue Reading
-
News
14 Oct 2020
Idera targets cloud data lake market with Qubole acquisition
Qubole joins the Idera Inc. group of software companies, bringing data pipeline capabilities into the group to target customers that need more cloud data storage. Continue Reading
-
News
07 Oct 2020
SODA Foundation improves Open Data Framework
An open source data management group enhanced its Open Data Framework with the Greenland 1.1 update, improving multi-cloud file support and expanding connectivity to data storage options. Continue Reading
-
News
16 Sep 2020
Explosive Snowflake IPO advances cloud data warehouse fortunes
Snowflake goes public in a big way on the New York Stock Exchange, raising more than $3 billion as enterprises increasingly move data and analytics workloads to the cloud. Continue Reading
-
News
26 Aug 2020
Snowflake IPO shows strength of cloud data warehouse
The cloud data warehouse services vendor files for an IPO as it looks to build out and expand its data portfolio to help organizations manage and analyze data assets. Continue Reading
-
News
23 Jul 2020
Starburst advances Presto to handle Hadoop data better
Enterprise Presto SQL vendor Starburst updated its data query platform with expanded support for legacy Hadoop workloads as well as modern cloud data lake deployments. Continue Reading
-
News
14 Jul 2020
BigQuery Omni enables Google multi-cloud data analytics
Google BigQuery data analytics users can now query data across clouds from multiple providers, including AWS and Microsoft Azure, without the need to first move the data. Continue Reading
-
News
09 Jun 2020
Snowflake files for IPO after months of speculation
Cloud data warehouse vendor Snowflake took a major step toward going public on Tuesday, filing an initial public stock offering with the Securities and Exchange Commission. Continue Reading
-
News
02 Jun 2020
Snowflake expands cloud data warehouse capabilities
Snowflake is building out its platform with new integrations to enable users to more easily connect to different data sources, including Salesforce Einstein Analytics. Continue Reading
-
News
27 May 2020
Apache Pulsar joins Kafka in Splunk Data Stream Processor
Splunk is integrating open source Apache Kafka capabilities alongside Apache Pulsar support to better enable its latest Data Stream Processor release. Continue Reading
-
News
28 Apr 2020
Actian Avalanche Real-Time Connected Data Warehouse adds integration
Actian is expanding its Cloud Data Warehouse with data integration capabilities to enable users to onboard and search data from both cloud and on-premises data sources. Continue Reading
-
News
20 Apr 2020
AWS brings cloud data lake services to bear against COVID-19
AWS has set up a large cloud data lake filled with information and resources on COVID-19 in an effort to help medical researchers fight the global pandemic. Continue Reading
-
News
25 Feb 2020
Databricks Data Ingestion Network brings data to lakehouse
Databricks Ingest entered a public preview in a move by Databricks to enable a lakehouse that combines the best features of the data lake and data warehouse models. Continue Reading
-
News
11 Feb 2020
Snowflake raises $479 million to boost cloud data warehouse
Snowflake is looking to grow its data warehouse platform with new funding and a partnership with Salesforce that could differentiate its platform from rivals. Continue Reading
-
News
14 Jan 2020
Former Hortonworks leader named new Cloudera CEO
Cloudera finds a new leader, pulling the former CEO of Hortonworks back into the fold to help set the direction for the big data Hadoop vendor as it moves forward in 2020. Continue Reading
-
Feature
13 Jan 2020
Analytics demands add loftier goals to data warehouse strategies
As the concept of storing data and the technologies needed to do it evolve, companies with set goals in mind are building their data warehouses to maximize analytics outcomes. Continue Reading
-
News
26 Sep 2019
Quilt Data emerges from stealth to enable cloud data search
Startup emerges with a new approach to organize and search cloud data storage repositories. Continue Reading
-
News
12 Sep 2019
Amazon Quantum Ledger Database brings immutable transactions
Based on technology built internally at Amazon, the tech giant's newest database provides a centralized approach for enabling a cryptographically secure ledger system. Continue Reading
-
News
15 Aug 2019
AWS Lake Formation goes GA, as cloud data lake market grows
First released in late 2018, AWS Lake Formation is now generally available and it could be the force that helps to accelerate adoption in the cloud data lake market. Continue Reading
-
News
26 Jul 2019
Cloudera open source route seeks to keep big data alive
Inspired by the IBM-Red Hat model, Cloudera goes the open source route to broaden its market as demand for Hadoop weakens and the vendor takes on big competitors like AWS. Continue Reading
-
News
03 Jul 2019
Snowflake product VP expounds on data warehouse for the cloud
In this Q&A, Christian Kleinerman, vice president of product development at cloud data warehouse vendor Snowflake, talks about the fast-moving company's plans for the next year. Continue Reading
-
News
04 Jun 2019
Vendor unveils Snowflake Data Exchange, Google Cloud integration
Snowflake Computing's data exchange marketplace aims to make data easily shared between users and providers, enable users to innovate and give providers an opportunity to monetize data. Continue Reading
-
News
03 Jun 2019
Lyftron launches universal data access platform
Lyftron launched a data access platform that uses a data hub, data insights, enterprise-wide data catalogs and lineage, and hybrid cloud management and migration to unify data. Continue Reading
-
News
01 May 2019
Snowflake CEO Bob Muglia replaced by former ServiceNow CEO
Frank Slootman, who led ServiceNow and Data Domain through successful IPOs, is the new chairman and CEO of cloud data warehouse vendor Snowflake, replacing former CEO Bob Muglia. Continue Reading
-
Feature
04 Apr 2019
How data staging helped Walgreens transform its supply chain
Walgreens built a centralized data warehouse to give supply chain partners a better view into its data -- but analytics were slow. That's where a data staging tier came in. Continue Reading
-
Feature
21 Feb 2019
DataOps is more than DevOps for data, Delphix CTO says
Data operations is young compared to DevOps, but it is increasingly used as part of projects that put data at the center of development. Here, Delphix CTO Eric Schrock makes observations about the trend. Continue Reading
-
Feature
01 Feb 2019
Cloud data warehouse makes inroads as users spurn admin tasks
Overlooked in the run-up to Hadoop, data warehouses have found new life off premises. Cloud-based data warehouses find favor with teams that want to reduce warehouse administration. Continue Reading
-
News
22 Jan 2019
New Teradata CEO pursues cloud-based architecture
Cloud architecture, analytics and AI data processing are top innovation priorities for new Teradata CEO Oliver Ratzesberger. He talks about his goals in this Q&A. Continue Reading
-
News
30 Nov 2018
Amazon Timestream, QLDB aim to grab more DBMS users for AWS
Built-for-purpose databases target general ones, especially in the cloud. At re:Invent 2018, AWS added time-series and transaction ledger databases to expand its line. Continue Reading
-
Tip
06 Jul 2018
When to choose an S3 big data environment over HDFS storage
Selecting a storage service for big data in the cloud can be challenging. Expert David Loshin explains usage patterns that could lead organizations to Amazon Simple Storage Service. Continue Reading
-
Answer
27 Oct 2017
Dimension tables vs. fact tables: What's the difference?
Fact tables and dimension tables are used together in star schemas to support data analytics applications. But they play different roles and hold different types of data. Continue Reading
-
Answer
17 May 2017
Operational data store vs. data warehouse: How do they differ?
Operational data stores and data warehouses both store operational data, but the similarities between them end there -- and they both have a role to play in analytics architectures. Continue Reading
-
Buyer's Guide
30 Mar 2016
A buyer's guide to selecting the best data warehouse product
With several deployment options and product choices, it's difficult to know where to start. This buyer's guide helps you choose the right data warehouse product for your company. Continue Reading
-
Feature
22 Mar 2016
Five factors to help select the right data warehouse product
How big is your company, and what resources does it have? What are your performance needs? Answering these questions and others can help you select the right data warehouse platform. Continue Reading
-
Feature
10 Mar 2016
A look inside the SAP IQ column-oriented database
The SAP IQ column-oriented database is designed for large data warehouses that require high scalability, rapid data loading and optimal query performance. Continue Reading
-
Feature
09 Mar 2016
Examining the Teradata Data Warehouse
With both relational and columnar options, the Teradata Active Enterprise Data Warehouse gives companies an efficient, scalable appliance they can deploy in-house or in the cloud. Continue Reading
-
Feature
24 Feb 2016
Evaluating the key features of data warehouse platforms
Choosing between the different types of data warehouse platforms can be simplified once you know which deployment option best meets your project requirements. Continue Reading
-
Feature
17 Feb 2016
What to expect from Oracle Exadata Database Machine
Oracle Exadata Database Machine combines hardware and software to enable analytics, batch, reporting and other tasks to run simultaneously within and across databases. Continue Reading
-
Feature
15 Feb 2016
Examining the IBM PureData System for Analytics appliance
Powered by Netezza technology, the IBM PureData System for Analytics data warehouse appliance enables users to execute complex queries and get results quickly. Continue Reading
-
Feature
16 Nov 2015
The benefits of deploying a data warehouse platform
Big data may be all the rage, but data warehouse platforms are still being utilized by companies of all sizes. Expert Craig S. Mullins takes a look at the technology. Continue Reading
-
Answer
11 Oct 2011
Key issues to consider when building a data warehouse
There are numerous issues, both technical and cultural, that organizations need to consider before building a data warehouse. Learn what they are from our data warehousing expert. Continue Reading
-
Answer
18 May 2011
Six tips for improving data warehouse performance
Get six expert tips for improving data warehouse performance. Learn how database engines, SSDs and MOLAP cubes can affect your data warehouse performance. Continue Reading
-
Feature
04 Feb 2010
Key benchmarks for measuring transaction processing performance
Find key benchmarks for measuring transaction processing performance at your company, and learn about XA two-phase commit and types of transaction processing. Continue Reading
-
Answer
10 Apr 2009
What are the most common system implementation mistakes?
Learn about some of the biggest mistakes in system implementation and why successful implementations are few and far between. Find out how to avoid these pitfalls with careful planning and more tips from our project management expert. Continue Reading
-
Answer
26 Jun 2008
How to evaluate data warehouse software in five steps
Get five steps to evaluating data warehouse software from a data warehouse expert. Continue Reading
-
News
10 Apr 2008
Why Are Data Warehouses Growing So Fast?
Richard Winter provides observations on the causes and effects of the explosion of digital information. Continue Reading
-
Answer
16 Mar 2006
Ralph Kimball vs. Bill Inmon approaches to data warehouse design
Learn about the debate between the Ralph Kimball and Bill Inmon approaches to data warehouse design. Continue Reading
-
News
06 Jan 2005
Data warehousing for government
Surprisingly, Data Warehouses have been slow to be adopted in the government circles. Continue Reading