Hadoop framework
Top Stories
-
Feature
06 Jan 2023
18 top big data tools and technologies to know about in 2023
Numerous tools are available to use in big data applications. Here's a look at 18 popular open source technologies, plus additional information on NoSQL databases. Continue Reading
-
Feature
17 Feb 2022
Hadoop vs. Spark: An in-depth big data framework comparison
Hadoop and Spark are widely used big data frameworks. Here's a look at their features and capabilities and the key differences between the two technologies. Continue Reading
-
Feature
19 Jan 2023
Data management trends: Convergence and more money
The past year focused heavily on data intelligence, lakehouse development and observability as vendors innovated to help enterprises make effective use of converged data and technologies. Continue Reading
-
Feature
17 Jan 2023
Data-centric developer responsibilities evolve in 2022
Enterprise Strategy Group Analyst Stephen Catanzano discusses how data-centric developer responsibilities are evolving as technological advancements enable more data use. Continue Reading
-
Opinion
12 Jan 2023
Organizations capitalize on intelligent data management
Intelligent data management concepts are opening new avenues for organizations to make better data-centric decisions and extract more value from their data. Continue Reading
-
Feature
10 Jan 2023
16 top data governance tools to know about in 2023
Data governance software can help organizations manage governance programs. Here's a look at the key features and capabilities of 16 prominent governance tools. Continue Reading
-
Tip
06 Jan 2023
5 pillars of data observability bolster data pipeline
Data observability provides holistic oversight of the entire data pipeline in an organization. Use the five pillars to ensure efficient, accurate data operations. Continue Reading
-
Feature
06 Jan 2023
18 top big data tools and technologies to know about in 2023
Numerous tools are available to use in big data applications. Here's a look at 18 popular open source technologies, plus additional information on NoSQL databases. Continue Reading
-
Feature
05 Jan 2023
18 top data catalog software tools to consider using in 2023
Numerous tools can be used to build and manage data catalogs. Here's a look at the key features, capabilities and components of 18 prominent data catalog tools. Continue Reading
-
Feature
05 Jan 2023
Top trends in big data for 2023 and beyond
Big data is driving changes in how organizations process, store and analyze data. The benefits are spurring even more innovation. Here are four big trends. Continue Reading
-
Answer
28 Dec 2022
Comparing DBMS vs. RDBMS: Key differences
A relational database management system is the most popular type of DBMS for business uses. Find out how RDBMS software differs from other DBMS technologies. Continue Reading
-
Feature
20 Dec 2022
Data forecast for 2023: Time to extract more value
Expect more organizations to optimize data usage to drive decision intelligence and operations in 2023, as the new year will be one of economic challenges for many. Continue Reading
-
Tip
15 Dec 2022
What key roles should a data management team include?
These 10 roles, with different responsibilities, are commonly a part of the data management teams that organizations rely on to make sure their data is ready to use. Continue Reading
-
Feature
15 Dec 2022
8 data integration challenges and how to overcome them
These eight challenges complicate efforts to integrate data for operational and analytics uses. Here's why, plus advice on how to deal with them. Continue Reading
-
News
15 Dec 2022
Apache Cassandra 4.1 extends open source NoSQL database
The open source Cassandra database is out with its first major update in 18 months, bringing with it an improved consensus protocol to boost transaction performance. Continue Reading
-
News
13 Dec 2022
Aiven launches managed ClickHouse database as a service
The open source database cloud services vendor continues to expand the number of technologies it supports, adding new analytics capabilities in a managed offering. Continue Reading
-
News
13 Dec 2022
SingleStoreDB 8.0 brings WebAssembly to unified database
The database vendor updates its hybrid transactional and analytical database with new JSON data query acceleration technology and developer support for WebAssembly. Continue Reading
-
Tip
12 Dec 2022
Data tenancy maturity model boosts performance and security
A data tenancy maturity model can boost an organization's data operations and help improve the protection of customer data. Improvement is tracked through tiers of data tenancy. Continue Reading
-
Feature
09 Dec 2022
The differences between a data warehouse vs. data mart
Data marts and data warehouses both play key roles in the BI and analytics process. Here's how they differ and how they can be used to help drive business decisions. Continue Reading
-
News
08 Dec 2022
CockroachDB brings user-defined functions to distributed SQL
User-defined functions land in Cockroach Labs' new database update aiming to improve application development. The release also adds Intelligent Insights for performance monitoring. Continue Reading
-
Feature
08 Dec 2022
Disney improves data integration efficiency with AWS Glue
During the pandemic, Disney revamped its data integration process after the media and entertainment giant's existing data integration tools proved unable to meet its new needs. Continue Reading
-
Opinion
08 Dec 2022
AWS DataZone headlines AWS re:Invent 2022
AWS DataZone will enable the sharing, search and discovery of data at scale with less risk. It is one of many data advancements announced at AWS re:Invent 2022. Continue Reading
-
Feature
05 Dec 2022
What is a data warehouse analyst?
Data warehouse analysts help organizations manage the repositories of analytics data and use them effectively. Here's a look at the role and its responsibilities. Continue Reading
-
Feature
05 Dec 2022
Evaluating data warehouse deployment options and use cases
There's still a place for data warehouses in data architectures. But first, ask whether your organization needs one and what type of technology platform is the best fit. Continue Reading
-
News
02 Dec 2022
EDB brings new tools to open source PostgreSQL database
The database vendor released new extensions designed to help PostgreSQL users with best practices for storage, user access and performance optimizations for database operations. Continue Reading
-
Tip
01 Dec 2022
Data observability benefits entire data pipeline performance
Data observability benefits include improving data quality and identifying issues in the pipeline process, but also has challenges organizations must solve for success. Continue Reading
-
News
30 Nov 2022
AWS adds data quality, scalability services for cloud data
The cloud giant expanded its data portfolio with a series of features designed to help organizations more easily scale database and data warehouse deployments. Continue Reading
-
News
29 Nov 2022
AWS expands cloud data options with Amazon DataZone
The cloud computing giant at its AWS re:Invent 2022 conference introduced a series of new capabilities to help organizations better integrate and manage data across services. Continue Reading
-
News
28 Nov 2022
Alation Connected Sheets extends data intelligence platform
The data intelligence vendor's Connected Sheets lets spreadsheet users directly pull in data sets from a data catalog to improve data governance and visibility. Continue Reading
-
Tip
28 Nov 2022
5 steps to an improved data quality assurance plan
Follow these steps to develop a data quality assurance plan and management strategy that can help identify data errors before they cause big business problems. Continue Reading
-
News
23 Nov 2022
How Fauna looks to advance serverless database technology
The CEO of the serverless database vendor is overseeing his firm's drive to build out a developer-focused database as an API to let organizations deploy applications faster. Continue Reading
-
Tip
23 Nov 2022
7 expert recommended data observability tools
Commercial data observability tools can offer organizations pre-built components and plenty of vendor support for data use cases including monitoring, security and decision-making. Continue Reading
-
Tip
18 Nov 2022
6 data observability open source tools to consider
Learn about six data observability open source options helping organizations pursue data science experiments that are more budget-friendly and flexible than commercial tools. Continue Reading
-
News
17 Nov 2022
Alluxio 2.9 scales out open source data orchestration
Multi-environment cluster synchronization lands in Alluxio platform to give organizations a single view of data across multiple deployments, wherever they are located. Continue Reading
-
News
16 Nov 2022
Microsoft SQL Server 2022 bridges on-premises to cloud
Enabling hybrid deployments that span the cloud and on-premises is the key goal for Microsoft's latest update of its 33-year-old relational database. Continue Reading
-
News
16 Nov 2022
PlanetScale boosts cloud database with data caching
The database vendor will enable users to speed up queries that are running slowly with its new Boost service, which uses insights about query performance. Continue Reading
-
News
15 Nov 2022
Redpanda updates event data streaming cloud platform
The event data streaming vendor rebuilt its cloud system using technology acquired in April, providing a new user console and interface to let organizations use real-time data. Continue Reading
-
News
15 Nov 2022
MotherDuck raises $47.5M for open source DuckDB database
The database startup received new funding to build out a hybrid cloud platform that will let organizations run DuckDB both in the cloud and on premises. Continue Reading
-
News
10 Nov 2022
Speedb data engine brings key value store to open source
The startup looks to provide a competitive alternative to RocksDB by building out its data technology and community of developers with a move to an open source methodology. Continue Reading
-
News
09 Nov 2022
Neo4j 5 accelerates graph database queries
The cypher query language got a big boost in the Neo4j 5 database update, letting users execute more complex queries faster than with earlier releases. Continue Reading
-
News
07 Nov 2022
Snowflake data cloud adds Python, multi-cloud collaboration
The cloud data vendor released preview updates to its platform to accelerate data queries, better support multi-cloud operations and boost developer productivity. Continue Reading
-
News
07 Nov 2022
EdgeDB raises $15M for open source graph-relational database
The startup vendor of open source database technology raised new money to help build out a platform that aims to relieve the object-relational impedance mismatch. Continue Reading
-
News
03 Nov 2022
Momento accelerates databases with serverless data caching
The startup has built a new platform that lets organizations more easily scale and accelerate database queries in the cloud without adding more infrastructure. Continue Reading
-
News
03 Nov 2022
Aerospike Cloud advances real-time database service
The database vendor has steadily advanced its core database technology in 2022 with JSON and Trino support and is now building out a new database-as-a-service platform. Continue Reading
-
News
02 Nov 2022
Alation set to advance data intelligence with new $123M
The data intelligence vendor, which aims to help enterprises organize data with data catalog technology, sees fundraising success and market demand for its platform. Continue Reading
-
News
01 Nov 2022
Equalum CDC Connect embeds change data capture and streaming
The CDC technology vendor expanded the reach of its real-time data integration platform that provides event data streaming to keep data moving to where it's needed. Continue Reading
-
News
27 Oct 2022
Cinchy raises $14.5M to expand dataware data management
The startup's technology aims to help enterprises liberate data from applications where it can be locked so that users can more easily get at data from multiple locations. Continue Reading
-
News
26 Oct 2022
InfluxDB Cloud overhauls time series database engine
InfluxData updated its InfluxDB Cloud database service with a new engine, new storage and real-time data capabilities, and expanded support for SQL queries. Continue Reading
-
Tip
26 Oct 2022
4 data quality challenges that hinder data operations
Data quality challenges pose a threat to organizations' decision-making. Inaccurate, inconsistent, missing and duplicate data poses threats to cultivating trustworthy data sets. Continue Reading
-
News
26 Oct 2022
Serverless PostgreSQL platform Bit.io goes GA, raises $7.5M
PostgreSQL database-as-a-service vendor launches a cloud service that integrates features designed to accelerate data migration from different sources. Continue Reading
-
News
19 Oct 2022
RisingWave Labs raises $36M for stream processing database
Open source-based streaming database vendor looks to expand into the cloud with a database-as-a-service platform written in the Rust programming language. Continue Reading
-
News
18 Oct 2022
Oracle Database 23c brings JSON, graph to relational database
The tech giant previewed the next major milestone for its namesake database at the CloudWorld conference, providing users with features to better work with different data models. Continue Reading
-
News
18 Oct 2022
Oracle extends MySQL HeatWave database to the data lakehouse
The Oracle MySQL HeatWave service provides both transactional and analytics processing capabilities and now also lets users tap into data lake storage for queries. Continue Reading
-
Tip
17 Oct 2022
Make data usability a priority on data quality for big data
To help make big data analytics applications more effective, IT teams must augment conventional data quality processes with measures aimed at improving data usability for analysts. Continue Reading
-
Tip
14 Oct 2022
6 dimensions of data quality boost data performance
Generate accurate data analysis and predictions by mastering the six dimensions of data quality -- accuracy, consistency, validity, completeness, uniqueness and integrity. Continue Reading
-
Feature
13 Oct 2022
How to reap the benefits of data integration, step by step
A new book lays out a strong case for data integration and guides readers in how to carry out this essential process. Continue Reading
-
News
13 Oct 2022
PostgreSQL 15 advances open source relational database
The new release of the widely deployed and supported PostgreSQL platform integrates enhanced logging, data compression, SQL and data replication capabilities. Continue Reading
-
News
11 Oct 2022
Google grows data cloud capabilities for data management
The tech giant brings open source Apache Iceberg table format support to its BigLake data lake as it extends BigQuery support for unstructured data and Apache Spark. Continue Reading
-
News
06 Oct 2022
ArangoDB expands scope of graph database platform
The database vendor extended its namesake database platform to support machine learning applications with its revamped ArangoGraph Insights Platform cloud database service. Continue Reading
-
Opinion
05 Oct 2022
Big Data London focuses on future of data-driven strategies
At Big Data London, data quality and intelligence took center stage as companies strive for fast and efficient delivery of quality information -- and the vendors to make it happen. Continue Reading
-
News
04 Oct 2022
Confluent brings designer and governance to streaming data
The streaming data platform vendor added a stream designer and new governance capabilities to its cloud service for organizations working with real-time data coming from Kafka. Continue Reading
-
Tip
04 Oct 2022
How to overcome the top 5 DataOps challenges
DataOps is a new tool for effective data use and improved data-driven decision-making. Organizations should prepare for these five DataOps challenges and learn how to overcome them. Continue Reading
-
Tip
29 Sep 2022
The future of DataOps trends in 2023 and beyond
DataOps is a growing tool for organizations looking to efficiently distribute accurate data to users. Learn the DataOps trends teams must understand as it evolves. Continue Reading
-
Tip
23 Sep 2022
How to build an effective DataOps team
More organizations are turning to DataOps to bolster their data management operations. Learn how to build a team with the right people to ensure DataOps success. Continue Reading
-
Feature
23 Sep 2022
How Lufthansa is flying its data warehouse to the cloud
Moving from an on-premises data system to the cloud can be a complex operation. Lufthansa is looking to remove some of the complexity with virtualization. Continue Reading
-
News
21 Sep 2022
CockroachDB serverless database debuts with migration tools
After a year in preview, the database vendor is making its serverless offering generally available. It provides a new production-ready database for distributed SQL. Continue Reading
-
News
20 Sep 2022
Imply advances Apache Druid real-time analytics database
The database vendor is continuing its effort to evolve the Apache Druid database, developing new capabilities to help users more easily load and transform data. Continue Reading
-
Tip
19 Sep 2022
7 top data quality management tools
Data quality management tools help organizations automate and fill gaps in data processes from lacking quality to dated analytics. Here are seven of the top tools in the market. Continue Reading
-
News
15 Sep 2022
Google eases cloud database migration, improves Datastream
Google wants to make migrating to its new AlloyDB database easier for its users as well as provide new support for database migration from PostgreSQL. Continue Reading
-
News
13 Sep 2022
Oracle brings MySQL Heatwave cloud database service to AWS
The tech giant launched a new MySQL cloud database service running on AWS infrastructure that will support both analytical and transactional database workloads. Continue Reading
-
News
09 Sep 2022
Kafka co-creator details event data streaming evolution
The open source Apache Kafka streaming technology and commercial vendor Confluent have grown over the last decade as organizations increasingly have turned to real-time data. Continue Reading
-
Tip
09 Sep 2022
7 data quality best practices to improve data performance
Data quality is essential to operate a successful data pipeline and enable data-driven decision-making. These seven data quality best practices can help improve performance. Continue Reading
-
News
31 Aug 2022
Meta and partners build Velox open source execution engine
The Facebook parent company, along with multiple contributors, including Ahana, Voltron Data and Intel, are developing a new open source technology to make data processing faster. Continue Reading
-
News
30 Aug 2022
Alation adds Snowflake service, updates data catalog
The vendor launched the Alation Cloud Service for Snowflake designed to enable Snowflake users to more easily use Alation's data intelligence capabilities. Continue Reading
-
News
30 Aug 2022
StarTree raises $47M for Apache Pinot-based analytics database
The vendor raised new money to continue to grow its database technology as the applications for analytics databases have expanded in recent years with more real-time data needs. Continue Reading
-
News
24 Aug 2022
Zilliz raises $60M for open source Milvus vector database
The leading commercial backer behind the open source Milvus database project is looking to advance the technology to build out a database for AI application workloads. Continue Reading
-
News
23 Aug 2022
InfluxData eases event streaming data collection
The new Native Collectors service in the cloud is an attempt by the time series database vendor to let users connect to message broker services and event streaming data. Continue Reading
-
Tip
23 Aug 2022
Cloud database comparison: AWS, Microsoft, Google and Oracle
Here's a look at the rival cloud database offerings from AWS, Google, Microsoft and Oracle based on their product breadth, migration capabilities and pricing models. Continue Reading
-
News
19 Aug 2022
PlanetScale reaches to the edge with serverless driver
The vendor continues to build out its database-as-a-service platform and is now aiming to make it easier for developers to connect to edge services. Continue Reading
-
Feature
18 Aug 2022
Evaluating the different types of DBMS products
The various types of database software come with advantages, limitations and optimal uses that prospective buyers should be aware of before choosing a DBMS. Continue Reading
-
News
18 Aug 2022
MariaDB set to expand geospatial database capabilities
With the purchase of CubeWerx, the database vendor will add geospatial capabilities to its SkySQL database service that will enable satellite imagery analysis in applications. Continue Reading
-
News
17 Aug 2022
Arcion data pipeline updates for schema evolution
The vendor added new database support to its change data capture platform including for BigQuery and Imply, as well as features for schema update and data column transformations. Continue Reading
-
News
17 Aug 2022
Cloudera users get fully managed data lakehouse platform
The vendor is expanding its set of offerings with the launch of CDP One, a service initially available only on AWS that enables serverless deployment in the cloud. Continue Reading
-
Opinion
15 Aug 2022
The modern data platform drives data-centric organizations
IT leads the modern data platform, functioning as the conduit, efficiently delivering the correct data to the right users, to empower data-driven decision-making in organizations. Continue Reading
-
Feature
12 Aug 2022
Should you run your database on premises or in the cloud?
Use of cloud databases is surging, but there are still reasons for on-premises ones. Here's a comparison of cloud and local database architectures to help you choose. Continue Reading
-
News
11 Aug 2022
GridGain, Apache Ignite founder talks in-memory databases
Nikita Ivanov details the origin of his company and discusses the growing need organizations have for real-time database processing capabilities to complete modern transactions. Continue Reading
-
Feature
09 Aug 2022
A look at Presto, Trino SQL query engines
The co-creator of the open source project at Facebook reflects on 10 years of growth as he helps lead one of its resulting tools into the future. Continue Reading
-
Tip
05 Aug 2022
How CDOs manage cloud adoption and hybrid cloud compliance
Cloud advancements are changing how chief data officers approach cloud data management as they juggle security, privacy and other hybrid cloud compliance issues. Continue Reading
-
News
05 Aug 2022
Hazelcast CEO looks to grow real-time data platform
The CEO of the data streaming vendor discusses the direction Hazelcast is heading in as it launches a serverless platform for real-time processing of streaming and contextual data. Continue Reading
-
Tip
03 Aug 2022
Key roles and responsibilities of the modern chief data officer
Chief data officer roles and responsibilities are expanding beyond data strategy, as they are increasingly tasked with cultivating a data-driven culture. Continue Reading
-
Tip
28 Jul 2022
What is data lineage? Techniques, best practices and tools
Organizations can bolster data governance efforts by tracking the lineage of data in their systems. Get advice on how to do so and how data lineage tools can help. Continue Reading
-
News
28 Jul 2022
Truist chief data officer on data management challenges
The CDO of bank holding company Truist outlines what she sees as an optimal data management culture as the demand for data skills continues to grow. Continue Reading
-
Tip
25 Jul 2022
The evolution of the chief data officer role
Chief data officers are taking on additional responsibilities beyond data management as they strive to transform organizations' data culture and focus on value creation. Continue Reading
-
News
22 Jul 2022
Apache Beam users detail stream data processing applications
At a Beam conference, users detail how they're using the open source data processing technology at large scale in support of a growing number of data pipelines. Continue Reading
-
Tip
22 Jul 2022
On-premises vs. cloud data warehouses: Pros and cons
Data warehouses increasingly are being deployed in the cloud. But both on-premises and cloud data warehouses have pluses and minuses to consider, as explained here. Continue Reading
-
News
20 Jul 2022
Oracle Database Service for Azure connects Microsoft to OCI
Oracle and Microsoft are extending their partnership to enable Microsoft cloud users to directly provision and access Oracle Cloud Infrastructure database services. Continue Reading
-
Tip
19 Jul 2022
How to plan and manage a multi-cloud database environment
Deploying databases on different cloud platforms offers various benefits. Here's a set of 10 best practices for building a multi-cloud database architecture. Continue Reading
-
News
19 Jul 2022
Confluent update eases multi-cloud event data streaming
The event data streaming vendor's new update introduces features to make it easier to integrate into a multi-cloud data stack deployment with the debut of a Terraform provider. Continue Reading
-
Tip
15 Jul 2022
Cloud DBA: How cloud changes database administrator's role
Cloud databases change the duties and responsibilities of database administrators. Here's how the job of a cloud DBA differs from what an on-premises one does. Continue Reading
-
News
14 Jul 2022
StarRocks brings open source OLAP database to the cloud
The open source online analytical transaction processing DBaaS startup takes a different approach to accelerate queries as it moves to the cloud. Continue Reading
-
Tip
14 Jul 2022
Managing databases in a hybrid cloud: 8 key considerations
To manage and monitor hybrid cloud database environments, consider business and application goals plus costs, latency, security, stability, simplicity, tools and technical skills. Continue Reading
-
News
14 Jul 2022
ScyllaDB V open source NoSQL database embraces WebAssembly
New release of the open source NoSQL database adds an optimized I/O scheduler to accelerate read/write operations and improve workload scalability. Continue Reading