Data integration
Most organizations draw data from multiple sources, including external ones. Data integration combines this data to create unified sets of information for tracking business performance and managing operations. Learn about data integration strategies to ensure information from multiple sources is consistent to meet users' data analysis needs across the organization.
Top Stories
-
News
30 Oct 2024
Alation browser-based extension aims to streamline analysis
The vendor's extension for Google Chrome embeds its tools in users' browsers to reduce time wasted toggling between applications and improve efficiency and speed to insight. Continue Reading
By- Eric Avidon, Senior News Writer
-
News
29 Oct 2024
Dremio updates data catalog to support all deployment types
Recognizing that some customers need to keep data on-premises, the vendor has extended the availability of its Data Catalog for Apache Iceberg beyond its cloud-based platform. Continue Reading
By- Eric Avidon, Senior News Writer
-
News
17 May 2022
Percona Platform aims to boost open source database support
The open source database services provider is out with a new integrated offering that provides automated capabilities for organizations to manage and optimize database operations. Continue Reading
-
News
17 May 2022
Imply raises $100M for analytics database technology
The lead vendor behind the open source Apache Druid database raises new money to help grow its go-to-market efforts and build out new technology as it heads toward a possible IPO. Continue Reading
-
Tip
13 May 2022
7 best practices for successful data governance programs
A comprehensive, companywide data governance program strengthens data infrastructure, improves compliance initiatives, supports strategic intelligence and boosts customer loyalty. Continue Reading
By- Donald Farmer, TreeHive Strategy
-
News
11 May 2022
Google introduces AlloyDB PostgreSQL-based cloud database
The tech giant is growing its cloud database portfolio with a new service that add analytics query acceleration to and boosts performance of the PostgreSQL database. Continue Reading
-
News
11 May 2022
ThoughtSpot demonstrates its evolution at Beyond 2022
The vendor's first in-person user conference since 2019 has showcased its transformation. In an interview, ThoughtSpot CEO Sudheesh Nair discusses the company's modernization. Continue Reading
By- Eric Avidon, Senior News Writer
-
News
11 May 2022
PingCap brings TiDB distributed SQL HTAP database to cloud
The TiDB Cloud provides a fully managed deployment of the open source TiDB database, which provides both analytical and transactional processing functionality. Continue Reading
-
News
10 May 2022
Talend Data Fabric updates data health functionality
The data integration vendor is improving its data fabric with enhancements that strengthen its trust score for providing a metric for data quality and health. Continue Reading
-
News
10 May 2022
Couchbase Server 7.1 advances enterprise NoSQL database
The database vendor is updating its namesake platform with an optimized storage engine and new integrations to connect data sources including cloud data lakes. Continue Reading
-
Feature
09 May 2022
Best practices and pitfalls of the data pipeline process
Developing an effective data pipeline process is a key step for organizations to manage data sources, flow and quality. A data pipeline also ensures approved data access. Continue Reading
-
News
04 May 2022
Starburst boosts data lake connections and fault tolerance
The data lake query vendor is bringing new features to its platform to optimize queries with the open source Trino query engine across multiple formats and sources. Continue Reading
-
News
04 May 2022
Alluxio 2.8 improves data orchestration platform security
Open source-based data platform provider Alluxio is updating its namesake technology with enhanced Amazon S3 support and improved security for cloud data access. Continue Reading
-
News
28 Apr 2022
Hasura enables GraphQL joins for data federation
Connecting multiple GraphQL services is a new feature in the Hasura 2.6 update that helps organizations unify multiple data sources in a data federation. Continue Reading
-
News
26 Apr 2022
Akamai goes DBaaS with Linode Managed Database service
The Linode Managed Database service is set to debut, bringing support for the MySQL database and expanding support to include PostgreSQL, Redis and MongoDB in the coming months. Continue Reading
-
News
21 Apr 2022
Databricks aims data lakehouse at media and entertainment
Gaming vendor Sega is using the data vendor's technology to unify its data for sales as well as game balancing to enable players to get the best experience. Continue Reading
-
News
20 Apr 2022
Oracle boosts Exadata Cloud Infrastructure with X9M
New hardware is coming to the tech giant's cloud service for database workloads, with the Exadata X9M for more compute and storage to provide increased performance and scale. Continue Reading
-
Feature
13 Apr 2022
Databricks fuels analytics for Spain's top soccer league
After prioritizing data-driven decision-making over the last decade, LaLiga is now using Databricks to inform its clubs and fans about play on the field. Continue Reading
By- Eric Avidon, Senior News Writer
-
News
12 Apr 2022
Arcion brings change data capture platform to the cloud
Getting data out of one system and into another in the right format as quickly as possible is a challenge the Arcion Cloud service is aiming to address for organizations. Continue Reading
-
News
07 Apr 2022
Monte Carlo introduces Circuit Breakers for data pipelines
In an effort to help improve data workflow reliability, Monte Carlo is rolling out a new feature that can help organizations stop inaccurate data flows from affecting operations. Continue Reading
-
News
06 Apr 2022
MongoDB 5.3 enhances time series data capabilities
MongoDB is continuing to grow its multimodel database capabilities, adding the ability to help users with gap filling for missing data sets, in the new 5.3 release. Continue Reading
-
News
05 Apr 2022
Redpanda expands event data streaming with more visibility
Alex Gallego, founder and CEO of Redpanda, discusses why his company acquired Kafka user interface vendor CloudHut, as organizations deal with the challenges of real-time data. Continue Reading
-
News
31 Mar 2022
Swim Continuum advances event streaming data intelligence
The vendor is continuing to build out its technology aimed at enabling organizations to build applications that use real-time data to improve operations. Continue Reading
-
News
28 Mar 2022
Snowflake launches industry-specific data cloud for retail
Retail Data Cloud is the vendor's fourth industry-specific data cloud, and comes prepackaged with data sets and capabilities to enable efficient data management and analytics. Continue Reading
By- Eric Avidon, Senior News Writer
-
News
24 Mar 2022
DataStax Astra DB integrates real-time data streaming
The database-as-a-service vendor advanced the change data capture capabilities of its cloud database with technology from its Apache Pulsar-based streaming service. Continue Reading
-
News
24 Mar 2022
PlanetScale eases serverless database schema migration
The database-as-a-service platform vendor looks to make it easier for developers to build data-driven applications and revert schema changes when needed. Continue Reading
-
News
22 Mar 2022
StarTree brings Apache Pinot real-time database to the cloud
The open source Apache Pinot OLAP data store is set to become easier to deploy, manage and operate in the cloud with improved data ingestion and data observability capabilities. Continue Reading
-
News
17 Mar 2022
Snowflake brings data cloud to healthcare and life sciences
Snowflake is continuing to build out its industry vertical platform offerings, helping users in different market segments collect, share and analyze data. Continue Reading
-
News
15 Mar 2022
Redis launches JSON database capabilities with RedisJSON 2.0
The data platform vendor is growing beyond its data caching roots to support more data types and full database capabilities that integrate with RediSearch indexing technology. Continue Reading
-
News
14 Mar 2022
Fauna brings real-time streaming to serverless database
The ability to directly subscribe to real-time updates is the latest feature for the Fauna database that can help developers quickly bring data to applications. Continue Reading
-
News
11 Mar 2022
Instaclustr to support Karapace open source schema registry
Instaclustr is joining rival Aiven in an effort to support an open source technology that brings REST proxy and schema technology to Kafka event streaming. Continue Reading
-
News
10 Mar 2022
Collibra Data Intelligence Cloud update targets productivity
The vendor's new and enhanced features are aimed at improving user efficiency and include a new browser extension along with added data governance capabilities. Continue Reading
By- Eric Avidon, Senior News Writer
-
News
09 Mar 2022
An analyst's blueprint for choosing a cloud data platform
Though choosing the tools that best fit the needs of an organization is difficult, analyst Doug Henschen has come up with a series of steps that can serve as a guide. Continue Reading
By- Eric Avidon, Senior News Writer
-
News
07 Mar 2022
Fannie Mae, Mercedes-Benz detail data lake platform uses
At the Subsurface Winter 2022 virtual conference, several organizations including Fannie Mae and Mercedes-Benz explained why and how they are using Dremio's data lake engine. Continue Reading
-
News
04 Mar 2022
Directus brings Open Data Platform technology to the cloud
The vendor's new managed cloud service is designed to enable organizations to connect applications, business intelligence and websites to data sources and databases. Continue Reading
-
Definition
02 Mar 2022
data ingestion
Data ingestion is the process of obtaining and importing data for immediate use or storage in a database. Continue Reading
By- Ben Lutkevich, Site Editor
-
News
02 Mar 2022
Anomalo Pulse dashboard aims for data quality insights
The startup is enhancing its platform by providing users with a new dashboard that brings visibility into the state of data used for data analytics and business intelligence. Continue Reading
-
News
02 Mar 2022
Alteryx unifies cloud capabilities in a single platform
The longtime data and analytics vendor launched Analytics Cloud, bringing together its first four cloud-native capabilities in one environment for a more seamless user experience. Continue Reading
By- Eric Avidon, Senior News Writer
-
News
28 Feb 2022
DBT Labs raises expectations for data transformation
DBT Labs co-founder and CEO Tristan Handy outlines his view on the modern data stack, how the vendor's technology powers data pipelines and why he raised money now. Continue Reading
-
News
24 Feb 2022
Ahana aims to improve Presto data lake security in the cloud
Data startup Ahana has updated its Presto cloud platform with integrated governance and control capabilities for data lake deployments. Continue Reading
-
Feature
24 Feb 2022
MetLife improves efficiency with Tibco Data Virtualization
The insurance giant's investment management division has reduced its data integration process from weeks to hours since adopting the analytics vendor's technology in 2017. Continue Reading
By- Eric Avidon, Senior News Writer
-
Feature
24 Feb 2022
Christal Bemont, Talend CEO: Show up as yourself
Christal Bemont, CEO of data management firm Talend, reflects on coming through difficult times in solidarity with co-workers, and how data quality assumes a heightened significance in the digital era Continue Reading
By- Brian McKenna, Senior Analyst, Business Applications
-
News
23 Feb 2022
Couchbase Mobile 3 brings NoSQL database to the edge
The vendor looks to integrate an edge-to-cloud database architecture with a new release that provides developers with tools to manage distributed database deployments. Continue Reading
-
News
23 Feb 2022
Voltron Data takes aim at data management with Apache Arrow
CEO and co-founder Josh Patterson outlines the promise of the new language-agnostic data analytics development framework and why the vendor is raising big money to support it. Continue Reading
-
News
23 Feb 2022
Alteryx makes personnel changes to navigate cloud journey
The longtime data management vendor has remade its C-suite over the past few years, including adding a new CEO and president, as it modernizes its technology. Continue Reading
By- Eric Avidon, Senior News Writer
-
News
17 Feb 2022
Hyperledger expands open source blockchain efforts
The CTO of a major blockchain group provides insight into the growing effort to build open source blockchain technologies for enterprises, though challenges remain. Continue Reading
-
News
09 Feb 2022
Reverse ETL vendor Census raises $60M
Census raises new money as the vendor ramps up its operations to help organizations get data from data warehouses to power large-scale business applications. Continue Reading
-
News
18 Jan 2022
Fivetran updates data integration platform with dbt Core
With automated data transformations and new data lineage visualization graphs, Fivetran is looking to make building data pipelines easier for data users. Continue Reading
-
Tip
05 Jan 2022
10 big data challenges and how to address them
Bringing a big data initiative to fruition requires an array of data skills and best practices. Here are 10 big data challenges enterprises must be ready for. Continue Reading
-
News
13 Dec 2021
SnapLogic raises $165M to fund AI data integration
The data integration vendor's fundraising success shows the growth the iPaaS and RPA markets have seen in recent years, with a steady pace of investment and acquisitions. Continue Reading
By- Esther Ajao, News Writer
-
Definition
08 Oct 2021
What is semantic technology?
Semantic technology is a set of methods and tools that provide advanced means for categorizing and processing data, as well as for discovering relationships within varied data sets. Continue Reading
By -
News
19 Aug 2021
Hitachi Vantara expands Lumada DataOps suite
Hitachi Vantara integrated its data management technologies into a new product suite intended to help organizations with data operations. Data governance is coming next. Continue Reading
-
Definition
19 Aug 2021
stream processing
Stream processing is a data management technique that involves ingesting a continuous data stream to quickly analyze, filter, transform or enhance the data in real time. Continue Reading
-
News
11 Aug 2021
Talend updates data fabric with more collaboration
With its summer 2021 update, data integration vendor Talend boosted its data sharing and integration features to help business users share trusted data sources. Continue Reading
-
Feature
06 Aug 2021
Why City Furniture embraced data virtualization
With data coming from on-premises and cloud sources and spanning legacy systems, databases and even flat files, City Furniture faced problems bringing all its data together. Continue Reading
-
Tip
28 Jul 2021
Data architecture vs. information architecture: How they differ
Data architects collect the statistics and information architects put the numbers into context as they work symbiotically to bolster an enterprise's data and business strategies. Continue Reading
By- Rick Sherman, Athena Solutions
-
Tip
23 Jul 2021
9 steps to a dynamic data architecture plan
Learn the nine steps to a comprehensive data architecture plan, including C-suite support, data personas, user needs, governance, catalogs, SWOT, lifecycles, blueprints and maps. Continue Reading
By- David Loshin, Knowledge Integrity Inc.
-
Tip
22 Jul 2021
6 key components of a successful data strategy
These six elements are essential parts of an enterprise data strategy that will help meet business needs for information when paired with a solid data architecture. Continue Reading
By- Donald Farmer, TreeHive Strategy
-
Tip
20 Jul 2021
5 principles of a well-designed data architecture
Here are five core data architecture principles to help organizations build a modern architecture that successfully meets their data management and analytics needs. Continue Reading
By- Donald Farmer, TreeHive Strategy
-
Tip
16 Jul 2021
How to build a successful cloud data architecture
As enterprises vacate the premises and migrate their operations skyward, a cloud data architecture can provide the long-term flexibility to improve workflows, costs and security. Continue Reading
-
Tip
13 Jul 2021
Data modeling vs. data architecture: What's the difference?
Data modelers and data architects have distinctly different roles, but they work in a complementary fashion to help enterprises unlock and capitalize on data's business value. Continue Reading
By- David Loshin, Knowledge Integrity Inc.
-
Feature
07 Jul 2021
Meltano spins out from GitLab to advance DataOps platform
Douwe Maan, founder and CEO of Meltano, outlines the new data startup's approach as it raises seed funding to advance an open source ELT system. Continue Reading
-
Feature
28 Jun 2021
What an automated data integration implementation means
Automated data integration can reduce time spent by data professionals on repetitive tasks. Learn about strategies to help implement automated data integration. Continue Reading
By -
News
25 Jun 2021
Fivetran looks to Teleport Data for database replication
Fivetran is expanding its data integration capabilities with data validation technology that takes a different approach than change data capture for database replication. Continue Reading
-
News
11 May 2021
K2View updates DataOps platform with data fabric automation
A data operations platform vendor is bringing new capabilities to its data platform that will help organizations more easily integrate and automate the movement of data. Continue Reading
-
Feature
23 Apr 2021
Establish big data integration techniques and best practices
A big data integration strategy departs from traditional techniques, embraces several data processes working together and accounts for the volume, variety and velocity of data. Continue Reading
-
News
21 Apr 2021
Oracle brings GoldenGate data integration service to cloud
Oracle is making its GoldenGate real-time data technology available on its second-generation Oracle Cloud Infrastructure platform, as well as enabling multi-cloud operations. Continue Reading
-
News
16 Mar 2021
Starburst and Varada partner for Trino data platform effort
Managing Trino, the open source project formerly known as PrestoSQL, could get easier and faster with a new partnership from two leading vendors in the market. Continue Reading
-
News
12 Mar 2021
Flatfile looks to be universal translator for data loading
Startup raises new funding to help advance its vision for making it easier for business users to extract, load and transform data from one source to another. Continue Reading
-
News
09 Mar 2021
Apache Daffodil advancing Data Format Description Language
Data integration and data loading efforts could get easier to execute, as open source DFDL project becomes a Top-Level Project at the Apache Software Foundation. Continue Reading
-
News
02 Mar 2021
Airbyte set to advance open source data integration platform
The CEO of a data integration startup explains how he is looking to grow the technology and community behind the vendor's open source data extract and loading platform. Continue Reading
-
News
18 Feb 2021
Grafana Enterprise brings observability stack on premises
Grafana Labs is launching a new on-premises project stack for data observability, based on a series of open source projects that the company leads or supports. Continue Reading
-
Feature
11 Feb 2021
Talend CEO talks about vendor's growth strategy
With its cloud business a primary driver of growth, Talend is progressing toward the goal of increasing annual revenue from $250 million to $1 billion. Continue Reading
By- Eric Avidon, Senior News Writer
-
News
05 Feb 2021
Hazelcast Jet 4.4 brings SQL to stream processing engine
Hazelcast Jet brings new SQL query capabilities to the stream processing platform that will enable developers to continuously query streaming data without interrupting data flow. Continue Reading
-
Feature
22 Jan 2021
Data fabrics help data lakes seek the truth
Data fabrics can play a key role in aligning business goals with the integration, governance, reliability and democratization of information collected in massive data lakes. Continue Reading
-
News
20 Jan 2021
Fivetran data connectors boost enterprise data integration
An enterprise data integration vendor is building out its suite of data connectors with updates for organizations to create data pipelines for business processes and analytics. Continue Reading
-
Definition
04 Jan 2021
What is feature engineering?
Feature engineering is the process that takes raw data and transforms it into features that can be used to create a predictive model using machine learning or statistical modeling, such as deep learning. Continue Reading
-
News
22 Dec 2020
Ascend aims to ease data ingestion with low-code approach
Data platform vendor Ascend has announced a new low-code approach to building out data pipelines on cloud data lakes to accelerate analysis and insights. Continue Reading
-
Feature
16 Dec 2020
Data anonymization best practices protect sensitive data
See how data anonymization best practices can help your organization protect sensitive data and those who could be at risk if that data identified them. Continue Reading
By -
Feature
10 Dec 2020
The top 6 use cases for a data fabric architecture
Enterprise data fabric adoption has been on the rise as a way to ensure access and data sharing in a distributed environment. Here are the top use cases for data fabrics. Continue Reading
-
News
10 Dec 2020
Varada accelerates data virtualization with Presto
The new Varada Data Platform combines data virtualization with the open source Presto SQL query engine to help enable rapid searches on cloud data lakes. Continue Reading
-
Definition
21 Nov 2020
Google BigQuery
Google BigQuery is a cloud-based big data analytics web service for processing very large read-only data sets. Continue Reading
By -
News
08 Oct 2020
Denodo Platform 8.0 expands data virtualization features
The updated platform from Denodo looks to help organizations via enhanced features that connect and query disparate sources of data across different environments. Continue Reading
-
Feature
28 Aug 2020
Investment in talent key for data quality in healthcare
Investing in training employees on proper data gathering and management practices is crucial for healthcare organizations seeking to ensuring data quality and patient care. Continue Reading
-
Feature
18 Aug 2020
Informatica CEO outlines digital transformation challenges
Informatica chief Amit Walia gives insight into what organizations need most to enable digital transformation and why enterprise data management is at the foundation. Continue Reading
-
News
08 Jul 2020
SODA Foundation launches to unify open source data management
A new Linux Foundation-sponsored group will support open source data management and promote interoperability between applications and data sources, on premises or cloud-based. Continue Reading
-
News
07 Jul 2020
Informatica expands enterprise data catalog capabilities
Informatica brought new features to its enterprise data catalog, including Data Asset Analytics, a tool to help organizations understand the value of their data. Continue Reading
-
News
30 Jun 2020
Fivetran raises $100M to advance enterprise data integration
The co-founder and CEO of Fivetran talks about what the vendor is doing to help organizations meet the challenges of enterprise data integration. Continue Reading
-
Tip
23 Jun 2020
Trusted data is among governance, data integration benefits
Well-conceived governance programs injected with data integration tools can overcome the inherent distrust companies have in their own data stored in multiple systems. Continue Reading
By- Andy Hayler, Information Difference
-
News
18 May 2020
Grafana 7.0 from Grafana Labs expands data visualization
Distributed tracing data joins log metrics in Grafana 7.0 release, providing users with more ways to connect, observe and visualize data coming from different services. Continue Reading
-
Feature
30 Apr 2020
How a logical data fabric can improve data management
As data continues to grow across different sources, speakers at the Fast Data Strategy virtual summit outline how a logical data fabric approach can help. Continue Reading
-
Tip
09 Apr 2020
Developing an enterprise data strategy: 10 steps to take
Consultants detail 10 to-do items for data management teams looking to create a data strategy to help their organization use data more effectively in business operations. Continue Reading
By- Craig Stedman, Industry Editor
-
News
17 Mar 2020
Hazelcast Jet 4.0 boosts event streaming data platform
The vendor's real-time event streaming platform gets a boost as the newest version adds support for Python machine learning models to help make sense of the data deluge. Continue Reading
-
News
09 Mar 2020
Matillion Data Loader goes GA: No-code tool addresses data ingestion
Matillion's new tool debuts a SaaS approach to help connect and load data from disparate sources without requiring organizations to conduct data transformations. Continue Reading
-
Feature
06 Mar 2020
Pros and cons of the 4 best IPaaS software options
Integrating with your cloud data? Choosing between IPaaS software and vendors can be difficult. Here is a breakdown of four of the top-choice vendor offerings on the market. Continue Reading
By -
News
03 Mar 2020
Talend Data Fabric Winter '20 update brings data inventory
Talend's Winter '20 Data Fabric milestone update integrates a new data inventory capability alongside enhanced data pipeline designer capabilities. Continue Reading
-
News
24 Feb 2020
Lessons learned from Credit Karma GraphQL architecture
Credit Karma's vice president of engineering explains why and how the personal finance service is using the GraphQL data query technology to support its growing business. Continue Reading
-
News
19 Feb 2020
Dell EMC Streaming Data Platform integrates open source technology
Dell combines several open source streaming data technologies, including Apache Kafka, Apache Flink and Pravega, to create a new streaming data platform. Continue Reading
-
News
13 Jan 2020
Boomi acquisition of Unifi Software nets data management
Dell Boomi expands its data integration software portfolio by acquiring Unifi Software, providing data preparation and data catalog capabilities. Continue Reading
-
Feature
31 Oct 2019
Data silos and culture lead to data transformation challenges
Data continues to grow at a rapid rate, and users are faced with increasing complexity and challenges to make sense of it all in a way that helps improve business outcomes. Continue Reading
-
News
24 Oct 2019
Splunk advances Data-to-Everything initiative
Splunk execs outline the vendor's direction and new capabilities at its annual user conference, including the general availability of Data Fabric Search and Data Stream Processor. Continue Reading
-
Feature
11 Oct 2019
Data integration vs. ETL in the age of big data
Data integration provides a consistent view of business performance across multiple data sources, though it needs to keep up with the changing needs of organizations and the big data revolution. Continue Reading
By- Andy Hayler, Information Difference