Data Management: Page

What is data transformation? Definition, types and benefits

Data transformation is the process of converting data from one format -- such as a database file, Extensible Markup Language (XML) document or Excel spreadsheet -- into another format.

By Stephen Bigelow, Mary Pratt, Rahul Awati • May 5, 2025

The difference between data cleansing and data transformation

Data cleansing corrects errors to improve data quality, while data transformation changes data format and structure to support analytics processes.

By Jacob Roundy • May 2, 2025

Fivetran adds reverse ETL with acquisition of Census

The data integration specialist's purchase provides users with complementary capabilities that enable them to send transformed data back to applications where decisions are made.

By Eric Avidon • May 2, 2025

StarTree aims to simplify AI development with new features

The database vendor plans to add support for Model Context Protocol and automated vector embedding capabilities to make it faster and easier to benefit from agentic AI.

By Eric Avidon • April 30, 2025

StarTree aims to simplify AI development with new features

The database vendor plans to add support for Model Context Protocol and automated vector embedding capabilities to make it faster and easier to benefit from agentic AI.

By Eric Avidon • April 30, 2025

Acceldata launches agentic AI-powered anomaly detection

The data observability specialist's new feature uses agentic AI to ensure that the data used to inform analytics and AI tools is high quality and won't lead to poor decisions.

By Eric Avidon • April 29, 2025

7 data cleansing best practices

Organizations rely on data for analytics and decision-making, but if that data is flawed, inconsistent or otherwise unreliable, it's not as valuable.

By Robert Sheldon • April 24, 2025

Unified databases: A powerhouse behind generative AI success

Unified databases support generative AI (GenAI) by integrating all data types into a single platform, streamlining infrastructure and improving scalability, speed and trust.

By Stephen Catanzano • April 24, 2025

What is a stored procedure?

A stored procedure is a set of Structured Query Language (SQL) statements that multiple programs can reuse and share to perform specific tasks.

By Adam Hughes, Rahul Awati • April 23, 2025

An explanation of data science and data scientist jobs

Data science uses advanced analytics techniques to gain insights, especially for business use cases.

By Sabrina Polin • April 22, 2025

What is data profiling?

Data profiling refers to the process of examining, analyzing, reviewing and summarizing data sets to gain insight into the quality of data.

By Sarah Lewis, Mary Pratt, Alexander Gillis • April 18, 2025

Monte Carlo launches first agents for data observability

Though the vendor already provides monitoring and troubleshooting capabilities, generative AI-powered agents for each aim to make instantaneous tasks that previously took days.

By Eric Avidon • April 17, 2025

What is a data lake?

A data lake is a storage repository that holds a vast amount of raw data in its native format until it is needed for analytics applications.

By Ben Lutkevich, Nick Barney, Craig Stedman • April 16, 2025

Google enters new era of AI for data with launch of agents

Agentic AI applications for data engineering and data science along with a new underlying knowledge engine aim to make data management and analytics easier and more efficient.

By Eric Avidon • April 9, 2025

New AI-powered tools from Dremio target data discovery

With relevant data key to developing accurate AI and analytics applications, the data lakehouse specialist's latest features target making data faster and easier to find.

By Eric Avidon • April 8, 2025

Snowflake embraces open source with full support for Iceberg

Three years after providing limited support for open data storage, the data platform vendor is signaling its embrace of open source with full support for the open table format.

By Eric Avidon • April 8, 2025

Databricks simplifies data ingestion with Lakeflow Connect

With preconfigured connectors to Salesforce and Workday -- and more to follow -- the data cloud and AI vendor is taking aim at streamlining data ingestion.

By Eric Avidon • April 2, 2025

Informatica adds to Claire lineup of GenAI capabilities

New copilots for data integration and iPaaS highlight the vendor's Spring 2025 release, along with a tool aimed at simplifying access to unstructured data to fuel AI development.

By Eric Avidon • April 2, 2025

Coalesce acquires data catalog upstart to aid transformation

After raising $50 million in venture capital funding in 2024, the startup acquired CastorDoc to add AI-powered data catalog capabilities to its data preparation platform.

By Eric Avidon • March 19, 2025

Confluent launches Tableflow to ease use of streaming data

The vendor's new feature enables users to convert event data to tables that developers and engineers can search and discover to inform AI and BI applications.

By Eric Avidon • March 19, 2025

AWS unifies analytics and AI development in SageMaker

In a move that brings previously disparate analytics and AI development tasks together in one environment with data management, Unified Studio is now generally available.

By Eric Avidon • March 14, 2025

Vast Data targets secure, speedy agentic AI development

The vendor is furthering its expansion into AI development with features such as vector search and event streaming aimed at enabling users to build and maintain agents.

By Eric Avidon • March 12, 2025

What is data preprocessing? Key steps and techniques

Data preprocessing, a component of data preparation, describes any type of processing performed on raw data to prepare it for another data processing procedure.

By Kinza Yasar , George Lawton • March 12, 2025

New Databricks tools tackle lingering GenAI accuracy issues

Features such as centralized model governance and real-time monitoring aim to improve the accuracy of outputs so that enterprises can confidently scale beyond experimentation.

By Eric Avidon • March 10, 2025

7 U.S. tech policies to watch in 2025

The Trump administration is already enacting new tech policies, seeking to establish the U.S. as a global leader in AI development and innovation while reducing red tape on Big Tech.

By Madeleine Streets • March 6, 2025