Data Management: Page

Use RAG with LLMs to democratize data analytics

Pairing retrieval-augmented generation with an LLM helps improve prompts and outputs, democratizing data access and making previously elusive information available to more users.

By Bill Schmarzo • Aug. 13, 2024

10 top vector database options for similarity searches

Vector databases excel in different areas of vector searches, including sophisticated text and visual options. Choose the platform that best fits organizational needs.

By Donald Farmer • Aug. 8, 2024

What is the Coalition for Secure AI (CoSAI)?

Coalition for Secure AI (CoSAI) is an open source initiative to enhance artificial intelligence's security.

By Ava DePasquale • Aug. 8, 2024

6 steps in fact-checking AI-generated content

Generative AI tools are now prevalent, yet the extent of their accuracy isn't always clear. Users should question an AI's outputs and verify them before accepting them as fact.

By Cameron Hashemi-Pour • Aug. 6, 2024

Generative AI shines spotlight on data governance and trust

Generative AI creates new opportunities for how organizations use data. Strong data governance is necessary to build trust in the data AI models use.

By Stephen Catanzano • Aug. 6, 2024

An explanation of large language models

Large language models can be traced back to 1966 but are significantly more sophisticated today.

By Sabrina Polin • Aug. 5, 2024

What is a data flow diagram (DFD)?

A data flow diagram (DFD) is a graphical or visual representation that uses a standardized set of symbols and notations to describe a business's operations through data movement.

By Scott Robinson , Tom Nolle • Aug. 2, 2024

New Snowflake service enables secure AI, ML deployment

Snowpark Container Services aims to provide the vendor's users with a secure environment for deploying and managing models and applications without having to move their data.

By Eric Avidon • Aug. 1, 2024

An explanation of prompt engineering

Prompt engineering is responsible for training AI language models to ensure accurate outputs in AI chatbots.

By Tommy Everson • Aug. 1, 2024

New features make Google’s Spanner a database for AI

The introduction of graph processing, vector search and full-text search optimize Spanner for developing and managing modern applications and models, including GenAI.

By Eric Avidon • Aug. 1, 2024

What is data democratization?

Data democratization makes information in a digital format accessible to the average end user.

By Scott Robinson • July 31, 2024

Astronomer adds DBT Core support to data orchestration suite

The vendor's latest Astro platform update integrates the open source transformation tool to help users better prepare information for analytics and AI models and applications.

By Eric Avidon • July 31, 2024

What is data loss prevention (DLP)?

Data loss prevention (DLP) -- sometimes referred to as 'data leak prevention,' 'information loss prevention' or 'extrusion prevention' -- is a strategy to mitigate threats to critical data.

By Garry Kranz, Andy Patrizio, Cameron Hashemi-Pour • July 30, 2024

What is denormalization and how does it work?

Denormalization is the process of adding precomputed redundant data to an otherwise normalized relational database to improve read performance.

By Jack Vaughan, Rahul Awati, Gavin Wright • July 29, 2024

What is electronic data processing (EDP)?

Electronic data processing (EDP) refers to the gathering of data using electronic devices, such as computers, servers and internet of things (IoT) technologies.

By Rahul Awati, Cameron Hashemi-Pour • July 26, 2024

What is data lifecycle?

A data lifecycle is the sequence of stages that a unit of data goes through from its initial generation or capture to its archiving or deletion at the end of its useful life.

By Paul Kirvan, Cameron Hashemi-Pour, Ivy Wigmore • July 26, 2024

What are data silos and what problems do they cause?

A data silo is a repository of data that's controlled by one department or business unit and isolated from the rest of an organization, much like grass and grain in a farm silo are closed off from outside elements.

By Scott Robinson, Craig Stedman, Aislyn Fredsall • July 25, 2024

What is data labeling?

Data labeling is the process of identifying and tagging data samples commonly used in the context of training machine learning (ML) models.

By Cameron Hashemi-Pour, Alexander Gillis, Ivy Wigmore • July 25, 2024

How to use a data governance maturity model

A data governance maturity model identifies where current operations are lacking and how to make improvements that better protect and use data.

By Jeff McCormick • July 25, 2024

Cloud database comparison: AWS, Microsoft, Google and Oracle

Here's a look at the rival cloud database offerings from AWS, Google, Microsoft and Oracle based on their product breadth, migration capabilities and pricing models.

By Chris Foot • July 24, 2024

What is a data architect?

A data architect is an IT professional responsible for defining the policies, procedures, models and technologies used in collecting, organizing, storing and accessing company information.

By Scott Robinson , Tom Nolle • July 24, 2024

IoT data management extends best practices to the edge

IoT devices generate and collect data from points all over the network. Organizations must apply general data management best practices to get the most value from IoT data.

By Mary Pratt • July 22, 2024

An explanation of advanced vs. predictive analytics

Predictive analytics is a type of advanced analytics. Learn more in this video.

By Sabrina Polin • July 18, 2024

What is a vector database?

A vector database is a type of database technology that's used to store, manage and search vector embeddings, numerical representations of unstructured data that are also referred to simply as vectors.

By Sean Kerner • July 17, 2024

Qlik launches Talend Cloud, aims to ensure data is trusted

The longtime BI vendor's new integration platform aims to deliver trust in the information users work with to inform analytics and AI models and applications.

By Eric Avidon • July 17, 2024