Data profiling tools and techniques
Top Stories
-
Tip
28 Nov 2022
5 steps to an improved data quality assurance plan
Follow these steps to develop a data quality assurance plan and management strategy that can help identify data errors before they cause big business problems. Continue Reading
-
Tip
17 Oct 2022
Make data usability a priority on data quality for big data
To help make big data analytics applications more effective, IT teams must augment conventional data quality processes with measures aimed at improving data usability for analysts. Continue Reading
-
News
10 Feb 2022
Data quality startup Superconductive raises $40M
The vendor behind the open source Great Expectations data quality technology is looking to build a commercial cloud service to help data professionals accurately profile data. Continue Reading
-
Feature
16 Jul 2021
The value of PDF data extraction: Sifting for hidden data
During the process of data cleaning, there's a way to extract valuable hidden data. Learn how in this excerpt from 'Cleaning Data for Effective Data Science.' Continue Reading
-
Feature
30 Mar 2021
How a DataOps pipeline can support your data
DataOps has created a lot of hype as a data management pipeline because of its focus on collaboration and flexibility. Read on to find out how these priorities support your data. Continue Reading
-
Feature
22 Feb 2021
The top 5 graph database advantages for enterprises
Graph databases offer plenty of advantages to organizations in the way they connect data points to each other. Read on to see what experts say the top advantages are. Continue Reading
-
Feature
12 Feb 2021
Cloud data catalog benefits for the enterprise
Vendor cloud data catalog options are expanding and offering more automated tools to end users. Read on to find out how enterprises can benefit from these options. Continue Reading
-
Feature
04 Feb 2021
Data catalog comparison to help you choose your best fit
Data catalog options vary across vendors, but, as with most decisions in the data realm, it takes self-knowledge to make the right choice and understand each option's capabilities. Continue Reading
-
Feature
02 Dec 2020
Top 5 U.S. open data use cases from federal data sets
The U.S. government has made data sets from many federal agencies available for public access to use and analyze. Check out some of the ways that data is being used. Continue Reading
-
Feature
19 Nov 2020
Why understanding data structures is so important to coders
Jay Wengrow talks about how his new book on data structures and algorithms and considerations for making your choices as efficient as possible. Continue Reading
-
Feature
10 Sep 2020
Data mapping as a service, a modern form of data discovery
The CEO of ActiveNav provides insight into how data mapping fits into the data management landscape as the vendor launches a new data mapping-as-a-service platform. Continue Reading
-
Feature
14 Aug 2020
How to streamline your data cleansing process
Data cleansing is an important part of maintaining data quality, and the process is easier if you keep ahead of it by upholding governance and quality standards. Continue Reading
-
Feature
17 Jul 2020
Top 5 feature engineering tips for better models
From understanding a model's expected goal to factoring in subject matter expertise, experts talk about the best ways to improve your feature engineering. Continue Reading
-
News
11 Jun 2020
How Informa Markets cohered customer data as it absorbed UBM merger
Trade show organiser Informa Markets turned to Collibra software as it sought to improve data quality while making marketing communications more targeted and precise Continue Reading
-
Feature
16 Mar 2020
How to build an effective streaming data architecture
Data architecture can be tricky when it comes to real-time analytics. Clear objectives and scalability are important factors when determining the streaming data architecture you need. Continue Reading
-
News
05 Mar 2020
Alteryx 2020.1 highlighted by new data profiling tool
Holistic Data Profiling, a new tool to give users an overall view of their data during modeling, highlighted the latest platform update from the data management and analytics vendor. Continue Reading
-
Answer
21 Jan 2020
What are the main features of data catalog software?
Data catalogs are curated data portals for self-service analytics users. Learn about the capabilities of data catalog tools, vendors that sell them and how catalogs work. Continue Reading
-
Feature
10 Dec 2019
How to streamline feature engineering for machine learning
Structured data is necessary in machine learning, but sifting through data is time consuming. Streamlining the feature engineering process can help data scientists be more productive. Continue Reading
-
Feature
14 Nov 2019
How AI could save the enterprise data catalog
Enterprise data catalogs record all the databases and files in a corporation, but sometimes it can become out of date. Advances in AI are helping minimize the problem. Continue Reading
-
Feature
11 Nov 2019
Managing unstructured data is crucial to enterprises' AI goals
Unstructured data makes up a huge portion of most businesses' data volume. But, with data-hungry AI systems coming online, making sense of these stores has never been more important. Continue Reading
-
Tip
08 Oct 2019
7 steps to a successful data lake implementation
Flooding a Hadoop cluster with data that isn't well organized and managed can stymie analytics efforts. Take these steps to help make your data lake accessible and usable. Continue Reading
-
Opinion
24 May 2019
GDPR privacy concerns still brewing on law's first birthday
The first year of the much-debated EU data protection rule was subdued. High-profile fines for privacy breaches have yet to come, but regulators are starting to take action. Continue Reading
-
Feature
09 May 2019
Data modeling software tackles glut of new data sources
Data modeling platforms are starting to incorporate features to automate data-handling processes, but IT must still address entity resolution, data normalization and governance. Continue Reading
-
News
25 Mar 2019
Facebook alumni forge own paths to big data analytics tools
Startups Interana and Rockset differ in their approaches to providing new query capabilities on fast-arriving big data. Both are led by technologists who started at Facebook. Continue Reading
-
News
25 Mar 2019
Building a business glossary enhances data governance
Experts say data professionals should work to create a common vocabulary in organizations to help boost data governance and compliance with laws like GDPR. Continue Reading
-
News
11 Mar 2019
Data catalog software takes on data lakes, privacy laws
Data catalogs form a hub for managing enterprise data. New products focus on machine learning and AI add-ons that help automate aspects of data governance. Continue Reading
-
Feature
21 Feb 2019
DataOps is more than DevOps for data, Delphix CTO says
Data operations is young compared to DevOps, but it is increasingly used as part of projects that put data at the center of development. Here, Delphix CTO Eric Schrock makes observations about the trend. Continue Reading
-
News
18 Dec 2018
Datawatch Swarm on path to combine data prep, analytics
Datawatch plans to add analytics and data visualization tools to its Swarm data preparation platform, starting with integration capabilities in a Swarm 2.2 release. Continue Reading
-
Infographic
03 Dec 2018
Measuring worker performance data requires skillful managers
Emerging HR analytics tools make it easier for managers to collect data on employee experiences and better quantify workforce performance, but the data can lie when misinterpreted. Continue Reading
-
Tip
24 May 2018
Six data risk management steps for GDPR compliance
By layering data risk management processes into your data governance framework, you can ensure the personally identifiable information your company stores meets GDPR compliance rules. Continue Reading
-
News
03 May 2018
Qlik readies new Qlik Sense features for cloud, AI, big data
Self-service BI vendor Qlik is beginning to add a promised set of advanced functionality to its Qlik Sense software, but the features will be delivered in stages. Continue Reading
-
News
30 Apr 2018
Tableau Prep tool aims to ease Tableau data preparation work
Tableau users who previously had to rely on software from other vendors to prepare data now have a new option: Tableau Prep, the BI vendor's own data preparation tool. Continue Reading
-
Tip
30 Mar 2018
GDPR mandates push data quality improvement into IT spotlight
Data quality issues cost companies significant amounts of money in lost revenue and added expenses, and their impact will only get bigger when the EU starts enforcing its GDPR law. Continue Reading
-
News
13 Sep 2017
British Army enhances data-driven decision making to staunch churn
The British Army is continuing to use SAS analytics software to improve its data management, with a particular focus on reducing high-value personnel churn Continue Reading
-
Feature
13 Mar 2017
Silicon Valley startups aim to make big data capture and prep slicker
A group of California-based startup and early-stage data analytics and management companies are bidding to make big data, including sensor data, more tractable for analysis Continue Reading
-
Buyer's Guide
24 Oct 2016
How to determine which data governance tool best meets your needs
This buyer's guide provides insights to help you determine if your organization could benefit from data governance software and how to navigate the buying process. Continue Reading
-
Feature
28 Sep 2016
Examining the top data governance tools on the market
Expert John Ladley examines the leading data governance software products, comparing and contrasting their features to help you determine which tool will best meet your needs. Continue Reading
-
Feature
19 Sep 2016
Alation Data Catalog helps provide collaborative data governance
Alation Data Catalog provides business analysts and data stewards with search and discovery, governance and collaboration functionality, and automates many data governance tasks. Continue Reading
-
Feature
29 Aug 2016
What you should know about Collibra Data Governance Center
Collibra Data Governance Center is a repository- and workflow-oriented data governance platform that also offers features for data management and data stewardship. Continue Reading
-
Feature
25 Aug 2016
How to narrow down your choices for buying a data governance tool
Evaluating and selecting a data governance tool depends on not only features and functionality, but also how you will use the tool to add value to your organization. Continue Reading
-
Feature
21 Apr 2016
What to know about the IBM Information Governance Catalog
IBM's Information Governance Catalog provides organizations with a workflow-oriented data governance tool for organizing, managing and accessing their data assets. Continue Reading
-
News
29 Jan 2016
Data quality metrics a governance must, managers say
Data governance managers who spoke during an online conference said that tracking business-oriented metrics on data quality improvement is a key to success in governance efforts. Continue Reading
-
Feature
28 Feb 2014
Identifying data quality issues via data profiling, reasonability
In a book excerpt, author Laura Sebastian-Coleman explores data profiling, data issue management and using reasonability checks in assessing quality. Continue Reading
-
Feature
28 Feb 2014
Dissecting data measurement: Key metrics for assessing data quality
In a book excerpt, data quality architect Laura Sebastian-Coleman explains data assessment terminology and details a framework for measuring quality. Continue Reading
-
Tip
16 Jan 2014
Using data profiling techniques -- and estimating the effort required
Data profiling is a key part of data quality efforts. Here's a simple formula for calculating the amount of time needed to profile a data set. Continue Reading
-
Tip
20 Aug 2013
Data governance tools: Part, but not all, of the governance puzzle
While tools designed for data governance are helpful, organizations must also implement best practices and standard processes to be effective. Continue Reading
-
News
01 May 2013
British Army data quality programme tackles ‘whole army’ concept
The British Army’s data quality programme faces a challenge with moves to unify regular and territorial soldiers into one force Continue Reading
-
Feature
09 Apr 2013
Microsoft SQL Server data profiling tool put to work
Andy Hogg demonstrates how to clean up dirty data with the data profiling tool that comes with Microsoft SQL Server Continue Reading
-
Feature
14 Nov 2012
Data quality essential to master data management
It is possible to have a data quality initiative without master data management, but every MDM project must have a data quality element Continue Reading
-
News
01 Nov 2012
West Midlands Police develops golden view of criminals, suspects
West Midlands Police, the second largest force in the UK, seeks to reduce risk to its officers and the public by using DataFlux software that gives a master record for criminals and suspects. Continue Reading
-
Feature
31 Oct 2012
Successful data stewardship framework needs solid plan, firm focus
Stewarding data can be a tough nut to crack: lots of effort for a reward that isn't always apparent. To succeed, strong project management is needed. Continue Reading
-
News
28 Mar 2012
IBM users reveal five data governance best practices to remember
IBM customers Nationwide Insurance and Cardinal Health reveal five rules of thumb they learned while implementing highly ambitious data governance programs. Continue Reading
-
News
08 Mar 2012
Data governance programs expose hills to climb on path to success
IT professionals from Sallie Mae and Fannie Mae offered insight on data governance challenges and tips on how to overcome them in separate sessions at two recent conferences. Continue Reading
-
News
30 Dec 2010
Top seven data management stories of 2010
The top data management stories of 2010 include SaaS-based data integration, data warehouse appliances, the SAP-Sybase acquisition and more. Continue Reading
-
News
27 Aug 2010
Increase the success of data governance programs from the bottom up
Data governance programs are often overlooked, pushed aside and just plain ignored through a lack of executive interest and funding. But some technology professionals are making the most of the situation. Continue Reading