Data Management

MongoDB 4.0, Stitch aim to grow NoSQL apps in cloud, on-prem

NoSQL vendor MongoDB upgraded its database software with ACID support, while also releasing a serverless platform intended to simplify application development. Continue Reading

By

• Craig Stedman, Senior Reporter

Three factors for protecting sensitive data in the GDPR era

Data privacy is a hot topic nowadays thanks to GDPR and the Facebook data scandal. But how do data security, access control and data protection differ? Continue Reading

By

• David Loshin, Knowledge Integrity Inc.

What's the difference between DDL and DML?

What's the difference between DDL and DML? Get the answer and see examples of data manipulation language and data definition language commands for SQL databases. Continue Reading

By

• Bridget Botelho

Hadoop data lake architecture tests IT on data integration

Hortonworks users talk about building Hadoop data lakes to support new applications -- and the challenges their teams face on ingesting and refining data for end users. Continue Reading

By

• Jack Vaughan

Hortonworks cloud options grow via Google, Microsoft, IBM

Hortonworks now supports Google Cloud Storage and has also broadened cloud deals with Microsoft and IBM, aiming to increase cloud uses of its big data platform. Continue Reading

By

• Jack Vaughan

What goes into a customer analytics data integration framework

Customer data integration is a minefield for IT teams to navigate. But incorporating a set of core technical functions into an integration architecture can ease the process. Continue Reading

By

• David Loshin, Knowledge Integrity Inc.

Data integration techniques to help keep BI data consistent

Data integration processes that aren't managed properly can create inconsistent data in BI and analytics applications. Here are some steps to avoid that problem. Continue Reading

By

• David Loshin, Knowledge Integrity Inc.

Google Cloud data lake fuels cloud payment processing flow

To create a cloud payment processing system, Global Payments first had to deploy a data lake in the Google Cloud. Getting quick user feedback was another early step. Continue Reading

By

• Jack Vaughan

Why Spark DataFrame, lazy evaluation models outpace MapReduce

Learn how the Spark DataFrame execution plan works and why its lazy evaluation model helps the processing engine to avoid the performance issues inherent in Hadoop MapReduce. Continue Reading

By

• David Loshin, Knowledge Integrity Inc.

Develop smart AI in CRM strategies to win and keep customers

Of the three words that comprise customer relationship management, one word binds the other two. As necessity and competition dictate that CRM upgrade itself with artificial intelligence and flights to the cloud, what counts most in successful sales, support and marketing is the relationship companies maintain with their customers and the management of that relationship. The trick is to engage consumers with the most technologically advanced methods by way of chatbots, email, texts, social media and location services, while satisfying that very personal and delicate human connection based on trust.

The June issue of Business Information opens with our editor's note and an examination of the enormous potential of AI in CRM to improve communication with customers and personalize customer service -- the core of a company's ultimate success. Yet technological personalization devoid of human contact can produce the unintended consequences of depersonalizing and jeopardizing those critical relationships.

Along those lines, our cover story emphasizes the importance of devising smart AI in CRM strategies that take this delicate balance into account while focusing attention on today's more knowledgeable, more demanding and technologically savvy consumers. In another feature, we evaluate the factors to consider when choosing the right CRM public, private or hybrid cloud model, and that choice should depend on a company's size, needs, regulatory requirements and artificial intelligence strategies.

Also in this issue, AI applications created and developed specifically for space exploration are finding their way into the enterprise, thanks to a special collaboration between NASA and a business entrepreneur. In addition, designing a human-like chatbot with a winning personality requires a business-minded approach that speaks the customers' language. And as AI and cloud apps take on greater significance in CRM, marketers divulge several problems on the way to deployment and admit they're partly to blame.

 Continue Reading

Starburst finds new worlds to conquer with SQL query engine

Relational databases may have hit a wall of late, but the SQL query engine seems poised for wider growth. Starburst, a retro startup of sorts, is among those looking to take it wider still. Continue Reading

By

• Jack Vaughan

GDPR compliance requirements drive new winds of data privacy

Hello, GDPR. May 25 is the witching hour for enforcement of the EU's much-discussed GDPR compliance requirements -- and it's a harbinger of more changes to come. Continue Reading

By

• Jack Vaughan

Six data risk management steps for GDPR compliance

By layering data risk management processes into your data governance framework, you can ensure the personally identifiable information your company stores meets GDPR compliance rules. Continue Reading

By

• David Loshin, Knowledge Integrity Inc.

AP uses data.world platform to spread data journalism

Data journalism reporters need tools that deliver quick context for stories on deadline. A data collaboration platform from data.world helps the Associated Press meet such needs. Continue Reading

By

• Jack Vaughan

GPU databases bring greater parallelism to big data processing

GPU databases offer a new way to process data. 451 Research analyst James Curtis discusses where they fit in big data applications, particularly for parallel processing. Continue Reading

By

• Jack Vaughan

CockroachDB database wagered on for scalability boost, GDPR

CockroachDB is an open source distributed database designed for processing on a global scale, a need that online gambling company Kindred Group hopes it can meet. Continue Reading

By

• Jack Vaughan

Why running SQL Server on Docker is no longer frowned upon

Microsoft now lets SQL Server databases run in Docker containers, a capability that depends on using volumes to store data in a persistent way outside the containers. Continue Reading

By

• Brien Posey

What the Microsoft GDPR compliance toolkit offers for SQL Server

The set of GDPR compliance tools that Microsoft offers for SQL Server is designed to make it easier for users of the database software to adhere to the EU's new data rules. Continue Reading

By

• Lindsay Moore

GDPR rules can spur broader steps to protect sensitive data

Companies need to make compliance with GDPR's requirements on managing personal data a priority, but they should also work to implement wider data protection efforts in the future. Continue Reading

By

• David Loshin, Knowledge Integrity Inc.

Data integrity protection spurs greater security spending

As hacking, ransomware and malware attacks mount, companies place big data protection and integrity among the primary reasons for increased spending on security software. Continue Reading

By

• Ron Karjian, Industry Editor

IoT, edge computing spawn new security issues

 Continue Reading

IT teams take big data security issues into their own hands

 Continue Reading

GDPR requirements put focus on data ethics, governance

 Continue Reading

Data integrity protection spurs greater security spending

 Continue Reading

U.S. data protection laws fall short in the age of big data

 Continue Reading

Security of big data fashions a whole new look with GDPR

As data managers scramble to protect their precious lakes of washed and unwashed data from the evils of hacking, malware, ransomware and botnets, there comes a privacy regulation of European Union origin that could change the way many U.S. companies protect their data from inside and outside forces. For some U.S. companies doing business in Europe and preparing for compliance, the EU's General Data Protection Regulation could be a well-intended enforcer of better data governance practices. But for businesses forced to change their old data protection habits, GDPR can be a four-letter word.

The April issue of Business Information opens with our editor's note and historical insights into the fundamental differences in attitude between the U.S. and Europe when it comes to protecting the data privacy of customers. As data breaches mount, however, the U.S. government -- willing or not -- may have to take steps beyond current regulations to ensure companies increase their security of big data.

Along those lines, our cover story examines some GDPR rules that can directly impact U.S. companies doing business overseas and, in the process, their data governance and ethics procedures. With the noted lack of maturity in data governance and security tools, we see in another feature how IT teams are addressing data security issues upfront in do-it-yourself ways when deploying big data systems.

Also in this issue, a GDPR compliance expert advises data managers on the best ways to prepare for a regulation that puts more control of information in the hands of users, the internet of things and edge computing could be compromising the security of big data and surveys show that companies place data protection among the top reasons for escalating their security spending.

 Continue Reading

GDPR requirements put focus on data ethics, governance

The General Data Protection Regulation makes privacy paramount and reinforces the practice of good data governance. Will a new focus on data ethics be an important side effect? Continue Reading

By

• Jack Vaughan

U.S. data protection laws fall short in the age of big data

Data breaches and a history of data abuse led the EU to adopt GDPR, but it might take massive scale data security crises for the U.S. to legislate similar data protection laws. Continue Reading

By

• Bridget Botelho

IT teams take big data security issues into their own hands

Data security needs to be addressed upfront in deployments of big data systems -- and users are likely to find they have to build some security capabilities themselves. Continue Reading

By

• Craig Stedman, Senior Reporter

Information architecture applied to big data streaming, AI

New technologies challenge data professionals, but taking a step back helps with hurdles. In this interview, consultant William McKnight takes a measured look at data streaming, GDPR and AI. Continue Reading

By

• Jack Vaughan

Cloud workloads, data lakes challenge information architecture

Data management options are expanding; cloud workloads are an example. That means changing your approach to information architecture, says data management expert William McKnight. Continue Reading

By

• Jack Vaughan

GDPR mandates push data quality improvement into IT spotlight

Data quality issues cost companies significant amounts of money in lost revenue and added expenses, and their impact will only get bigger when the EU starts enforcing its GDPR law. Continue Reading

By

• Andy Hayler, Information Difference

Kubernetes container orchestration gets big data star turn

The new thing in big data is Kubernetes container orchestration. While it's still early, there are signs of activity, which are cited in this edition of the Talking Data podcast. Continue Reading

By

• Jack Vaughan

Kubernetes gains momentum in big data implementation process

Big data vendors and users are looking to Kubernetes-managed containers to help accelerate deployments and enable more flexible use of computing resources. Continue Reading

By

• Craig Stedman, Senior Reporter

IT, others focus efforts as GDPR implementation date looms

The EU's General Data Protection Regulation is meant to bring better data privacy to bear in the age of big data. How GDPR implementation will proceed remains to be seen. Continue Reading

By

• Jack Vaughan

Streaming tool from StreamSets eyes data in motion for GDPR

StreamSets software for inspecting big data brings governance to data in motion. Such capabilities may find more use as the European Union's GDPR deadline looms. Continue Reading

By

• Jack Vaughan

What does the GDPR definition of personal data include?

The definition of personal data in the EU's GDPR data protection rules is broad enough to include any type of data that can be used to directly or indirectly identify a person. Continue Reading

By

• Bridget Botelho

Data expert: GDPR deadline is an opportunity, not a burden

There is stress as the EU's General Data Protection Regulation compliance deadline nears, but the GDPR privacy movement is a good thing for data policies, advises consultant Daragh O Brien. Continue Reading

By

• Jack Vaughan

Google TPUs open up on cloud; LinkedIn intros Hadoop Dynamometer

In big data news, we find Google TPUs, or Tensor Processing Units, offered as a cloud service, while LinkedIn is open sourcing a Hadoop test simulator called Dynamometer. Continue Reading

By

• Jack Vaughan

TensorFlow

TensorFlow is an open source framework developed by Google researchers to run machine learning, deep learning and other statistical and predictive analytics workloads. Continue Reading

By

• Jack Vaughan

Hyperledger Fabric offers path to enterprise blockchain future

Blockchain arose from bitcoin, but it's looking to find a place in the enterprise. Frameworks like Hyperledger Fabric could smooth out the technology's rough side for business uses. Continue Reading

By

• Jack Vaughan

MongoDB 4.0 takes ACID transactions to multi-document level

MongoDB is taking a deeper step into SQL-style processing waters with a 4.0 update that brings increased support for ACID-compliant transactions to its NoSQL database. Continue Reading

By

• Jack Vaughan

Data analytics architecture must break down higher ed silos

Siloed data isn't only a problem for businesses. It's also a big issue for many large universities -- one that their data infrastructures need to resolve for effective analytics. Continue Reading

By

• David A. Teich

Data catalog software takes open data initiative to the streets

Data catalog software from Alation helped San Diego's chief data officer open up the city's data to residents, as well as city planners and other government workers. Continue Reading

By

• Jack Vaughan

Data managers should study up on GPU deep learning

As GPU deep learning becomes more common, data managers will have to navigate several new layers of complexity in their quest to build or buy suitable data infrastructure. Continue Reading

By

• Jack Vaughan

Three ways to turn old files into Hadoop data sets in a data lake

Hadoop data lakes offer a new home for legacy data that still has analytical value. But there are different ways to convert the data for use in Hadoop depending on your analytics needs. Continue Reading

By

• David Loshin, Knowledge Integrity Inc.

How AI and IoT will influence data management in 2018

AI and IoT will alter the data management landscape in 2018, according to analyst James Kobielus. AI will need regular updates, and DevOps will become more prevalent as a result. Continue Reading

By

• Jack Vaughan

Apache Hadoop 3.0 goes GA, adds hooks for cloud and GPUs

Is this the post-Hadoop era? Not in the eyes of Hadoop 3.0 backers, who see the latest update to the big data framework succeeding in machine learning applications and cloud systems. Continue Reading

By

• Jack Vaughan

How SQL Server containers in Docker can ease database deployment

Docker containers can make the SQL Server deployment process more efficient and flexible. Here's what they are and how to get started on creating containers for SQL Server databases. Continue Reading

By

• Robert Sheldon

Dimension tables vs. fact tables: What's the difference?

Fact tables and dimension tables are used together in star schemas to support data analytics applications. But they play different roles and hold different types of data. Continue Reading

By

• David Loshin, Knowledge Integrity Inc.

NewSQL databases rise anew -- MemSQL, Spanner among contenders

The NewSQL database was almost hidden when Hadoop and NoSQL arose. Now, as more big data teams move toward production uses, MemSQL, Cloud Spanner and similar products may get a second look. Continue Reading

By

• Jack Vaughan

Bank sees ETL processes evolve from IT to front-line users

ETL jobs -- once the sole province of IT -- take on a new form as data wrangling and self-service gain greater traction with business users of analytics. Continue Reading

By

• Jack Vaughan

Data management processes take on a new tenor in analyst's view

Changes in data management processes -- including self-service data preparation, data lakes and real-time analytics -- create a new landscape in companies, according to analyst Matt Aslett. Continue Reading

By

• Jack Vaughan

Chief data officer jobs call for nurturing data ethos in companies

In many organizations, chief data officer jobs centered on defense against risk are giving way to ones emphasizing innovation. To do so, CDOs must nurture a data culture, MIT panelists said. Continue Reading

By

• Jack Vaughan

Quiz: What's your IQ on data lake implementation and management?

A data lake can provide lots of analytics value to an organization. This quiz can tell you if you know what it takes to deploy and manage one; it also contains info to help boost your knowledge. Continue Reading

By

• Tréa Lavery, Editorial Assistant

Operational data store vs. data warehouse: How do they differ?

Operational data stores and data warehouses both store operational data, but the similarities between them end there -- and they both have a role to play in analytics architectures. Continue Reading

By

• Craig Stedman, Senior Reporter

Many say yes to NoSQL software for easing big data management woes

NoSQL software is seen answering the need for a more flexible database framework to capture, manipulate and analyze massive amounts of unstructured data. Continue Reading

— http://searchdatamanagement.techtarget.com

Microsoft SQL Server Management Studio (SSMS)

Microsoft SQL Server Management Studio (SSMS) is an integrated environment to manage a SQL Server infrastructure. Continue Reading

By

• Jessica Sirkin
• Adam Hughes

How to select the best DBMS software: A buyer's guide

Learn how to evaluate and buy the best DBMS software for your organization. Continue Reading

A look at the leading operational database management systems

The market for operational DBMS products can be confusing, especially with so many choices. But knowing your application requirements can help point you in the right direction. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Options for scaling out SQL Server applications to boost workloads

Scaling out a database to meet the needs of a heavy processing workload can be a challenge. Here are details on the SQL Server scalability methods available to ease the process. Continue Reading

By

• Brien Posey

What are key features for choosing the best ETL tools for your needs?

Choosing the right ETL tool for your data integration requirements can be a challenge. Here's a rundown on what to look for in ETL software and potential vendors to consider. Continue Reading

By

• Craig Stedman, Senior Executive Editor

Microsoft SQL Server 2016 relational DBMS overview

Microsoft SQL Server 2016 for Windows comes in four editions, with updates that include a new stretch database feature, Polybase, dynamic data masking and more. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Reltio master data management architecture rides graph analytics wave

An onslaught of unstructured data, social and otherwise may change the nature of master data management platforms. Reltio Cloud may stand as an indicator. Continue Reading

By

• Jack Vaughan

How to determine which data governance tool best meets your needs

This buyer's guide provides insights to help you determine if your organization could benefit from data governance software and how to navigate the buying process. Continue Reading

Examining the top data governance tools on the market

Expert John Ladley examines the leading data governance software products, comparing and contrasting their features to help you determine which tool will best meet your needs. Continue Reading

By

• John Ladley

Alation Data Catalog helps provide collaborative data governance

Alation Data Catalog provides business analysts and data stewards with search and discovery, governance and collaboration functionality, and automates many data governance tasks. Continue Reading

By

• Sue Hildreth

HPE sells Vertica analytics, thanks to the growth of open source software

HPE is paring down its software holdings, including analytical database software in the Vertica line and other big data tools. A sale to Micro Focus is due to close next year, leaving users in some limbo for now. Continue Reading

By

• Jack Vaughan

What you should know about Collibra Data Governance Center

Collibra Data Governance Center is a repository- and workflow-oriented data governance platform that also offers features for data management and data stewardship. Continue Reading

By

• T.J. Houpes

How to narrow down your choices for buying a data governance tool

Evaluating and selecting a data governance tool depends on not only features and functionality, but also how you will use the tool to add value to your organization. Continue Reading

By

• John Ladley

Exploring the features of Oracle Enterprise Manager 13c

Cloud Control, a feature of Oracle Enterprise Manager 13c, can be used to monitor and manage databases, middleware, infrastructure and hardware running on-premises or in the cloud. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Inside BMC's database performance tools for DB2 for z/OS

BMC offers several tools to help DBAs manage and prevent critical performance issues in DB2 for z/OS, as well as monitoring options for other vital mainframe subsystems. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Inside the SAP Data Services data integration tool

SAP Data Services can be used alone or with other SAP products to provide data integration, transformation, data quality, data profiling and text data processing. Continue Reading

By

• Rick Sherman, Athena Solutions

An overview of the Pentaho Data Integration platform

The Pentaho Data Integration platform enables organizations to integrate, blend, convert and transform data from any data source across their entire enterprise. Continue Reading

By

• Rick Sherman, Athena Solutions

Examining the functions and features of database performance tools

To help you determine which tools your organization needs, it's important to review the primary features and functionality of the three database performance tools categories. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Three indicators that could signal database performance issues

Database performance monitoring and management tools can be used to mitigate issues and help organizations be more proactive, so they can avoid performance problems and outages. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

What you need to know about Oracle Data Integrator 12c

Oracle Data Integrator 12c works with several other Oracle products to leverage the capabilities of RDBMSs for processing and transforming data. Continue Reading

By

• Rick Sherman, Athena Solutions

What you need to know about database performance software

Database performance software identifies bottlenecks and points of contention, monitors workload and throughput, and manages system and DBMS resource usage. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Inside the MapR Hadoop distribution for managing big data

The MapR Hadoop distribution replaces HDFS with its proprietary file system, MapR-FS, which is designed to provide more efficient management of data, reliability and ease of use. Continue Reading

By

• Abie Reifer

What to know about the IBM Information Governance Catalog

IBM's Information Governance Catalog provides organizations with a workflow-oriented data governance tool for organizing, managing and accessing their data assets. Continue Reading

By

• T.J. Houpes

A buyer's guide to selecting the best data warehouse product

With several deployment options and product choices, it's difficult to know where to start. This buyer's guide helps you choose the right data warehouse product for your company. Continue Reading

Unstructured data is a misnomer

Nowadays, the term unstructured data pops up everywhere. It owes its popularity for a large part to the success of big data, to successful technologies such as NoSQL and Hadoop, and to formats such ... Continue Reading

By

• Rick van der Lans

Five factors to help select the right data warehouse product

How big is your company, and what resources does it have? What are your performance needs? Answering these questions and others can help you select the right data warehouse platform. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

A look inside the SAP IQ column-oriented database

The SAP IQ column-oriented database is designed for large data warehouses that require high scalability, rapid data loading and optimal query performance. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Examining the Teradata Data Warehouse

With both relational and columnar options, the Teradata Active Enterprise Data Warehouse gives companies an efficient, scalable appliance they can deploy in-house or in the cloud. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Evaluating the key features of data warehouse platforms

Choosing between the different types of data warehouse platforms can be simplified once you know which deployment option best meets your project requirements. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

What to expect from Oracle Exadata Database Machine

Oracle Exadata Database Machine combines hardware and software to enable analytics, batch, reporting and other tasks to run simultaneously within and across databases. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Examining the IBM PureData System for Analytics appliance

Powered by Netezza technology, the IBM PureData System for Analytics data warehouse appliance enables users to execute complex queries and get results quickly. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Data quality metrics a governance must, managers say

Data governance managers who spoke during an online conference said that tracking business-oriented metrics on data quality improvement is a key to success in governance efforts. Continue Reading

By

• Craig Stedman, Senior Reporter

The benefits of deploying a data warehouse platform

Big data may be all the rage, but data warehouse platforms are still being utilized by companies of all sizes. Expert Craig S. Mullins takes a look at the technology. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Three ways to build a big data system

In a book excerpt, author Dale Neef outlines and compares different approaches organizations can take when trying to bring a big data system into their IT environments. Continue Reading

By

• Dale Neef

drone photography

Drone photography is the capture of still images and video by a remotely-operated or autonomous unmanned aerial vehicle (UAV), also known as an unmanned aircraft system (UAS) or, more commonly, as a drone. Continue Reading

By

• TechTarget Contributor

Types of NoSQL databases and key criteria for choosing them

In a book excerpt, consultant Dan Sullivan offers insights into how to select the right type of NoSQL database for the right application in your organization. Continue Reading

By

• Dan Sullivan

How to identify master data in a multi-domain MDM program

In an excerpt from their book on managing multi-domain master data management programs, Mark Allen and Dalton Cervo explain how to identify MDM domains and your master data. Continue Reading

By

• Mark Allen and Dalton Cervo

SAP HANA in-memory DBMS overview

SAP HANA is an in-memory DBMS and application platform designed to handle high transaction rates and complex queries using one data copy. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Redis open source DBMS overview

The Redis open source DBMS provides a highly scalable data store that can be shared by multiple processes, applications or servers. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

MySQL open source RDBMS overview

Developers, database administrators and DevOps teams use MySQL open source RDBMS to more easily operate next-generation applications in the cloud. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Convergence of Data Virtualization Servers and SQL-on-Hadoop Engines?

Hadoop has become a popular and powerful platform for data storage and data processing. Data stored in Hadoop can be used by a wide range of applications and tools and for a wide range of use ... Continue Reading

By

• Rick van der Lans

Which in-memory DBMS best fits your company's needs?

Database expert Craig S. Mullins examines some top in-memory DBMS software offerings to help you determine which is the best fit for your organization. Continue Reading

By

• Craig S. Mullins, Mullins Consulting

Oracle Database 12c relational database management system overview

Oracle Database 12c delivers strong performance for mission-critical workloads, with features and functionality for diverse processing needs and requirements. Continue Reading

By

• Craig S. Mullins, Mullins Consulting