Loading...
Data cleaning : a practical perspective /
Data warehouses consolidate various activities of a business and often form the backbone for generating reports that support important business decisions. Errors in data tend to creep in for a variety of reasons. Some of these reasons include errors during input data collection and errors while merg...
| Main Authors: | , |
|---|---|
| Format: | eBook |
| Language: | English |
| Published: |
San Rafael, California (1537 Fourth Street, San Rafael, CA 94901 USA) :
Morgan & Claypool,
2013.
|
| Series: | Synthesis digital library of engineering and computer science.
Synthesis lectures on data management ; # 36. |
| Subjects: | |
| Online Access: | Abstract with links to full text |
| Summary: | Data warehouses consolidate various activities of a business and often form the backbone for generating reports that support important business decisions. Errors in data tend to creep in for a variety of reasons. Some of these reasons include errors during input data collection and errors while merging data collected independently across different databases. These errors in data warehouses often result in erroneous upstream reports, and could impact business decisions negatively. Therefore, one of the critical challenges while maintaining large data warehouses is that of ensuring the quality of data in the data warehouse remains high. The process of maintaining high data quality is commonly referred to as data cleaning. In this book, we first discuss the goals of data cleaning. Often, the goals of data cleaning are not well defined and could mean different solutions in different scenarios. Toward clarifying these goals, we abstract out a common set of data cleaning tasks that often need to be addressed. This abstraction allows us to develop solutions for these common data cleaning tasks. We then discuss a few popular approaches for developing such solutions. In particular, we focus on an operator-centric approach for developing a data cleaning platform. The operator-centric approach involves the development of customizable operators that could be used as building blocks for developing common solutions. This is similar to the approach of relational algebra for query processing. The basic set of operators can be put together to build complex queries. Finally, we discuss the development of custom scripts which leverage the basic data cleaning operators along with relational operators to implement effective solutions for data cleaning tasks. |
|---|---|
| Item Description: | Part of: Synthesis digital library of engineering and computer science. Series from website. |
| Physical Description: | 1 PDF (xv, 69 pages) : illustrations. Also available in print. |
| Format: | Mode of access: World Wide Web. System requirements: Adobe Acrobat Reader. |
| Bibliography: | Includes bibliographical references (pages 65-67). |
| ISBN: | 9781608456789 |
| ISSN: | 2153-5426 ; |
| Access: | Abstract freely available; full-text restricted to subscribers or individual document purchasers. |