Olson Database Archiving

How to Keep Lots of Data for a Very Long Time
1. Auflage 2010
ISBN: 978-0-08-088442-4
Verlag: Elsevier Science & Techn.
Format: EPUB
Kopierschutz: 6 - ePub Watermark

E-Book, Englisch, 312 Seiten

With the amount of data a business accumulates now doubling every 12 to 18 months, IT professionals need to know how to develop a system for archiving important database data, in a way that both satisfies regulatory requirements and is durable and secure. This important and timely new book explains how to solve these challenges without compromising the operation of current systems. It shows how to do all this as part of a standardized archival process that requires modest contributions from team members throughout an organization, rather than the superhuman effort of a dedicated team.
* Exhaustively considers the diverse set of issues-legal, technological, and financial-affecting organizations faced with major database archiving requirements.
* Shows how to design and implement a database archival process that is integral to existing procedures and systems.
* Explores the role of players at every level of the organization-in terms of the skills they need and the contributions they can make.
* Presents its ideas from a vendor-neutral perspective that can benefit any organization, regardless of its current technological investments.
* Provides detailed information on building the business case for all types of archiving projects

Jack E. Olson is a widely recognized database technology expert. His career includes significant contributions at IBM, BMC, Evoke, and now NEON Enterprise Software, where he serves as Chief Technology Office. Olson is author of Data Quality: The Accuracy Dimension, also published by Morgan Kaufmann. The inventor of record on several patents, he holds a BS from the Illinois Institute of Technology and an MBA from Northwestern University.

Autoren/Hrsg.

Olson, Jack E.

Inhaltsverzeichnis

1;Front Cover;1
2;Database Archiving How to Keep Lots of Data for a Very Long Time;4
3;Copyright Page;5
4;Dedication Page;6
5;Contents;8
6;Preface;14
6.1;How this Book is Organized;15
6.2;Organizations that are Likely to Need Database Archiving;16
6.3;Who this Book is for;16
7;Acknowledgments;18
8;Part 1: Archiving Basics;20
8.1;Chapter 1: Database Archiving Overview;22
8.1.1;1.1 A Definition of Database Archiving;23
8.1.2;1.2 Forms of Data Archiving;25
8.1.3;1.3 The Data Lifeline;31
8.1.4;1.4 Types of Data Objects;34
8.1.5;1.5 Data Retention Requirements Versus Data Archives;35
8.1.6;1.6 The Database Archives and Other Database Types;38
8.1.7;Summary;38
8.2;Chapter 2: The Business Case for Database Archiving;40
8.2.1;2.1 Why Database Archiving is a Problem Today;40
8.2.2;2.2 Implications of not Keeping Data;44
8.2.3;2.3 Data Volume Issues;46
8.2.4;2.4 Change Management;49
8.2.5;2.5 Current Database Archiving Practices;50
8.2.6;Summary;51
8.3;Chapter 3: Generic Archiving Methodology;52
8.3.1;3.1 The Methodology;52
8.3.2;3.2 Define Motivation for Archiving;54
8.3.3;3.3 Identify Objects to Archive;58
8.3.4;3.4 Determine When to Put Objects in the Archive;61
8.3.5;3.5 Determine How Long to Keep Objects in the Archive;63
8.3.6;3.6 Determine What to do with Discarded Objects;66
8.3.7;3.7 Determine Who Needs Access to Archives and How;66
8.3.8;3.8 Determine the Form of Archive Objects;67
8.3.9;3.9 Determine Where the Archive will be Kept;69
8.3.10;3.10 Determine Operational Processes Needed;76
8.3.11;3.11 Determine Necessary Administrative Processes;78
8.3.12;3.12 Determine Required Change Processes;78
8.3.13;Summary;79
8.4;Chapter 4: Components of a Database Archiving System;82
8.4.1;4.1 The Database Archiving Organization;82
8.4.2;4.2 Archive Application Data Gathering;83
8.4.3;4.3 Archive Application Design;84
8.4.4;4.4 Archive Data Extraction;84
8.4.5;4.5 Archive Data Management;85
8.4.6;4.6 Archive Access;85
8.4.7;4.7 Archive Administration;86
8.4.8;Summary;86
9;Part 2: Establishing a Database Archiving Project;88
9.1;Chapter 5: Origins of a Database Archiving Application;90
9.1.1;5.1 Problems that Lead to Database Archiving Solutions;91
9.1.2;5.2 Recognizing Problems;92
9.1.3;5.3 Assignment of Problems for Initial Study;94
9.1.4;5.4 Initial Problem Study Components;94
9.1.5;5.5 Determining the Basic Strategy for the Archiving Application;97
9.1.6;5.6 The Application Strategy Chart;102
9.1.7;Summary;102
9.2;Chapter 6: Resources Needed;104
9.2.1;6.1 People;104
9.2.2;6.2 Authority;106
9.2.3;6.3 Education;107
9.2.4;6.4 Repository;107
9.2.5;6.5 Archive Server;108
9.2.6;6.6 Software Tools;108
9.2.7;6.7 Disk Storage;109
9.2.8;Summary;110
9.3;Chapter 7: Locating Data;112
9.3.1;7.1 Inventorying Data;112
9.3.2;7.2 Picking the Archivist's Data;118
9.3.3;7.3 Documenting Data Sources;119
9.3.4;Summary;120
9.4;Chapter 8: Locating Metadata;122
9.4.1;8.1 Metadata Definitions;122
9.4.2;8.2 Where to Find Metadata;128
9.4.3;8.3 Selecting a Version of the Metadata;132
9.4.4;8.4 Classifying Data;133
9.4.5;8.5 Documenting Metadata;136
9.4.6;8.6 Keeping up with Changes;137
9.4.7;Summary;138
9.5;Chapter 9: Data and Metadata Validation;140
9.5.1;9.1 Matching Data to Metadata;140
9.5.2;9.2 Assessing Data Quality;142
9.5.3;9.3 Assessing Metadata Quality;143
9.5.4;9.4 Validating Data Classification;144
9.5.5;9.5 Documenting Validation Activities;144
9.5.6;9.6 Repeating Validation Activities;145
9.5.7;Summary;145
10;Part 3: Designing Database Archiving Applications;146
10.1;Chapter 10: Designing for Archive Independence;148
10.1.1;10.1 Independence from Application Programs;148
10.1.2;10.2 Independence from DBMS;151
10.1.3;10.3 Independence from Systems;152
10.1.4;10.4 Independence from Data Formats;152
10.1.5;Summary;154
10.2;Chapter 11: Modeling Archive Data;156
10.2.1;11.1 The Source Data Model;156
10.2.2;11.2 The Target Data Model;161
10.2.3;11.3 Model Representations;166
10.2.4;Summary;167
10.3;Chapter 12: Setting Archive Policies;168
10.3.1;12.1 Extract Policies;168
10.3.2;12.2 Archive Storage Policies;173
10.3.3;12.3 Archive Discard Policies;176
10.3.4;12.4 Validation and Approval;178
10.3.5;Summary;178
10.4;Chapter 13: Changes to Data Structures and Policies;180
10.4.1;13.1 Archiving System Strategies for Handling Metadata Changes;180
10.4.2;13.2 Metadata Change Categories;182
10.4.3;13.3 Changes to the Archive Data Model;189
10.4.4;13.4 Managing the Metadata Change Process;190
10.4.5;13.5 Changes to Archive Policies;191
10.4.6;13.6 Maintaining an Audit Trail of Changes;195
10.4.7;Summary;196
11;Part 4: Database Archiving Application Software;198
11.1;Chapter 14: The Archive Data Store;200
11.1.1;14.1 Archive Database Choices;201
11.1.2;14.2 Important Features;204
11.1.3;14.3 False Features;212
11.1.4;14.4 How Choices Stack up;214
11.1.5;Summary;214
11.2;Chapter 15: The Archive Data Extraction Component;216
11.2.1;15.1 The Archive Extractor Model;217
11.2.2;15.2 Extractor Implementation Approaches;219
11.2.3;15.3 Execution Options;222
11.2.4;15.4 Integrity Considerations;224
11.2.5;15.5 Other Considerations;228
11.2.6;Summary;232
11.3;Chapter 16: The Archive Discard Component;234
11.3.1;16.1 Data Structure Considerations;234
11.3.2;16.2 Implementation Form;238
11.3.3;16.3 Integrity Considerations;239
11.3.4;16.4 Operational Considerations;241
11.3.5;16.5 Audit Trail;244
11.3.6;Summary;246
11.4;Chapter 17: The Archive Access Component;248
11.4.1;17.1 Direct Programming Access;248
11.4.2;17.2 Access Through Generic Query and Search Tools;250
11.4.3;17.3 Access Through Report Generators and BI Tools;250
11.4.4;17.4 Selective Data Unload;251
11.4.5;17.5 Accessing Original Data;253
11.4.6;17.6 Metadata Services;255
11.4.7;17.7 Other Access Considerations;255
11.4.8;Summary;257
12;Part 5: Administration of the Database Archive;260
12.1;Chapter 18: Ongoing Auditing and Testing;262
12.1.1;18.1 Responsibility for Ongoing Auditing and Testing;263
12.1.2;18.2 Auditing Activities;263
12.1.3;18.3 Testing Activities;267
12.1.4;18.4 Frequency of Audits and Tests;269
12.1.5;Summary;269
12.2;Chapter 19: Managing the Archive Over Time;270
12.2.1;19.1 Managing the Archive Database;270
12.2.2;19.2 Managing the Archive Repository;272
12.2.3;19.3 Using Hosted Solutions;274
12.2.4;19.4 Managing Archive Users;275
12.2.5;Summary;278
12.3;Chapter 20: Nonoperational Sources of Data;280
12.3.1;20.1 Retired Applications;280
12.3.2;20.2 Data from Mergers and Acquisitions;282
12.3.3;20.3 e-Discovery Applications;283
12.3.4;20.4 Business Intelligence Data;285
12.3.5;20.5 Logs, Audit Trails, and Other Miscellaneous Stuff;286
12.3.6;Summary;287
13;Final Thoughts;288
14;Appendix A: Generic Archiving Checklist;290
15;Appendix B: Goals of a Database Archiving System;294
16;Appendix C: Job Description of a Database Archive Analyst;296
16.1;Position;296
16.2;Job Responsibilities;296
16.3;Required Qualifications;297
16.4;Other Helpful Qualifications and Characteristics;297
17;Glossary;298
18;References;302
19;Index;304