Preserving Digital Materials Preserving Digital Materials Third Edition Ross Harvey and Jaye Weatherburn ROWMAN & LITTLEFIELD Lanham • Boulder • New York • London Published by Rowman & Littlefield A wholly owned subsidiary of The Rowman & Littlefield Publishing Group, Inc 4501 Forbes Boulevard, Suite 200, Lanham, Maryland 20706 www.rowman.com Unit A, Whitacre Mews, 26-34 Stannary Street, London SE11 4AB Copyright © 2018 by Rowman & Littlefield All rights reserved No part of this book may be reproduced in any form or by any electronic or mechanical means, including information storage and retrieval systems, without written permission from the publisher, except by a reviewer who may quote passages in a review British Library Cataloguing in Publication Information Available Library of Congress Cataloging-in-Publication Data Names: Harvey, D R (Douglas Ross), 1951–, author | Weatherburn, Jaye, author Title: Preserving digital materials / Ross Harvey and Jaye Weatherburn Description: Third edition | Lanham, Maryland : Rowman & Littlefield, 2018 | Includes bibliographical references and index | Description based on print version record and CIP data provided by publisher; resource not viewed Identifiers: LCCN 2017047110 (print) | LCCN 2017047496 (ebook) | ISBN 9781538102985 (electronic) | ISBN 9781538102961 (hardcover : alk paper) | ISBN 9781538102978 (pbk : alk paper) Subjects: LCSH: Digital preservation Classification: LCC Z701.3.C65 (ebook) | LCC Z701.3.C65 H37 2018 (print) | DDC 025.8/4—dc23 LC record available at https://lccn.loc.gov/2017047110 The paper used in this publication meets the minimum requirements of American National Standard for Information Sciences—Permanence of Paper for Printed Library Materials, ANSI/NISO Z39.48-1992 Printed in the United States of America This book is dedicated to the collaborative and generous international digital preservation community, and to the diverse new participants staking a welcome claim in this field Contents List of Tables xi Foreword xiii Preface xvii Acknowledgments xxi Introduction xxiii Part I: Why Do We Preserve Digital Materials? Chapter 1 Preservation in the Digital Age Changing Paradigms 4 Changing Definitions 9 What Exactly Are We Trying to Preserve? 13 How Long Are We Preserving Digital Materials? 14 Reshaping Preservation Practice 14 Chapter 2 The Need for Digital Preservation 17 Why Preserve Digital Materials? 17 Professional Imperatives 19 Expanding the Pool of Stakeholders 22 How Much Data Have We Lost? 25 Current State of Awareness 28 Needs and Responsibilities 30 vii Part II: What Digital Materials Are We Preserving? Chapter 3 Digital Artifacts, Digital Objects, Storage 37 Modes of Digital Death 38 Digital Storage Media 41 Preservation Storage 47 Cloud Storage 49 Digital Objects—More Than Digital Artifacts 50 Commercial or Cultural Heritage Imperatives? 52 Chapter 4 Selection for Preservation 57 Professional Practice and Selection for Preservation 57 Traditional Selection Criteria 59 Intellectual Property Rights, Context, Stakeholders, and Lifecycle Models 62 Developing Selection Frameworks for Digital Materials 66 How Much to Select? 68 The Ever-Changing Nature of Selection 69 Chapter 5 Requirements for Successful Digital Preservation 73 Digital Objects, Technology, and Data 73 The Importance of Preserving Context 77 The OAIS Reference Model 78 The Role of Metadata 80 Authenticity 84 Trustworthy Digital Repositories 90 The Essence of Digital Materials 92 Part III: How Do We Preserve Digital Materials? Chapter 6 Digital Preservation Strategies I 101 Historical Overview of Digital Preservation Strategies 101 Categorizing Digital Preservation Strategies 102 Policies 104 Procedures and Guidelines 105 “Nonsolutions” Approaches 106 “Preserve Technology” Approaches 107 “Preserve Objects” Approaches 110 viii Contents Combining Strategies 113 Interim Measures for Long-Term Solutions 114 Chapter 7 Digital Preservation Strategies II 119 Digital Archaeology and Digital Forensics 119 Emulation 123 Standard Data Formats 126 Migration 134 Combining Strategies for Effective Digital Preservation 137 Chapter 8 Case Studies 143 Research Data Curation 143 Web Archiving 148 Email Preservation 154 Personal Digital Archiving 156 Preservation of New Media Art 160 Part IV: Collaboration and the Future Chapter 9 Digital Preservation Initiatives 171 Collaboration 171 A Brief History of Digital Preservation Initiatives 172 Themes 174 New Initiatives 176 International Initiatives 176 National Initiatives 185 Increasingly Collaborative and International 191 Chapter 10 The Future of Digital Preservation 197 What Have We Learned So Far? 197 Digital Preservation is Maturing 206 New Directions 215 Bibliography 223 Index 241 About the Authors 249 Contents ix University of Michigan Library “Computer and Video Game Archive [Resources].” September 1, 2017 guides.lib.umich.edu/c.php?g=282987&p=1885528 New Media Art Preservation Becker, Christoph, Günther Kolar, Josef Küng, and Andreas Rauber “Preserving Interactive Multimedia Art: A Case Study in Preservation Planning.” In ICADL 2007, LNCS 4822, edited by D H.-L Goh et al., 257–66 Berlin: Springer, 2007 publik.tuwien.ac.at/files/pub-inf_5204.pdf Biggs, Simon “Make or Break? Concerning the Value of Redundancy as a Creative Strategy.” In The Preservation of Complex Objects: Volume Software Art, edited by Leo Konstantelos et al., 17 Jisc, 2012 radar.gsa.ac.uk/2806/1/pocos_vol_2_final_release%5B1%5D.pdf Dietrich, Dianne, and Frank Adelstein “Archival Science, Digital Forensics, and New Media Art.” Digital Investigation 14, Supplement (2015): S137–S145 doi:10.1016/j.diin.2015.05.004 Rieger, Olga Y., et al Preserving and Emulating Digital Art Objects Cornell University Library, 2015 ecommons.cornell.edu/handle/1813/41368 Personal Digital Archiving Cahoy, Ellysa Stern “The Challenge of Teaching Personal Archiving.” In National Digital Information Infrastructure and Preservation Program Perspectives on Personal Digital Archiving, 77 Washington DC: Library of Congress, 2013 www.digitalpreservation.gov/documents/ ebookpdf_march18.pdf Hawkins, Donald T., ed Personal Archiving: Preserving Our Digital Heritage Medford, NJ: Information Today, 2013 John, Jeremy Leighton, et al Digital Lives: Personal Digital Archives for the 21st Century: An Initial Synthesis 2010 britishlibrary.typepad.co.uk/files/digital-lives-synthesis02-1.pdf Lee, Christopher A., ed I, Digital: Personal Collections in the Digital Era Chicago: Society of American Archivists, 2011 Marshall, Catherine C “The Long Term Fate of Our Digital Belongings: Toward a Service Model for Personal Archives.” 2007 arxiv.org/ftp/arxiv/papers/0704/0704.3653.pdf Redwine, Gabriela Personal Digital Archiving Digital Preservation Coalition, 2015 www.dpconline org/component/docman/doc_download/1460-twr15-01 Research Data Curation Figshare The State of Open Data: A Selection of Analyses and Articles about Open Data, Curated by Figshare London: Digital Science, 2016 doi:10.6084/m9.figshare.4036398 Frank, Rebecca D., Elizabeth Yakel, and Ixchel M Faniel “Destruction/Reconstruction: Preservation of Archaeological and Zoological Research Data.” Archival Science 15, no (2015): 141–67 doi:10.1007/s10502-014-9238-9 236 Bibliography Hudson-Vitale, Cynthia, et al SPEC Kit 354: Data Curation Washington, DC: Association of Research Libraries, 2017 Johnston, Lisa R., ed Curating Research Data: Practical Strategies for Your Digital Repository Chicago: Association of College and Research Libraries, 2017 Key Perspectives Ltd Data Dimensions: Disciplinary Difference in Research Data Sharing, Reuse and Long Term Viability: A Comparative Review Based on Sixteen Case Studies Digital Curation Centre, 2010 www.dcc.ac.uk/sites/default/files/documents/publications/SCARP%20SYNTHESIS pdf Lee, Christopher, Suzie Allard, Nancy McGovern, and Alice Bishop “Open Data Meets Digital Curation: An Investigation of Practices and Needs.” International Journal of Digital Curation 11, no (2016): 115–25 doi:10.2218/ijdc.v11i2.403 Lynch, Clifford A “The Next Generation of Challenges in the Curation of Scholarly Data.” In Research Data Management: Practical Strategies for Information Professionals, edited by Joyce M Ray, 395–408 West Lafayette, IN: Purdue University Press, 2014 Lyon, Liz, et al Disciplinary Approaches to Sharing, Curation, Reuse and Preservation: Final Report 2010 www.dcc.ac.uk/sites/default/files/documents/scarp/SCARP-FinalReport-Final-SENT pdf Proll, Stefan, Kristof Meixner, and Andreas Rauber “Precise Data Identification Services for Long Tail Research Data.” iPRES 2016 ipr16.organizers-congress.org/frontend/organizers/media/ iPRES2016/_PDF/IPR16.Proceedings_4_Web_Broschuere_Link.pdf Research Councils UK Concordat on Open Research Data 2016 www.rcuk.ac.uk/documents/ documents/concordatonopenresearchdata-pdf/ Social Media Preservation Bruns, Axel “A First Draft of the Present: Why We Must Preserve Social Media Content.” The Conversation, May 16, 2016 theconversation.com/a-first-draft-of-the-present-why-we-must -preserve-social-media-content-59087 McGill, Andrew “Can Twitter Fit Inside the Library of Congress?” Atlantic, August 4, 2016 www.theatlantic.com/technology/archive/2016/08/can-twitter-fit-inside-the-library-of -congress/494339/ Thomson, Sara Day Preserving Social Media Digital Preservation Coalition, 2016 doi:10.7207/ twr16-01 Thomson, Sara Day, and William Kilbride “Preserving Social Media: The Problem of Access.” New Review of Information Networking 20, nos 1–2 (2015): 261–75 doi:10.1080/13614576 2015.1114842 Bibliography 237 Software Preservation Amadeo, Ron “Saving Old Software from Extinction in the Age of Cloud Computing.” Ars Technica, June 18, 2014 arstechnica.com/gadgets/2014/06/saving-old-software-from-extinction -in-the-age-of-cloud-computing/ Chue Hong, Neil “Digital Preservation and Curation: The Danger of Overlooking Software.” In The Preservation of Complex Objects, vol 1: Visualisations and Simulations, edited by Janet Delve et al., 25–35 Portsmouth, UK: University of Portsmouth, 2012 Matthews, Brian, Arif Shaon, Juan Bicarregui, and Catherine Jones “A Framework for Software Preservation.” International Journal of Digital Curation, no (2010) doi:10.2218/ijdc.v5i1.145 Meyerson, Jessica, David Rosenthal, Euan Cochrane, Zach Vowel, and Natasa Milic-Frayling “Software Sustainability and Preservation: Implications for Long-term Access to Digital Heritage.” iPres 2016, 294–95 ipr16.organizers-congress.org/frontend/organizers/media/ iPRES2016/_PDF/IPR16.Proceedings_4_Web_Broschuere_Link.pdf Meyerson, Jessica, et al “The Software Preservation Network (SPN): A Community Effort to Ensure Long Term Access to Digital Cultural Heritage.” D-Lib Magazine 23, nos 5–6 (2017) doi:10.1045/may2017-meyerson Moss, Richard “An OS Odyssey: Why These Mac Users Won’t Abandon 16-year-old Software.” Ars Technica, September 9, 2016 arstechnica.com/gadgets/2016/09/an-os-9-odyssey -why-do-some-mac-users-still-rely-on-16-year-old-software/ Sisu, Dianna “Software Preservation and Sustainability.” DCC News, March 16, 2017 www.dcc ac.uk/node/10676 The Software Heritage Archive www.softwareheritage.org/archive/ Software Preservation Network www.softwarepreservationnetwork.org/ Software Sustainability Institute www.software.ac.uk/ Web Archiving Awesome Web Archiving 2017 github.com/iipc/awesome-web-archiving Ayala, Brenda Reyes “Challenges for Web Archivists: Issues in the Preservation of Digital Cultural Heritage.” In Annual Review of Cultural Heritage Informatics, edited by Jennifer Weil Arns, 151–64 Lanham, MD: Rowman & Littlefield, 2016 Bowers, John “A Million Squandered: The ‘Million Dollar Homepage’ as a Decaying Digital Artifact.” Harvard Library Innovation Lab Blog, July 21, 2017 lil.law.harvard.edu/blog/2017/07/21/ a-million-squandered-the-million-dollar-homepage-as-a-decaying-digital-artifact/ Brown, Adrian Archiving Websites: A Practical Guide for Information Management Professionals London: Facet, 2006 238 Bibliography Brügger, Niels, and Ralph Schroeder, eds The Web as History: Using Web Archives to Understand the Past and the Present London: UCL Press, 2017 Leetaru, Kalev “The Internet Archive Turns 20: A Behind the Scenes Look at Archiving the Web.” Forbes, January 18, 2016 www.forbes.com/sites/kalevleetaru/2016/01/18/the-internet -archive-turns-20-a-behind-the-scenes-look-at-archiving-the-web/#213694c582e0 Maemura, Emily “Web Archiving: Past, Present and Future, or,  Yet another Web Archiving Bibliography.” November 1, 2016 dci.ischool.utoronto.ca/2016/11/01/web-archiving-past -present-and-future/ Masanés, Julien Web Archiving Springer, 2006 Milligan, Ian, Nick Ruest, and Jimmy Lin “Content Selection and Curation for Web Archiving: The Gatekeepers vs the Masses.” JCDL 16, June 19–23, 2016, Newark, NJ doi:10.1145/ 2910896.2910913 Pennock, Maureen Web-Archiving Digital Preservation Coalition, 2013 www.dpconline.org/ docs/technology-watch-reports/865-dpctw13-01-pdf/file Rhodes, Sarah “Breaking Down Link Rot: The Chesapeake Project Legal Information Archive’s Examination of URL Stability.” 2011 web.archive.org/web/20160507113444/http://www.llrx com/features/linkrot.htm Van de Sompel, Herbert, David S H Rosenthal, and Michael L Nelson “Web Infrastructure to Support e-Journal Preservation (and More).” May 19, 2016 arxiv.org/abs/1605.06154 Bibliography 239 Index 4C Project, 204, 206–7 Academic Preservation Trust See APTrust access devices, 50 access to preserved materials, 201 advocacy for digital preservation, 30, 210–11 AHDS, 172 Alliance Permanent Access to the Records of Science in Europe Network See APARSEN amnesiac society, 25 analog backups, 107 ANDS, 29, 185, 189–90 APARSEN, 204 appraisal, 59–61; and digital materials, 61 See also technical appraisal APTrust, 185, 190, 191 Arca Memorie, 160 archival discs, 28 archival file formats, 112; developing, 133 Archival Resource Key See ARK archival value, 60 Archive-It, 150–51, 211 Archivematica, 114, 132, 162, 212 archivists, preservation responsibility, 20–21 ARK, 84 Arkivum, 212 Ars Electronica collection, 160–61 Arts and Humanities Data Service See AHDS attributes to preserve, 77 Audit and Certification of Trustworthy Digital Repositories, 65, 78, 91 Australian experts, view on strategies, 102–3, 201, 202 Australian Lesbian and Gay Archives, 64 Australian National Data Service See ANDS Australian Research Data Provenance (RDP) Interest Group, 190 authenticity, 77–78, 84–90, 201; definitions, 84–85; need for documentation, 52; predigital paradigm, 85; research into, 88–90, 214; threats to, 85–86 See also trustworthiness Automation, 201; of metadata creation and management, 82 awareness of preservation issues, 28–30, 201 Bagit, 114 BBC Domesday Project, 27, 28, 120–21, 124, 127 See also Domesday Reloaded Benchmark DP project, 65 benchmarking and assessment models, 65 benign neglect, 3, 6, 11, 198, 214 Binder tool, 162 “Bit List” of Digitally Endangered Species, 180 BitCurator, 121, 122, 123 bitstream copying, 111 bitstream preservation, 74 Black Lives Matter, 64 blockchain, 214 Blue Ribbon Task Force on Sustainable Digital Preservation and Access, 18, 203–4 British Library, 102, 123, 131, 151, 152, 179, 183, 199, 203, 213 British Library Sound Archive, 4, 42 Btrfs, 213 Budapest Open Access Initiative, 145 bwFLA Emulation as a Service project See EaaS project 241 California Digital Library, 84 CAMiLEON, 109, 120, 124, 136, 172, 175, 199 capability maturity models, 203 CASPAR, 181 CEDARS, 66, 82, 86–88, 172, 175, 199, 203 CESSDA ERIC Cost-Benefit Advocacy Toolkit, 204 challenges to digital preservation, 38–41, 200–201; change management, 216 changes to digital materials through preservation, 73, 135 Chronicle of Life, 159 Chronopolis, 185, 191 cloud services, 212 cloud storage, 49, 92 See also preservation storage collaboration, 21, 23, 171–72, 187, 200 Collaboration to Clarify the Costs of Curation See 4C Project combining strategies and practices, 113–14 commercial engagement with digital preservation, 212 commercial indifference to digital preservation, 25 commercial preservation services, 198, 212 community input in selection, 64 community resources, 21–22 Computer History Museum, 108–9 CONTENTdm, 48, 114 context, importance of preserving, 60, 63, 77–78 continuum models and selection, 65 conversion on demand, 136 copyright legislation, 62 CoreTrustSeal, 91 Cornell University Libraries, 108, 162, 163 corporate interest in digital preservation, 212 cost modelling, 201, 203–4 creators of digital materials, preservation role, 63–64, 200 Curation Costs Exchange, 204 Curation Lifecycle Model, 9, 10, 23, 65, 145, 148, 187 Curation Reference Manual, 186 cyberinfrastructure, cyberscholarship, Danish Royal Library, 127, 156 data: champions, 145; lifecycle management, 202; loss, 25–28 (see also information loss); management plans, 145; as preservation focus, 77; recovery, 26; standard data formats, 112, 126–30, 131–32 Data Curation Profiles project, 64 Data Management Plans (DMPs) Interest Group, 190 Data Seal of Approval, 91 Data Stewardship project TU Delft, 145 Database Preservation Toolkit, 213 DataONE Data Life Cycle model, 145 DCC/CASPAR Representation Information Registry, 130 decentralized technology, 214 definitions, 101, 102; disciplinary differences, 11–12; need for new, 3–4, 9–10; predigital, 6–7, 9; revised, 10–11 descriptive metadata, 81 Designated Community, 63, 79, 87 DigCurr Project, 204–5 DigCURV, 8, 205 DigiPres Commons, 175, 211 digital archaeology, 106–7, 119–21 Digital Archiving and Preservation Training Needs Survey, 205 digital art See new media art digital artifacts, 50 digital continuity, threats to, 39–40 Digital Curation Centre, 29, 91, 185–87, 172, 199 See also Curation Lifecycle Model; Curation Reference Manual; SCARP digital curation, definition, 186 digital dark age, 25, 29 digital forensics, 43, 121–23; hardware, 122; software, 122 digital information, volume, 4, 42 Digital Lives project, 24, 156 digital materials: definition, 13–14; reasons to preserve, 17–19 Digital Object Identifier See DOI digital objects, 50–52; definition, 80 Digital POWRR, 209 digital preservation: as business as usual, 176; challenges, 38, 202–5; collaboration, 171–72; future, 197–216; initiatives, history of, 172–76; issues, 200–201; maturing, of digital preservation, 206–13; new directions, 215–16; new roles, 21; reflections, 206, 208; research agendas, 199, 213–14; reasons for, 17–19; services, 212; societal benefits, 17–19; technical aspects, 37 Digital Preservation Awards, 211 Digital Preservation Business Case Toolkit, 204 Digital Preservation Capability Maturity Model, 65, 203 Digital Preservation Coalition, xiii, xiv, 156, 171, 176, 179–80, 212; advocacy, 21, 30, 174, 211; Technology Watch Reports, 180 Digital Preservation Handbook, 180 Digital Preservation Network See DPN Digital Preservation Testbed, 131, 155, 199 digital storage media, 41–47; capacities, 41; deterioration, 42; lack of artifactual value; 42– 43 See also durable/persistent storage media Digitization, 13–14, 202 242 Index DIN 31644 See nestor Seal of Approval Dioscuri, 124, 126 diversity, digital preservation stakeholders, 210–11 DMPonline, 145, 186 documentation, maintaining essential, 51–52 Documenting the Now, 159 DOI, 84 Domesday Project See BBC Domesday Project Domesday Reloaded, 27, 120 DPC See Digital Preservation Coalition DPCMM See Digital Preservation Capability Maturity Model DPN, 185, 190–91 DRAMBORA, 65, 91 DROID, 127, 130 DSpace, 5, 174, 176 Dublin Core, 81, 114 durable/persistent storage media, 46–47, 107 DuraCloud, 48, 49, 191, 198 DuraSpace, 49, 174, 176, 191 EaaS project, 126 EAD See Encoded Archival Description E-ARK, 180, 182, 213 education and training, 202, 204–5 Educopia Institute, 184 e-infrastructure, Electronic Resource Preservation and Access Network See ERPANET email: essential elements, 155; preservation, 154–56; preservation, future directions, 156; preservation issues, 154 emulation, 74, 109, 120, 123–26, 213; new media art, 162 encapsulation, 113 Encoded Archival Description, 81 ePADD, 155 e-research, 5–6 ERPANET, 172, 174–75, 199 essence See significant properties essential elements See significant properties European Commission–funded projects, 176, 178, 181–82, 199, 214 Ex Libris Rosetta, 114, 198 eXtensible Markup Language See XML Facebook, 158 FAIR Data Principles, 6, 146 Fedora Commons, 176 figshare, 191 file formats, 126–30; archival, 112, 133; obsolescence, 74, 28, 210; open compared with proprietary, 128–29; proliferation, 127; registries, 130–31; restricting range of, 112, 132–33; standardizing, 112, 131–32; sustainability criteria, 131 Fixity, 85 flash storage, 45–46; lifespan, 46; storage and handling, 46 Florida Digital Archive, 176 Functional Requirements for Evidence in Recordkeeping project, 26, 88–89 funding digital preservation, 38, 201, 202, 203–4, 208–9 funding digital preservation research, 214 Galleries, Libraries, Archives and Museums sector See GLAM sector GeoCities, 157 geospatial data, selection, 68 GLAM sector, xviii, xxiii, 3, 19, 38; paradigm shift, 3, Global Digital Formats Registry, 130 guidelines, 105–6; definition, 102 Handle system, 84 handling digital storage media See storage and handling practices HathiTrust, 172, 183, 191 HD Rosetta, 47 Heritrix tool, 151, 152 HOPPLA, 59 HTML, 112 human error, 41 ICE Forum, 205 ICPSR, 105, 106, 132 IDCC, 175, 186 IIPC, 150, 151–52, 153; Web Archiving Conference, 150 individuals: advocacy to, 211; role in digital preservation, 24, 64, 211; role in web archiving, 153 See also personal digital archiving information loss, categories, 40 See also data loss information packages, 14 information production: digital, 5; predigital, 4–5 information society, InSPECT project, 86, 155 integrating digital preservation into mainstream operations, 200, 202–3 integrity, 85, 201; need for documentation, 52 intellectual property rights, 62, 200 Interactive Assessment: Selection of Digital Materials for Long-Term Retention, 66 International Digital Curation Conference See IDCC International Digital Preservation Day, 180, 211 International Governance Initiative survey 2016, 29 international initiatives, 176–77 International Internet Preservation Consortium See IIPC Index 243 International Journal of Digital Curation, 186 Internet Arcade, 124 Internet Archive, xxv, 18, 59, 64, 66, 68, 133, 149, 150–51, 153 internet, growth, Internet Web Archiving Workshop, 150 InterPARES, 10, 67, 89–90, 135–36, 205 Inter-university Consortium for Political and Social Research See ICPSR iPRES, 30, 48, 175, 197, 207, 209 ISO 14721 See OAIS Reference Model ISO 16363 See Audit and Certification of Trustworthy Digital Repositories ISO 20652 See PAIMAS Ithaka, 182 IWAW See Internet Web Archiving Workshop Jenkinson, Sir Hilary, 20 JHOVE, 130, 179 Jisc, 59, 105, 109, 147, 175, 179, 185, 214 JSTOR, 174, 176, 182 JSTOR/Harvard Object Validation Environment See JHOVE Kahle, Brewster, 150 KEEP project, 109, 125, 181, 182 Keepers Registry, 21 Keeping Emulation Environments Portable project See KEEP project Keeping Research Data Safe Project See KRDS Koninklijke Bibliotheek, 109, 124; e-Depot, 174, 176 KRDS, 204 Kulturarw3, 150 legal deposit legislation, 24, 62–63 legal frameworks for preservation, 62 legal reasons for preservation, 20 legal rights See intellectual property rights lessons from experience, 198–99 Levels of Digital Preservation, 49, 65, 188, 203 Libnova, 212 librarians, preservation responsibility, 20–21 Library of Congress, 19, 24, 25, 64, 82, 130, 131, 132, 156, 158, 184, 188 LIFE (Lifecycle Information for E-Literature) Project, 203, 204 LIFE model, 203 lifecycle models, 65; research data, 145 See also Curation Lifecycle Model link rot, 83–84 LOCKSS, 24, 111, 136–37, 176, 184, 198 LOCKSS private network, 184 Long Now Foundation, 12 loss of digital information, 26 Lots of Copies Keep Stuff Safe See LOCKSS MAME Project, 124 managing digital preservation, 202–3 maturity matrices, 65 See also capability maturity models; Digital Preservation Capability Maturity Model; NDSA Levels of Digital Preservation; NSLA Digital Preservation Maturity Matri media art See new media art mediation, 73–74 Mellon Foundation, 123, 125, 156 Memory Lab, 159 MetaArchive Cooperative, 176, 184–85 metadata, 80–84; in OAIS Reference Model, 81; support for preservation, 81 See also preservation metadata Metadata Encoding and Transmission Standard See METS METS, 82, 114 microservices approach, 113–14 migration, 74, 112–13, 134–37, 183; effect on data, 135; on request, 136; requirements, 134–35; tools, 135 minimal effort ingest, 207, 208–9, 216 modes of digital death, 38–41 MODS, 81 More Product Less Process See MPLP MPLP (More Product Less Process), 208 museums of computing, 108–9 Nationaal Archief Digital Preservation Testbed See Digital Preservation Testbed National and State Libraries Australasia See NSLA National Archives and Records Administration, 27, 45, 131, 150 National Archives of Australia, 8, 28, 51, 86–87, 112 National Archives (UK), 49, 86, 105, 106, 120, 130, 131, 179, 202, 210; Digital Archive, 174 National Digital Heritage Archive, 49 National Digital Information Infrastructure Program See NDIIPP National Digital Stewardship Alliance See NDSA National Digital Stewardship Residency program See NDSR National Library of Australia, 24, 38–39, 63, 127, 149, 150, 174, 177, 199; e-deposit service, 63 National Library of New Zealand, 49, 134, 199, 209; metadata extraction tool, 82 National Library of Scotland, 49 National Museum of Computing, 108–9 National Space Science Data Center, 28 NCDD, 17, 185, 189 NDIIPP, 184, 187, 188, 214 NDSA, 65, 171, 185, 187–88, 197–99 See also Levels of Digital Preservation NDSR, 163, 205 NEDLIB, 82, 124 244 Index need for immediate action, 61 nestor, 88, 91, 92, 105, 171, 176, 185, 188–89 nestor Seal of Approval, 189 Netherlands Coalition for Digital Preservation See NCDD Netherlands Media Art Institute, 163 Networked European Deposit Library See NEDLIB new directions in digital preservation, 215–16 new media art: capturing artist’s intent, 161; emulation, 162; interactive nature, 161, 163; multiplicity of formats, 161; preservation, 160–63; preservation, future directions, 163; preservation issues, 160–61; new stakeholders in digital preservation, xviii, 22–25, 210–11, 215–16; participation in web archiving, 153 See also stakeholders “nonsolutions,” 106–7 normalization, 132–33, 134 NSLA, 24, 65, 156, 158; Digital Preservation Maturity Matrix, 65 OAIS Reference Model, 12, 24, 65, 78–80, 87, 90, 91, 92, 114, 146–47, 180, 207, 208, 216; criticism of, 78–79; Designated Community, 59, 63, 87; information package, 14, 113; metadata in, 81, 82; significance, 79, 80 obsolescence, 50, 74, 103, 111, 126, 210 Oceanstore, 172 OCLC Digital Archive, 114 open access movement, 24, 145–46 Open Archival Information System See OAIS Open Archives Initiative, 146 open file formats, 128–29 Open Preservation Foundation, 21, 123, 124, 130, 136, 171–72, 174, 176, 178–79, 182 open-source software compared with proprietary software, 75–76 OpenWayback tool, 152 operating systems, preservation support, 213 optical disks, 43–45; lifespan, 45; storage and handling, 45 ORCID, 84 Pacific And Regional Archive for Digital Sources in Endangered Cultures See PARADISEC PADI, 172, 174 PAIMAS, 78 PANDORA, 68, 149, 150 paradigm, preservation See preservation paradigm PARADISEC, 174 parsimonious preservation, 208–9, 216 PASIG, 175 PDF/A, 130, 133 performance model, 51, 86–87 PERICLES, 176, 180, 181–82, 205, 211 PERSIST, 61, 66, 172, 176, 177–78 persistent identifiers, 83–84 persistent storage media, 107 Persistent Uniform Resource Locator See PURL Personal Archiving Day, 24, 158 Personal Computer Museum, 108–9 personal digital archiving, 24, 156–60, 211; future directions, 159–60; preservation issues, 157–58 Personal Digital Archiving conference, 156, 158 Planets, 39, 86, 109–10, 126, 136, 176, 178, 181 planning, 202 POCOS Project, 109 policies, 104–5; definition, 102; development, 105, 200 Portico, 90, 112, 176, 182–83 POWRR See Digital POWRR practices, 104 predigital paradigm, 6–7, 85 PREMIS, 82, 83, 114 PREMIS Data Dictionary for Preservation Metadata, 78 preservation: anxiety, 29; in place, 214; principles, fundamental, 208, 215; professional imperatives, 19–21; reasons for, 17–19; responsibility for, 17, 200; spectrum, 103 Preservation and Archiving Special Interest Group See PASIG preservation metadata, 81–83; standards, 82–83 Preservation Metadata Implementation Strategies See PREMIS preservation paradigm, 42–43; digital, 7–8, 11–13, 21; need for new, 6–7; predigital, 4–5, 6, 7, 42–43, 61, 66, 77; shift, 3, 4–5, 6–8, 216 preservation storage, 47–48; commercial services, 48; costs, 48; criteria, 48 See also cloud storage “preserve objects” approaches, 110–13 “preserve technology” approaches, 107–10; requirements, 108–9 Preserveware portal, 182 Preservica, 114, 175, 178, 198, 212 Preserving Access to Digital Information See PADI Preserving Digital Objects With Restricted Resources See Digital POWRR Presidential records, digital, 19, 26, 153 PrestoCentre, 179 PrestoPRIME, 40 principles, 104; definition, 102 proactive preservation, 38 procedures, 105–6; definition, 102 procurement, digital preservation services, 212 Producer-Archive Interface-Methodology Abstract Standard See PAIMAS professional responsibility to preserve, 19–21 professional responsibility to select, 57–58 project-based support, 203 Index 245 Project NEDLIB, 109 PRONOM, 130, 131 proprietary file formats, 128–29 proprietary software compared with open-source software, 75–77 provenance, 85 Public Records Office of Victoria (PROV), 113 publishers, preservation responsibility, 4–5, 24, 183 PURL, 84 quantity of digital materials, 61, 201 reflections on digital preservation, 206–7 refreshing, 111, 134 rendering of digital objects, 73–74 replication, 111 research agendas into digital preservation, 213–14 Research Council UK concordat, 146 research data: academic libraries, 147; preservation costs, 204; preservation issues, 144; preservation planning, 147; selection, 67–68; sharing and reuse, 144–45 Research Data Australia (RDA) Registry, 189 research data curation, 143–48; challenges, 148; future directions, 147–48; preservation issues, 144–45 research data lifecycle models, 145 research data management, 6, 146, 202; plans, 67; research, 148 Research Data Management Forum, 186 research funding bodies, 67 research into digital preservation, 102, 199–201, 213–15 research libraries: digital preservation awareness, 39; new roles, Research Libraries Group, 39, 175 restricting range of file formats, 112 Rhizome, 162 risk management, 111 roles and responsibilities, 17, 21, 57, 211; archivists’ responsibilities, 20; publishers, 24 Rosenthal, David, on emulation, 125 Rothenberg, Jeff: on digital preservation challenges, 38; on digital storage media lifespan, 41; on emulation, 124–25; on strategies, 106 scalability of digital preservation activities, 202, 205–6 SCAPE, 182 SCARP, 23; case studies, 59, 64, 144–45 scholars, role in digital preservation, 23–24 scholarship, transformation, 23–24 scientific data, loss, 28 scientists, role in digital preservation, 23–24 selection, 200; appraisal criteria, 59; in archives, 59–61; criteria, 59; decisions, debate about, 58, 68–69; frameworks, 66–68; how much, 68; in libraries, 59–61; for preservation, 27, 57–69; need for, 58; vs keeping everything approach, 68–69 SHAMAN, 181 SHERPA Project, 205 SIARD, 213 significant properties, 66, 86–88 skills: development of, 201; need for new, 8; required, 204 small institutions, 206 Smithsonian Astrophysics Observatory, 64 social media, 19; preservation challenges; 157–58; preservation tools, 159, 213 Social Sciences and Humanities Research Council of Canada, 28 software: blocks, 62; dependence on, 50–51, 73–74 See also obsolescence solid-state drives See SSD spectrum of strategies, 103 SSD (solid-state drives), 46 stakeholders: engaging in digital preservation, 22–25, 30, 200; input in appraisal, 63–64; input in selection, 63–64 See also new stakeholders in digital preservation standard data formats, 112, 126–30, 131–32 standards, 200 State and University Library Denmark, 209 storage See preservation storage storage and handling practices, 43, 44, 107 storage media See digital storage media strategies, 101–14; combining, 113–14, 137; criteria for effective, 102–4; definition, 102; history, 101–3 taking preservation actions now, 201 Task Force on Archiving of Digital Information, 22–23, 27, 90, 175, 197, 207 Task Force on Technical Approaches for Email Archives, 156 Task Force on the Artifact in Library Collections, 42 technical appraisal, 67 technology: failure, 40–41; maturing, 212–13; preservation, 108–9; watch, 79, 102, 103, 108 terminology, 101, 102 TIFF file format, 132 time-based media art See new media art tools, 212–13 TRAC, 90, 91 Trusted Digital Repositories and Audit Checklist See TRAC Trusted Digital Repository (TDR) Checklist and Criteria, 65 246 Index trustworthiness, 78 See also authenticity trustworthy digital repositories, 90–92 trustworthy digital repository certification: Chronopolis, 191; HathiTrust, 183; Portico, 183 TU Delft, 145 Twitter, 19, 156, 157, 158, 159; preservation, Library of Congress, 19, 25 UK Data Archive, 132; Research Data Lifecycle model, 145 UK Web Archiving Consortium, 174 UNESCO PERSIST program See PERSIST UNESCO/PERSIST Guidelines for the Selection of Digital Heritage for Long-Term Preservation, 61, 66, 178 UNESCO, role in digital preservation, 177 UNESCO/UBC Vancouver Declaration, 177–78 Unified Digital Formats Registry, 130 Uniform Resource Locator See URL Universal Preservation Format, 214 Universal Virtual Computer, 109–10 University of California Curation Center, 186 University of Cambridge data champions, 145 University of Pittsburgh, 26, 88–89 URL, 83–84 US 1960 census data, 27 US federal government records, 25–26 USB flash drives, 41, 45, 46 UVC See Universal Virtual Computer value, determining, 59 See also selection Variable Media Network, 161–62, 163 veraPDF, 133 VERS, 113 Victorian Electronic Records Strategy See VERS Vimeo, 19 Vine, 157 virtualization, 123, 125 VRA Core, 81 WARC file format, 133, 152, 153 Wayback Machine, 150, 153 Web ARChive file format See WARC file format web archiving, 148–53; future directions, 152–53; individuals, 153; new stakeholders, 153; preservation issues, 149–50; selective approach, 149 Web Curator Tool, 152 web sites, archivability, 153 Wheatley, Paul, on BBC Domesday Project, 28, 120–21 whole domain harvesting, 68 World Wide Web, 4, 148 Xena, 112, 132 XML, 82, 112 XML Normalising for Archives See Xena ZFS, 213 Index 247 About the Authors Ross Harvey is adjunct professor of information technology at Monash University, Melbourne He has held academic positions at universities in Australia, Singapore, and the United States, most recently in the School of Library and Information Science at Simmons College, Boston His current research and teaching interests focus on the stewardship of digital materials in libraries and archives, particularly their preservation, and on the history of the book He has extensive experience in research projects in Australia and the UK, including with the Humanities Advanced Technology and Information Institute at the University of Glasgow and the Digital Curation Centre Ross has published widely in the fields of bibliographic organization, library education, the preservation of library and archival material, and newspaper history. His most recent books are The Preservation Management Handbook (with Martha Mahard, 2014); Preserving Digital Materials, 2nd ed (2011) and Digital Curation, 2nd ed (with Gillian Oliver, 2016) Jaye Weatherburn is a digital preservation officer at the University of Melbourne, implementing the university’s ten-year digital preservation strategy (2015–2025) She began her career in film and television before turning to information science She received a bachelor’s degree in film and television from the Victorian College of the Arts, University of Melbourne, then worked in live television production, initially as a studio operator and subsequently as a freelance camera operator She worked for a wide variety of clients in both studio and outside broadcast settings, in sports and variety television production Jaye then returned to study, completing a diploma of professional writing and editing and a master’s in information management, both at RMIT University. She contributed to an Australian National Data Service (ANDS) project for Swinburne University of Technology, investigating policy implementation and procedural workflows for implementing digital object identifiers (DOIs) for gray literature publications and data Jaye was an editorial assistant for the Australian Library Journal, 2014–2016, and guest-edited the final issue of the journal (volume 65, issue 4: “The Future of LIS Education in Australia and New Zealand”) For as long as Twitter is around, you can find her at @jayechats 249 ... II: What Digital Materials Are We Preserving? Chapter 3 Digital Artifacts, Digital Objects, Storage 37 Modes of Digital Death 38 Digital Storage Media 41 Preservation Storage 47 Cloud Storage 49 Digital. .. Ross Harvey, Preserving Digital Materials (Munich: K G Saur, 2005)  3 Ross Harvey, Preserving Digital Materials, 2nd ed (Berlin: De Gruyter Saur, 2012)  4 NSF-DELOS Working Group on Digital Archiving... (Chapters 1–2): Why Do We Preserve Digital Materials? Part II (Chapters 3–5): What Digital Materials Are We Preserving? Part III (Chapters 6–8): How Do We Preserve Digital Materials? Part IV (Chapters