Search

Lightning Talk

Web archiving can take many forms, but usually involves fully capturing websites, storing the captured content, and faithly reproducing, or replaying the archived sites. Since the web at its core consists of HTTP requests and responses, this process is often done at the HTTP traffic level to ensure full fidelity. Traditionally, as pioneered by the Internet Archive and others, capture has been done by a web crawler which would automatically ‘crawl’ sites by making HTTP requests and discovering new links. Another approach is to capture content through the web browser itself, capturing content right before it gets to the browser (or even right after). This type of web archiving can be done by using the suite of open source tools to capture interactive websites and replay them at a later time as accurately as possible on one’s own computer. Webrecorder project builds tools that specialize in a ‘user-driven’ form of web archiving, where the user is able to direct the archiving process through their browser. The goal of Webrecorder has been to build quality open source tools to enable ‘web archiving for all’ to allow anyone with a browser to create their own web archives, and to accurately replay them at a later time. Webrecorder project intends to support the creation of lots of small, decentralized archives by individuals and institutions. Rather than supporting a single centralized silo, a key goal remains to support web archives in a variety of environment and storage scenarios. From users’ personal laptops, to google drive, to IPFS, Webrecorder tools will be designed to support creating and accessing web archives wherever they may be found. Through this workshop participants will gain a working knowledge on how web archiving works by using a simple web archiving process from capture to replay on a user’s local computer by using two open-source tools from Webrecorder: archiveweb.page and replayweb.page. Archiveweb.page is an open-source web archiving capture tool that turns your browser into a full-featured interactive web archiving system. It is available as an extension for any Chrome or Chromium based browsers and as a standalone app. Replayweb.page is an open-source browser-based viewer that loads web archive files provided by the user and renders them for replay in the browser. It functions as a serverless (client-side) web archive replay tool. Both these tools combined create high-fidelity web archives using a basic workflow from capture to replay that participants can control, save, and embed onto other platforms. All the code can be viewed and accessed via the Webrecorder github: http://github.com/webrecorder/ Attendees will benefit from this workshop by gaining the ability to create high fidelity captures to make collections that they’ll have full autonomy over and can manage on their own devices and services. This session includes step-by-step installation help for both archiveweb.page and replayweb.page from the Webrecorder team. There will be a tutorial on how to analyze the website before capturing pages as well as breakdown to better understand components of the practice of web archiving and explore how they can fit into existing and emerging digital preservation workflows. The target audience members for this type of workshop include: researchers, archivists, librarians, other practitioners working with digital materials, and developers. No prior experience with web archiving will be required of attendees.

Lightning Talk

A project team was established in late 2019 to create a Siegfried/Wikidata integration. The project was established to make Yale University Library’s work curating digital preservation data in Wikidata actionable; that is, enable it to be consumed by the Siegfried utility for the purpose of file format identification. Once accessible by such a tool, file-system data can be linked directly to Wikidata records and thus the breadth and depth of the Wikidata dataset. The combination opens up possibilities around the EaaSI work also being developed with Wikidata in mind. The Siegfried/Wikidata collaboration was an intentional one that would have been difficult to make happen through normal circumstances; be that geographic or organisational dispersal, opportunity, or cost. The project was seen as a worthwhile endeavour to pursue independently of these restrictions and other projects may in the future need to resort to non-traditional approaches to achieve their aim. The first iteration of this work successfully went live in October 2020 and for it to continue to succeed there is a call to arms from those in the digital preservation and Wikidata communities to help push it further. Work in the pipeline is believed will continue to demonstrate the worthwhile nature of today's commitment.

Cultural Heritage plays an important role in a modern city like Shenzhen. An archaeological discovery of Shenzhen 5000 years ago is innovatively preserved in library digital repository using digitalization and multimedia technologies at Southern University of Science and Technology(SUSTech). Multimedia modalities including interactive text,audio,image,graph,andvideo contents are developed, curated, and preserved in the project. Multimedia animation of a unique ritual culture from the archaeological discovery is further developed through deploying new computer graphics and Artificial Intelligence (AI) techniques. The project is materialized through inter- disciplinary collaboration among members from various teams with expertise in archaeology, multimedia, AI, and digital preservation. This collaboration enables the re-imaging of Shenzhen 5000 years ago innovatively with modern and technical elements.

With the continuous enrichment of Museum digital resources, more and more attention has been paid to the management of them. This article introduces the practice of the National Museum of China in the long-term preservation of high-definition three-dimensional images of cultural relics in terms of data acquisition, quality control, storage and security protection mechanisms.

Lightning Talk

Distributed long-term preservation with diverse roles and responsibilities is the goal of the LaVaH project. The poster describes the division of work between stakeholders from the university libraries, the data centers, and the service provider for library infrastructure. Data management is done locally at the universities, central digital archiving tasks by the service provider (hebis) and storage infrastructure is hosted by two data centers.

Lightning Talk

Dunhuang Mogao Grottoes, a world cultural heritage originally built in the 4th century, has now 735 remaining grottoes. Since the 1990s, Dunhuang Academy has taken the lead in digitizing the architectural forms, statues and murals of the grottoes through non-contact data collection and optical measurement technology, so that Dunhuang resources can be fully protected digitally. Based on that, through “digital Dunhuang”, numerous images, videos, three-dimensional digital objects, research documents and archaeological information are collected to build a digital, integrated, large-scale mural resource library and a sharing guarantee system for Dunhuang digital resources, to further link with relevant international resources and support knowledge mining and intelligent services.

Lightning Talk

Lightning Talk

Paper presented at the iPRES 2021 conference, Beijing, China, 19-22 Oct. 2021. The European Commission supported ARCHIVER project (Archiving and Preservation for Research Environments) aims to “introduce significant improvements in the area of archiving and digital preservation services, supporting the IT requirements of European scientists and providing end-to-end archival and preservation services, cost-effective for data generated in the petabyte range with high, sustained ingest rates, in the context of scientific research projects”. This paper presents a software solution developed by Arkivum to meet the needs of long-term digital preservation of scientific datasets in ARCHIVER. We present and discuss how this solution is scalable (able to process and store very large volumes of research data) and sustainable (both economically and environmentally). This is achieved through a combination of serverless computing, deployment on hyperscale infrastructure, and implementation of configurable ‘Minimum Effort Ingest’ workflows. In particular, we show how high-performance and scalable Long Term Digital Preservation (LTDP) of very- large datasets can be done in a way that is entirely compatible with high levels of cost-efficiency and minimized environmental impact.

This poster presents the challenges of population health data long-term protection, put forward the security system and multi-sided approaches to defend these threats.

Working with huge collections of unstructured data is a common yet still challenging task in digital preservation. This paper presents a tool for finding irrelevant files in large data sets to spot the relevant. The tool builds on two well-known and frequently used applications, respectively data sets and combines and extents them in a meaningful way.

This paper investigates a number of practices to ensure safety for human lives and compare them with practices to ensure the ‘lives’ of bit-streams. The selected practices for human lives are: A. common emergency preparedness practices for securement of places like shopping centers, B. safety critical systems commonly used for airplanes, space crafts and nuclear power plants, and C. pandemic preparation planning. The results of the comparison are used to illustrate how human security precautions can be used in similar ways in a bit preservation case involving methods and systems on both the technical and the organizational level

Lightning Talk

File format identification is a necessary step for the effective digital preservation of records. It allows appropriate actions to be taken for the curation and access of file types. The National Archives has existing processes for dealing with binary file format types, using tools such as PRONOM and DROID. These methods rely on using header information (metadata) and consistent binary sequences. However, these are not appropriate for the identification of text le formats as these do not contain recognisable header information or consistent patterns. Most text formats can be opened as plain text files, however file type information is often needed to understand the files use and context. Automated methods are necessary for text file format identification due to the scale of digital records processed by The National Archives, UK. An Artificial Intelligence methodology was tested and implemented using representative data collected from the GitHub repositories of UK Government departments. The first prototype developed has achieved reasonably good performance in successfully detecting five file formats with similar characteristics. The results encourage us to carry out additional experiments to include further text file format types.

International audience; The source code of landmark software developed since the beginning of the computer era is a precious part of our cultural heritage, and needs to be properly rescued, curated, archived and made available to present and future generations. In this article, we present the Software Heritage Acquisition Process, that has been designed to provide detailed guidelines on how to perform this important task, preserving important historical information. This process has been validated extensively on several important pieces of software source code of historical relevance in the University of Pisa, in collaboration with UNESCO, and is open to all for adoption and improvement.

This poster provides the latest updates on the Digital Preservation Storage Criteria. These Criteria are intended to help with developing requirements and evaluations of preservation storage solutions, to seed discussions about preservation storage, and/or to use as digital preservation instructional material. The Criteria are grouped into categories including content integrity, cost considerations, flexibility, information security, resilience, scalability & performance, support, and transparency. The working group created an accompanying usage guide covering risk management, independence, elements in establishing bit safety, and cost considerations as related to the Criteria, with new topics to be added in the next version. This year, the working group mapped each criterion to international standards that are relevant to Digital Preservation Storage such as ISO 16363 Audit and Certification of Trustworthy Digital Repositories and the ISO 27000 Information Security series. The aim of this poster is to discuss the mapping that was done between the criteria and these standards, as well as the proposed changes to the criteria and the associated usage guide as a result.

Thus far, software preservation in Dutch Heritage institutions is far from common practice. Over the course of 18 months the collaborative Software Archiving-project aimed to lower the threshold for institutions to start or advance software preservation. The project investigated the status quo, made recommendations and offered practical resources on emulation as a service, browser emulation and metadata for software preservation.

Since 2019, four groups have been created within the French association “Aristote”, including members of National Library & Archives and several Ministries. These four groups are working on these subjects: 1. Digital Formats knowledge: in all our institutions we must deal with many different formats, it was necessary to share our experience, help each other, and propose tools to help the French digital preservation community to think about the development of format preservation strategies. 2. Translation: because most of the documentation about digital preservation is not available in French. 3. Expertise: it's necessary to identify and share our experts’ knowledge on file formats between institutions because of the lack of human resources in the digital preservation domain. 4. Tools: many tools are available, and we can offer a national guidance through our experimentations. In conclusion, the creation of these groups has set up new ways to improve our National digital preservation strategy. The poster is made with BDNF (https://bdnf.bnf.fr/), a free application from the French national Library, it was created to use digital objects and images available in Gallica, the French digital national library online (https://gallica.bnf.fr).

The Dutch Digital Heritage Network has developed an online tool that helps archives and heritage organisations to formulate their policy on file formats. It builds a knowledge base, via a smart combination of codification of formats on one hand and personalisation of tailor made policies on the other. This paper will explain how the online tool is set up, what technologies it uses and what possible next steps might be in the near future.

When preserving spreadsheets, in certain cases it is decided to convert the spreadsheet file format to an image-based file format such as TIF. However, during this conversion, a loss of information can occur. Certain functionalities cannot be translated to the new file format and therefore lose their meaning. An example of this are formulas. When converting towards an image-based file format, the outcome of the formula will still be displayed, but the calculation that is behind it is lost. It is therefore imperative to find out which properties in spreadsheets are significant, such that these can be preserved. The Open Preservation Foundation’s Archives Interest Group (OPF AIG) decided to research this using the InSPECT methodology, which consists of both an Object Analysis and a Stakeholder Analysis. These two types of analysis eventually led to a longer report which was published, in which not only our results were shared, but also a reusable and practice-tested method to apply the InSPECT methodology. In this paper, we present the main findings of our research.

This paper presents findings from a multi-method study in archiving, accessing, and preserving 3D data. Specifically, we seek to develop a reusable and robust model for preserving and accessing 3D data. We further seek to identify links between digital triage, preservation actions, and archiving in multiple disciplines in order to make recommendations to embed data stewardship processes in research ecosystems. This work happens through interdisciplinary collaboration to validate curation practices across fields and disciplines. Numerous disciplines and sectors are producing 3D data for research and instruction, but without the guidance of published standards or practices generalizable across fields. This paper will present our findings from identifying researcher needs, preservation and access requirements, and metadata models for our 3D models of specimens from the Virginia Tech Entomology Department. Our outcomes are an evaluation of the output using quantitative and qualitative methods, a working 3D metadata schema for access and preservation, and an access platform for our 3D models.

Since 1996, the Internet Archive (IA) has provided storage, preservation, and access infrastructure and services to over 1,000 cultural heritage organizations around the world. It has also provided customized digital preservation services on a contractual basis to a handful of large institutions. In 2020, IA began building a more generalized digital preservation service in response to the needs of a broader range of institutions and to leverage IA’s self-owned data centers, non-profit cloud services, and demonstrated expertise in both small and petabyte-scale digital stewardship. This system is being developed in direct dialogue with 30+ organizations, including universities, public libraries, arts organizations, and cultural heritage organizations, over the course of the 2021 - 2022 year. This paper shares key takeaways from the information collected from this pre-pilot phase and serves as a lean landscape review of the current gaps within the digital preservation landscape, particularly as they relate to the distinct needs and goals of nonprofits, libraries, and cultural heritage organizations, that this service aims to address.

The growing adoption of AI and data analytics in various sectors has resulted in digital preservation emerging as a cross-sectoral problem that affects everyone from data-driven enterprises to memory institutions alike. As all contemporary storage media suffer from fundamental density and durability limitations, researchers have started investigating new media that can offer high-density, long-term preservation of digital data. In the European Union-funded Future and Emerging Technologies project OligoArchive, we are exploring one such media, namely, synthetic Deoxyribo Nucleic Acid (DNA). In this paper, we provide an overview of the ongoing collaboration between project OligoArchive and the Danish National Archive in preserving culturally important digital data with synthetic DNA.

Lightning Talk

There are three states of archival objects and their corresponding management measures. Clarifying the continuity or discreteness of signals and semantics of three states is very important in preservation. For objects at digital state, low-order logic dependencies with software and hardware dependencies as the core need to be removed. And for objects at data state, high-order logic dependencies with semantic associations as the core need to be removed.

As cultural heritage organizations seek solutions, open source, community-based, and commercial digital preservation systems and tools have proliferated. Nevertheless, given the magnitude of digital content and the requirements of specific file formats, institutions struggle to integrate disparate tools and systems to support their institutional preservation programs. The purpose of the panel discussion is to provide insights from on-the-ground implementations of current preservation tools and to consider the opportunities and challenges in deploying and integrating these tools with local digital content management processes.

The Hesburgh Libraries and Snite Museum of Art at the University of Notre Dame were awarded a 3-year grant that provided funding for a unified, cross-institutional discovery and exhibition platform that promotes serendipitous discovery of digitized cultural heritage materials. Although many digital preservation concerns were outside the scope of the grant, one beneficial output of the project has been renewed discussion and interest around robust digital preservation implementations appropriate for each institutions’ specific needs. From derivative access copies to preservation TIFF images, the lightweight technical solution was designed to meet the discovery needs of the grant partners and also leave room to connect the project with future digital preservation systems and infrastructure. In this paper, we will discuss how our efforts to bring together different types of cultural heritage materials was also informed by an opportunity to consider digital preservation needs. We will describe the flexible, human-centered workflows that the team developed to prioritize education and collaboration, while leaving space for future preservation initiatives. This case study will provide concrete examples of how to bring workflows from disparate library, archive, and museum (LAM) units into harmony while being sensitive to both current, local practices as well as perceived future needs.

Our department collects vast chunks of assorted data from legacy servers left over after teams disband and/or studios close. In most cases the domain experts that created that data and knew how to use it moved on resulting in a loss of the knowledge needed to make sense of it. Our solution to this issue was to train an AI model that could help identify and classify this data and subsequently feed the output to our catalog application. Our demonstration would show how our model was trained, how it carries out predictions, and how well it performs on those predictions. To illustrate performance we will present confusion matrices, F1 scores, and precision-recall graphs. We will also outline future plans regarding model improvements and uses.

Lightning Talk

This paper describes the volume of JHOVE-based file validation warnings in the National Library of New Zealand’s digital preservation repository, our motivation for addressing them, and the start of our automated workflow that seeks to significantly reduce the number of indicated files.

This poster describes the Format Library helper tool built by the National Library of New Zealand to aid file format research and analysis.

The Digital Lifecycle Management Interest Group (DLMIG) of the University System of Maryland and Associated Institutions (USMAI) formed in 2020 and provides a space for multi-institutional collaboration. The group is working toward a USMAI-wide digital lifecycle management strategy that will provide sustainable and scalable digital preservation and practices at consortium institutions of all sizes. This poster will share the group’s experiences and challenges thus far as a model for other consortia and collaborations.

Lightning Talk

Databases preserved in archives contain highly valuable information that frequently cannot be made freely accessible for analyses via standard data portals, be it due to legal, commercial or ethical issues. We present OSSDIP, the reference implementation of a high-security data visiting infrastructure initially conceived as a safe-compute environment for medical data. It provides highly controlled and monitored data visiting services while ensuring to the largest degree possible that data cannot be extracted from the infrastructure. This may offer archives a viable alternative for providing restricted access to sensitive data in a more flexible manner.

In 2019 the Library of Congress launched the Digital Collections Management Compendium (DCMC). This publicly available resource establishes and communicates institutional digital collections management policy. A core function of the DCMC is to articulate the connections between broader digital collections management policy and that of planning resources produced and/or consulted by Library staff. This paper provides information regarding the development of the DCMC and its key features, and supports use of the DCMC as a public resource. We intend this paper to be of use to others working on organization-wide digital collections management initiatives. More broadly, the paper contributes to the discussion on how work around digital collections policy and planning connects with practice.

Lightning Talk

Preservation metadata is the significant component of digital long-term preservation, includes the information about data processing, and undertakes the functions maintaining the reliability, integrity, authenticity, renderability, understandability of archived resources. This paper describes MedPRES preservation metadata-related work, construction requirements with the foundation of Open Archival Information System (OAIS) architecture, data model which contains object, file, event, agent entities, relationships, and semantic units, illustrate metadata practice in MedPRES key processes as well.

I. INTRODUCTION The PERSIST Content Task Force under the Preservation Subcommittee of the UNESCO Memory of the World Program would like to offer a workshop to participants at the iPres conference to be held in October 2021, titled: “Guidelines for the Selection of Digital Heritage for Long-Term Preservation: What, why, when.” The Workshop would be based on the 2nd edition of the UNESCO Guidelines for the Selection of Digital Heritage for Long-term Preservation. This edition will be officially launched during the 2nd Memory of the World Global Policy Forum to be held in Paris on 21-22 September 2021. This one-hour workshop would be geared to an audience of practitioners of digital preservation. The workshop would introduce the Guidelines, elaborate on key points made in the Guidelines, and provide opportunity to exchange questions and answers. The workshop would be informal, allowing for active interchange among the workshop participants and the workshop leader. II. OBJECTIVE The workshop’s objective is to provide guidance and advice to participants about the appropriate digital resources that should be preserved by cultural and memory institutions for long-term access. III. BACKGROUND AND RELEVANCE The origin of these Guidelines was the very successful UNESCO Memory of the World conference held in 2012 in Vancouver Canada gathering over 600 global participants from cultural institutions, governments and the information industry to discuss digital information, its safekeeping, and continued access to these digital resources [link]. One of the conclusions of the conference was that there was a lack of information and guidance on what digital items should be kept for posterity, given the fact that the volume of digital information was almost incalculable. And since 2012, that number has multiplied many times over. Some selection of digital resources would be needed in order to keep the task manageable. Therefore, a Content Task Force, consisting of members from UNESCO, The International Council on Archives (ICA) and led by IFLA was created to develop guidelines to assist practitioners and decision makers in making informed decisions about what digital resources should/must be kept for long term access. The result was the publication “Guidelines for the selection of digital heritage for long-term access” which was launched in 2016 and widely used for training and advocacy purposes around the world. Five years is a long time in the digital ecosystem, and it was felt necessary to bring the Guidelines up to date, especially to add some of the newer forms of digital resources widely available. ICA, The International Council of Museums (ICOM) and IFLA representatives as well as other experts worked for the past 18 months, in a virtual way, to develop the second edition of the Guidelines. This publication will be officially launched in September 2021. Therefore, the timing is perfect to bring this publication to the attention of practitioners and decision makers dealing with the challenges of preserving digital information at this iPres conference. This workshop would fit under Sub-theme 4: Building the Capacity.

With the advent of the so-called Web 2.0 technologies, web resources became the primary platform for internal and external collaboration, knowledge exchange, and self-publication. Many of these services cannot be fully preserved by solely relying on client-side technologies like crawlers. In particular, their dynamic and reactive character will be lost by generating static snapshots. In this article, we develop concepts and describe infrastructure built on emulation to address the problem of retiring obsolete web service infrastructure while keeping the service long-term accessible and usable. We show the practicability of this approach by the example of three use-cases from academic projects.

Lightning Talk

Purpose: Research data (RD) is a fast developing area of digital resources that requires long-term preservation. But the acquisition, processing, share, and preservation of RD involve complicated rights issues among multi-stakeholders with different or conflicting interests. Only with well-designed, easy-to-implement, and balanced rights management, we can achieve an effective, reliable, robust, sustainable research data management and preservation. This tutorial aims to summarize issues and best practices in this regard to stimulate further discussion on it.

This half day tutorial will provide participants with an introduction to the Metadata Encoding and Transmission Standard (METS) and the METS Primer. It will give a basic overview of the standard and explore different models of implementation. The METS schema is a standard for encoding descriptive, administrative, and structural metadata regarding objects within a digital library as well as digital archives, expressed using the XML schema language of the World Wide Web Consortium. It is maintained by the METS Board and the METS Maintenance Activity is managed by the Library of Congress

Lightning Talk

UNESCO Memory of the World Programme (MoW) and its Preservation Sub-Committee are concerned with the long term and sustained access to the World’s documentary heritage, including digital. They are keen to engage with the digital preservation professionals around the world, to gather the requirements for effective international policies to support digital preservation actions and, more importantly, work towards reliable access to the world’s documentary heritage, now and in the far future. The past two decades have seen unprecedented increase in publishing, documenting, and communicating in the digital form, giving rise to a wealth of knowledge, insights and experiences. Digital information is becoming critical for education, skill building and participation in the global digital economy. This panel is organized by the UNESCO Preservation Sub-Committee to discuss the critical technological, policy and sustainability factors in providing effective access to the World’s digital documentary heritage.

Lightning Talk

Lightning Talk