BitCurator Access

From BitCurator
Jump to: navigation, search

The BitCurator Access project developed tools to assist collecting institutions (libraries, archives, and museums) in providing web-based and local access to born-digital materials held on disk images. BitCurator Access tools simplify access to raw and forensically-packaged disk images, allowing collecting institutions to incorporate these objects into access environments in a manner that reflects the original order and relevant environmental context. Using open source digital forensics software libraries, these tools enable detailed analysis of file and file system provenance, quality and accessibility of files, metadata in files and the file system, and residual (non-file system) data contained within disk images.

Downloads (Web Tools)

The bitcurator-access-webtools project is a virtualized web service providing access to disk images contents.

File-2.png
bitcurator-access-webtools (GitHub)

Current and past releases

Book-2.png
Quickstart Guide (bitcurator-access-webtools) Installing and using bitcurator-access-webtools.

Downloads (Redaction Tools)

The bitcurator-access-redaction project includes a disk image redaction tool and a Python API to construct your own redaction tools.

File-2.png
bitcurator-access-redaction (GitHub)

Current and past releases

Book-2.png
Quickstart Guide (bitcurator-access-redaction) Installing and using bitcurator-access-redaction.

Online Help

User-8.png
BitCurator User Group Get support and discuss issues with the community.
Monitor.png
Screencasts and Video Tutorials Screencasts and tutorials on our YouTube channel.

Licenses

The source in the BitCurator Access GitHub repositories is GPL v3 licensed. This wiki, documentation, and other materials generated by the BitCurator team are licensed under Creative Commons Attribution 4.0 International (CC BY 4.0). All other software included in the BitCurator environment is distributed in accordance with original licenses.

Research and Development Areas

BitCurator Access focused on four areas of interest related to accessing born-digital collections:

  • Web-based access to raw and forensically packaged disk images
  • Transforming and using digital forensics metadata in collecting environments
  • Redaction of file items, metadata and hidden data from disk images
  • OS and executable virtualization for legacy disk images

Browsing Disk Images on the Web

The bitcurator-access-webtools project is a Flask application that allows users to browse file systems in raw and forensically packaged disk images within a web browser. The application can parse raw and E01-packaged images containing FAT16, FAT32, NTFS, HFS+, and EXT 2/3/4 file systems, and allows users to navigate the file system contents, download individual files, and search the contents within a simple web interface.

For more information on the design of the application, along with instructions on how to obtain and build the software, see the BitCurator Access Webtools page.

See also Screencast Tutorials for walkthroughs of past releases.

Redaction

The bitcurator-access-redaction project builds on existing disk image redaction and Digital Forensics XML tools to provide collecting institutions with software to redact strings and byte sequences identified in disk images. The software also includes a Python API allowing institutions to develop powerful custom redaction facilities using cutting-edge tools including lightgrep.

Developing comprehensive strategies for redacting born-digital materials is an important concern for many archives, libraries, and museums. Digital media acquisitions often contain data that may be classified as private, sensitive, or individually identifying, and the complexity and volume of information being collected demands automation to ensure that risks of inadvertent disclosure are minimized.

Currently, there are relatively few open source redaction tools capable of addressing these needs. The bitcurator-access-redaction project targets specific needs, including:

  • Redacting specific bitstreams from raw disk images
  • Creating redacted copies of forensically-packaged disk images
  • Redacting metadata from common file formats, including Office and PDF files.
  • Redacting patterns from bitstreams using pylightgrep

Virtualization

Born-digital materials that contain executable content or bootable operating systems often require virtualized hardware support to remain accessible. Between 2014 and 2016, the BitCurator Access project explored a range of methods to provision virtual machines providing access to disk images extracted from legacy media, including the use of the bwFLA Emulation-as-a-Service platform developed at the University of Freiburg.

You can find a more detailed explanation of the intended use cases and related technologies in the paper "Functional Access to Forensics Disk Image in a Web Service" (also in the Proceedings of iPres 2015).