Showing posts with label migration. Show all posts
Showing posts with label migration. Show all posts

Saturday, February 28, 2015

OxGarage Conversion

OxGarage Conversion. Website. February 27, 2015.
An interesting web tool from the University of Oxford for converting documents to different formats.  OxGarage is a web, and RESTful, service to transform documents between a variety of formats, which uses the Text Encoding Initiative format as a pivot format.The initial option is to select:
  • Documents
  • Presentations
  • Spreadsheets
There are dozens of source and target formats listed, such as Word, WordPerfect, RSS, PDF, ppt, csv, xls, and so forth. There is an option when you upload an XML document with links to images on your computer to also add the images.  If you have a document with links to images on the internet, these will be downloaded and included with your document.
 

Sunday, December 7, 2014

Agreement Elements for Outsourcing Transfer of Born Digital Content.

Agreement Elements for Outsourcing Transfer of Born Digital Content. Ricky Erway, Ben Goldman and Matthew McKinley. Dublin, Ohio: OCLC Research. 2014. [PDF]
The article Swatting the Long Tail of Digital Media: A Call for Collaboration (2012) held that few institutions would be able to have the hardware, software, and expertise to be able to read all digital media types. A group of archival practitioners started a pilot project to test outsourcing of the transfer of content from physical media they couldn’t read in-house. They realized the need for agreements between repositories and service providers to spell out the terms of such collaboration. The group began compiling a list of elements that should be considered when creating these agreements.

This article suggests elements to consider when creating an agreement for outsourcing the transfer of born-digital content from a physical medium, while encouraging adherence to both archival principles and technical requirements. The main areas are:
  1. General Provisions: desired outcome, description of work, responsibilities and liabilities
  2. Information Supplied by Service Provider: handling instructions
  3. Information Supplied by Client: content, inventory,
  4. Statement of Work: processing, exceptions, documentation, delivery, acceptance
  5. Cost and Liability: schedule of costs and charges, responsibilities of each party
The parties should agree upon a clear set of requirements regarding the services that the Service Provider is to provide. 




Friday, October 17, 2014

Safeguard the Future of Your Data: Digital Preservation Technology for the U.S. Federal Market.

Safeguard the Future of Your Data: Digital Preservation Technology for the U.S. Federal Market. Hitachi brochure. 2014.
Hitachi’s Digital Preservation Platform (HDPP) is a non-magnetic storage solution that has the ability to preserve unlimited amounts of data for decades on end with minimal migration. The projected capacity of the storage solution is 1 PB per rack by the end of 2014. Offline media is also supported.

Cost-efficiency is another factor when considering long-term preservation. Traditional archives use a migration strategy that requires regular media refreshing which has proven to be costly over time. Migration is an ongoing process that takes a significant amount of resources.

Blu-ray optical media and M-DISC media ensure longevity and compatibility across generations of technology so the data can still be accessible as formats continue to evolve. Blu-ray discs are projected to 1 TB per disc. Mdisc capability is currently at 25 GB per disc, with plans for 300 GB per disc. Brochure also includes quick specs and diagrams.
 

Saturday, July 13, 2013

Edward R. Murrow's audio essays with the famous -- and not-so-famous -- have been digitized and put online

Edward R. Murrow's audio essays with the famous -- and not-so-famous -- have been digitized and put online. Computerworld. Lucas Mearian. July 12, 2013.
Over 800 oral essays from Edward R. Murrow's 1950s radio series, This I Believe, have been placed online for public use by Tufts University. The audio collection comes from almost 800 reel-to-reel tape recordings "that were nearly lost forever due to natural wear and tear from more than 50 years in less than ideal storage." The engineers captured the analogue recordings using a 96K, 24-bit high resolution WAV format.


Thursday, September 20, 2012

Swatting the Long Tail of Digital Media:A Call for Collaboration.

Swatting the Long Tail of Digital Media:A Call for Collaboration. Ricky Erway. OCLC Research.
September 2012. 
 Archiving born digital content stored on a wide range of physical media types requires specialized
knowledge, expertise, and equipment to read and preserve the content on physical media, ranging from punched cards to flash drives. In general, transferring content from a particular physical medium requires a compatible computer that can read the data in the format that is stored on the medium, but also other hardware and software components, such as cables and drivers. A community-based approach could establish software and workstations for antiquated technology (SWAT ) sites where a few institutions acquire and maintain the technology and expertise to read data and transfer content from particular types of obsolete media. 

Tuesday, May 1, 2012

Preserving Moving Pictures and Sound.

Preserving Moving Pictures and Sound. Richard Wright. DPC Technology Watch Report 12-01. March 2012. [PDF]
This excellent report is for anyone with responsibility for collections of sound or moving image content and an interest in preservation of that content. For audiovisual materials, digitization is critical to the survival of the content because of the obsolescence of playback equipment and decay and damage of physical items, whether analogue or digital.

The basic technology issue for audio/visual content is to digitize all items on the shelves, either for preservation or access. The risk of loss is high. Another issue is moving content from the current media to digital files. A third issue is preserving the digital files. This report describes the techniques for preservation planning, digitization and digital preservation of audiovisual content, and describes the technologies.  Preservation of these materials is difficult because they are physically, culturally, and economically different.
Explanation of signals and carriers. "Digital technology produces recordings that are independent of carriers. Carrier independence is liberation". Digital preservation of the digitized signal means to preserve the numbers, but also the technology to decode the numbers. ‘Maximum integrity’ means keeping the full quality of the audio and video. As far as possible, the new preservation copy should be an exact replica of the original: the content should not be modified in any way’. This may be difficult to achieve.

The two basic kinds of preservation action are: 1) changing the audiovisual content within a collection, or normalization; 2) changing the system that holds the collection.
There are four main factors in an analogue or digital conservation program:
  1. packaging (wrappers), handling and storing;
  2.  environmental conditions;
  3.  protecting the masters; and
  4.  condition monitoring, maintaining quality.

The four PrestoPRIME requirements for effective access to time-based media are:
  1. granularity: division of the content into meaningful units;
  2. navigation: the ability to select and use just one unit,
  3. citation: the ability to cite a point on the time dimension of an audio or video file, with a permanent link
  4. annotation: the ability of a user of content to make time-based contributions
Other topics include access rights, implications for small collections or institutions. The digitization standards, encoding, wrapper and metadata are all agreed and well documented.  There is no reason for the basic encoding to ever be changed, though wrappers may eventually become obsolete. All archives need to be aware of the risk of loss of embedded metadata. Finally, surveys have shown that in universities there is a major problem of material that is scattered, unidentified, undocumented and not under any form of preservation plan.

Thursday, December 8, 2011

A literature review: What exactly should we preserve? How scholars address this question and where is the gap

A literature review: What exactly should we preserve? How scholars address this question and where is the gap.  Jyue Tyan Low. Cornell University Library. 7 Dec 2011.
There are generally two approaches to long-term preservation of digital materials
  1. preserving the object in its original form as much as possible along with the accompanying systems,
  2. migration or transformation: transforming the object to make it compatible with more current systems but retaining the original “look and feel.
Migration is the most widely used method, but there can be changes to the original.  If some of the original properties are lost, what then are the essential properties to maintaining its integrity?  Currently there are no formal and objective way to help stakeholders decide what the significant properties of the objects are, which are defined as:
The characteristics of digital objects that must be preserved over time in
order to ensure the continued accessibility, usability, and meaning of the
objects, and their capacity to be accepted as evidence of what they purport
to record.
An important goal of digital preservation is more than just retrieving the objects, it is to ensure the authenticity of the information.  A digital object can change as long as the final output is what it is expected to be.  The properties to preserve come from the purpose of the object, and at least one purpose for the object needs to be defined. Archivists have created standards that look at records in the context of their creation, intended use and preservation.  It is important to ask what features of the object is important when delivering to the user.  There may be many uses to many communities that were not intended by the object creator, so we should not let the ideal limit the reasonable.

Friday, April 30, 2010

Digital Preservation Matters - April 30, 2010

Digital Preservation: An Unsolved Problem. Jonathan Shaw. Harvard Magazine. April 27, 2010.

With the advantages of digital, why do libraries not embrace the digital future now? One of the main obstacles is the issue of preservation. For books: "the greatest risks to printed material are the environment, wear and tear, security, and custodial neglect." For digital: using data is one of the best ways to preserve it because you know it is usable; digital data must be read and checked constantly to ensure integrity. Another concern about digital is that current formats may not be readable in the future (reference to June 2009 New Yorker cover). Born digital materials are not as easy to save since they have many different formats. This is difficult for librarians keeping records of the university's intellectual life, because of both the legal and digital challenges. "We are in a period of unprecedented lack of documentation of academic output."

---

Gutenberg 2.0. Harvard's libraries deal with disruptive change. Jonathan Shaw. Harvard Magazine. April 27, 2010.

In the scientific disciplines, information, from online journals to databases, must be recent to be relevant. Books in libraries to some seem more like a museum. Some think that massive digital projects will make research libraries irrelevant. The future of libraries is clearly digital. "Yet if the format of the future is digital, the content remains data. And at its simplest, scholarship in any discipline is about gaining access to information and knowledge." Access to the information will mean different things and be done in different ways. In the meantime, "Who has the most scientific knowledge of large-scale organization, collection, and access to information? Librarians."

How do we deal with large scale collections and the access to the information? "We ought to be leveraging that expertise to deal with this new digital environment. That's a vision of librarians as specialists in organizing and accessing and preserving information in multiple media forms, rather than as curators of collections of books, maps, or posters." The role of libraries isn't going away, but it is changing.

The idea that libraries will be stewards of vast data collections raises very serious concerns about the long-term preservation of digital materials. The worry is that the longevity of the resources has not been tested. There are 3 copies of the 109 TB Harvard repository. It is in a constant process of checking and refreshing to make sure everything is readable.

---

The Floppy is Dead: Time to Move Memories to the Cloud. Lance Ulanoff. PC Magazine. Apr 26, 2010.

The decision by Sony to stop producing 3.5-inch disks marks an end to that format. The end of any popular format can have a ripple effect on the technology world. If the data is not migrated to later formats it could "trapped on its obsolete format". All media will become obsolete sometime, it is the natural progression of technology. Since change is inevitable the article suggests everyone consider cloud-based backup storage options. It suggests that this is better than storing data on eventually-to-be-obsolete media.

---

Google is not the last word in information. Lia Timson. Sydney Morning Herald. April 29, 2010.

Interesting article concerning primary and secondary sources, what is on the internet and how it gets there, special collections, etc.

  • "Better still is the lesson and the realisation that information and history don't just appear on Google. Someone has to publish it onto the web, put it there in the first place."
  • "As educators we must ask that assignment bibliographies include more than just "three websites". We must insist on a variety of media as sources, including interviews with real people, be they witnesses, historians or surviving relatives, and even insist on trips to the local library."
  • … researching is much wider and deeper than searching online.

---

A Gentle Reminder to Special-Collections Curators. Todd Gilman. The Chronicle of Higher Education. April 29, 2010.

Article and a librarian's experience trying to use special collections. The "job is not to keep readers from your books but just the opposite: to facilitate readers' use of the collections."

---

Tuesday, February 9, 2010

Digital Preservation Matters - February 8, 2010


Online Recordkeeping: It's All in a Name. Mimi Dionne. Internet Evolution. February 2, 2010.


The born-digital record lifecycle has five stages, in chronological order: creation; distribution and use; storage and maintenance; retention; and disposition or archival preservation. All five stages are important. One of the best practices for born-digital records is uniform file naming protocols, including location, to encourage strong content management. These should align with the records retention policies. Organizations are better off if they select the information they need to retain and destroy what they don’t need. “The benefits of implementing a records program that includes regular records destruction have far-reaching influence not only on compliance issues and maintenance of a company’s IT environment but also the health of its budget.”


---


SPIE to Preserve E-Books in Portico. Press Release. Portico. 2 February 2010.

Portico has agreed with SPIE (the international society for optics and photonics) to preserve its collection of e-books, currently 93 items. It already participates with Portico to preserve its e-journals. Portico now holds over 34,000 e-books and over 10,000 e-journals. The SPIE has also announced the launch of their digital library, which includes 120 SPIE Press titles from the Field Guides, Monographs, and Tutorial Texts series.


---


Long-Term Preservation Of Web Archives – Experimenting With Emulation And Migration Methodologies. Andrew Stawowczyk Long. IIPC. December 2009. [54 p. PDF]

The decision to emulate or migration are largely based on personal beliefs, rather than on any particular evidence. We do not know which of these is more useful in the long term. All objects change over time, so ensuring long-term, useful access to collections requires we first define the most important aspects of an object that needs to be preserved. The “Preservation Intent” may be useful for this, which is what the institution intends to preserve for any given digital object and for how long. Also needed is the creator’s intent, the contextual information and the technical information.

Two possible approaches for institutions may be:

  1. preserve digital objects over the next twenty years;
  2. find means of preserving objects for longer.

Or an approach may include both: preserve items for 20 years while the search for longer preservation mechanisms continues. “Significant properties” means the properties of a digital object that are essential to the representation of the intended meaning of that object.

The author does not recommend either emulation or migration as a perfect solution to the problem at this current time. Also, their findings and recommendations include:

  1. There are no tools suitable for long-term preservation of very large web archives
  2. All preservation actions need to be based on a clearly defined “Preservation Intent”
  3. Migration and emulation offer some time extensions to for short term access to digital objects.
  4. Emulation seems to present higher risks as a long-term preservation methodology.

It is not possible to preserve it all. Priorities need to be established for practical, long-term preservation solutions. The best hope for adequate long-term preservation, lies in continuous and systematic work, researching various preservation methodologies, and improving our understanding of the future use of web archives.

---

Is NAND flash about to hit a dead end? Lucas Mearian. Computerworld. February 4, 2010.

IM Flash Technologies has said that shrinking the technology much further may not be possible because of problems with bit errors and reliability. The number of electrons that can be stored in the memory cell decreases with each generation of flash memory, making it more difficult for the cells to reliably retain data.

---

CNRI Digital Object Repository™. Corporation for National Research Initiatives. 19 January 2010.

(CNRI) has developed a new version of its Digital Object Repository Software. It is open source, flexible, scalable, secure, and has a suite that provides a common interface for accessing all types of digital objects. Redundancy is supported by a mirroring system with software to ensure that replicated objects are kept in sync.