Username: Password: lost p/w?
home | help | subscribe | search | register
Even Digital Memories Can Fade
Posted by FolkTom Barger in on November 10, 2004 at 9:53 AM



November 10, 2004
Even Digital Memories Can Fade
By KATIE HAFNER
http://nytimes.com/2004/11/10/technology/
10archive.html?hp&ex=1100149200&en=0b6f57f06554be78&ei=5094&partner=homepage

he nation's 115 million home computers are brimming over with personal treasures - millions of photographs, music of every genre, college papers, the great American novel and, of course, mountains of e-mail messages.

Yet no one has figured out how to preserve these electronic materials for the next decade, much less for the ages. Like junk e-mail, the problem of digital archiving, which seems straightforward, confounds even the experts.

"To save a digital file for, let's say, a hundred years is going to take a lot of work," said Peter Hite, president of Media Management Services, a consulting firm in Houston. "Whereas to take a traditional photograph and just put it in a shoe box doesn't take any work." Already, half of all photographs are taken by digital cameras, with most of the shots never leaving a personal computer's hard drive.

So dire and complex is the challenge of digital preservation in general that the Library of Congress has spent the last several years forming committees and issuing reports on the state of the nation's preparedness for digital preservation.

Jim Gallagher, director for information technology services at the Library of Congress, said the library, faced with "a deluge of digital information," had embarked on a multiyear, multimillion-dollar project, with an eye toward creating uniform standards for preserving digital material so that it can be read in the future regardless of the hardware or software being used. The assumption is that machines and software formats in use now will become obsolete sooner rather than later.

"It is a global problem for the biggest governments and the biggest corporations all the way down to individuals," said Ken Thibodeau, director for the electronic records archives program at the National Archives and Records Administration.

In the meantime, individual PC owners struggle in private. Desk drawers and den closets are filled with obsolete computers, stacks of Zip disks and 3½-inch diskettes, even the larger 5¼-inch floppy disks from the 1980's. Short of a clear solution, experts recommend that people copy their materials, which were once on vinyl, film and paper, to CD's and other backup formats.

But backup mechanisms can also lose their integrity. Magnetic tape, CD's and hard drives are far from robust. The life span of data on a CD recorded with a CD burner, for instance, could be as little as five years if it is exposed to extremes in humidity or temperature.

And if a CD is scratched, Mr. Hite said, it can become unusable. Unlike, say, faded but readable ink on paper, the instant a digital file becomes corrupted, or starts to degrade, it is indecipherable.

"We're accumulating digital information faster than we can handle, and moving into new platforms faster than we can handle," said Jeffrey Rutenbeck, director for the Media Studies Program at the University of Denver.

Professional archivists and librarians have the resources to duplicate materials in other formats and the expertise to retrieve materials trapped in obsolete computers. But consumers are seldom so well equipped. So they are forced to devise their own stop-gap measures, most of them unwieldy, inconvenient and decidedly low-tech.

Philip Cohen, the communications officer at a nonprofit foundation in San Francisco, is what archivists call a classic "migrator." Since he was in elementary school, Mr. Cohen, 33, has been using a computer for his school work, and nearly all of his correspondence has been in e-mail since college.

Now Mr. Cohen's three home computers are filled with tens of thousands of photos, songs, video clips and correspondence.

Over the years, Mr. Cohen, who moonlights as a computer fix-it man, has continually transferred important files to ever newer computers and storage formats like CD's and DVD's. "I'll just keep moving forward with the stuff I'm sentimental about," he said.

Yet Mr. Cohen said he had noticed that some of his CD's, especially the rewritable variety, are already beginning to degrade. "About a year and a half ago they started to deteriorate, and become unreadable," he said.

And of course, migration works only if the data can be found, and with ever more capacious hard drives, even that can be a problem.

"Some people are saying digital data will disappear not by being destroyed but by being lost," Dr. Rutenbeck said. "It's one thing to find the photo album of your trip to Hawaii 20 years ago. But what if those photos are all sitting in a subdirectory in your computer?"

For some PC users, old machines have become the equivalent of the bin under the bed. This solution, which experts call the museum approach to archiving, means keeping obsolete equipment around the house.

Simon Yates, an analyst at Forrester Research, for example, keeps his old PC in the back of a closet underneath a box. The machine contains everything in his life from the day he married in 1997 to the day he bought his new computer in 2002. If he wanted to retrieve anything from the old PC, Mr. Yates said, it would require a great deal of wiring and rewiring. "I'd have to reconfigure my entire office just to get it to boot up," he said.

Peter Schwartz, chairman of the Global Business Network, which specializes in long-range planning, says that a decade or two from now, the museum approach might be the most feasible answer.

"As long as you keep your data files somewhat readable you'll be able to go to the equivalent of Kinko's where they'll have every ancient computer available," said Mr. Schwartz, whose company has worked with the Library of Congress on its preservation efforts.

"It'll be like Ye Olde Antique Computer Shoppe," Mr. Schwartz said. "There's going to be a whole industry of people who will have shops of old machines, like the original Mac Plus."

Until that approach becomes commercially viable, though, there is the printout method.

Melanie Ho, 25, a graduate student at the University of California, Los Angeles, has been using computers since elementary school. She creates her own Web sites and she spends much of her day online.

Yet she prints important documents and stores a backup set at her parents' house 100 miles away.

"As much as a lot of people think print will be dead because of computers," she said, "I actually think there's something about the tangibility of paper that feels more comforting."

Proponents of paper archiving grow especially vocal when it comes to preserving photographs. If stored properly, conventional color photographs printed from negatives can last as long as 75 years without fading. Newer photographic papers can last up to 200 years.

There is no such certainty for digital photos saved on a hard drive.

Today's formats are likely to become obsolete and future software "probably will not recognize some aspects of that format," Mr. Thibodeau said. "It may still be a picture, but there might be things in it where, for instance, the colors are different."

The experts at the National Archives, like those at the Library of Congress, are working to develop uniformity among digital computer files to eliminate dependence on specific hardware or software.

One format that has uniformity, Mr. Thibodeau pointed out, is the Web, where it often makes no difference which browser is being used.

Indeed, for many consumers, the Web has become a popular archiving method, especially when it comes to photos. Shutterfly.com and Ofoto .com have hundreds of millions of photographs on their computers. Shutterfly keeps a backup set of each photo sent to the site.

The backups are stored somewhere in California "off the fault line," said David Bagshaw, chief executive of Shutterfly.

But suppose a Web-based business like Shutterfly goes out of business?

Mr. Bagshaw said he preferred to look on the bright side, but offered this bit of comfort: "No matter what the business circumstances, we'll always make people's images available to them."

Constant mobility can be another issue.

Stephen Quinn, who teaches journalism at Ball State University in Muncie, Ind., moves frequently because of his work. He prefers to keep the amount of paper in his life to a minimum, and rarely makes printouts.

Dr. Quinn has a box in the bottom drawer of his desk that contains an eclectic set of storage disks dating back to the early 1980's, when he started out on an Amstrad computer.

All of Dr. Quinn's poetry ("unpublished and unpublishable" he says) and other writings are on those various digital devices, along with his daily diaries.

At some point, he wants to gather the material as a keepsake for his children, but he has no way to read the files he put on the Amstrad disks more than 20 years ago. He has searched unsuccessfully for an Amstrad computer.

"I have a drawer filled with disks and no machinery to read it with," Dr. Quinn said.

That is becoming a basic problem of digital life. Whatever solution people might use, it is sure to be temporary.

"We will always be playing catch up," said Dr. Rutenbeck, who is working at pruning his own digital past, discarding old hard drives and stacks of old Zip disks.

"It feels really good to do," he said, "just like I didn't keep a box of everything I did in first grade."


User Comments

DMemberburner97119
Date: November 10, 2004 @ 11:31 AM
good artical . i have about 1200 cdr disc's burned and have come to the conclusion that besides the fact they can be damaged and just plain go bad over time they take up way to much room and even with a decent filing system its a hassle getting to the data i want . ive gone to using usb enclosures with 200 gig internal ata drives that way i have plenty of room for now and all i have to do is turn the drive i want on and the file im after is instantly available .
Advancedgoldenpi
Date: November 10, 2004 @ 12:02 PM
My vast collection is safer - mostly on CDs, but all packaged in lighttight containers, in a suitably temperate room.

Hard drives are reliable and convenient. The main problem is what happens if they do fail - you can lose a huge amount of data. At least if a CD fails, you havn't lost too much.
DMembertelsien
Date: November 10, 2004 @ 12:30 PM
Over time, nothing. A friend of mine gave me a disk with a bunch of pictures on it about three months ago, and it effectively freezes my computer every time I put it in.
DMembertelsien
Date: November 10, 2004 @ 12:38 PM
and it did work at first, plus there are no scratches. :( (Frown)
Advancedpepe512000
Date: November 10, 2004 @ 3:34 PM
Computers were suppose to free us all of paper and files, etc.... HA...I'm being buried in our office here under mounds of printed out material and cd stored data... it's crazy!
Advancedpepe512000
Date: November 10, 2004 @ 3:36 PM
We also have six back-up computers... SIX! Nutso.
DMemberTheRealJFM
Date: November 10, 2004 @ 3:47 PM
easy way - get a managed webhosting contract with a no dataloss and no downtime guarantee - store your files on the resulting FTP server in the private folders (check the privacy policy here to make sure the hosts can't read the files).

Bingo! You have permenant backups of the files, and the HOST has to worry about the dataloss and backup methods.

Other than that you can't go wrong with mirrored harddiscs on two mirrored machines :p (Joking)
DMemberterabyte
Date: November 10, 2004 @ 4:02 PM
I upgrade my computer every few years, and have yet have a hard drive actually fail on me. Each time I upgrade, I make a copy of my old data onto the new hard disk, effectively renewing it. As far as I'm concerned, this is the best possible way to keep data safe.

But I'm not an expert.
Advancedgoldenpi
Date: November 10, 2004 @ 4:23 PM
Ive seen failures - one induced by physical abuse (a laptop is not a battering ram), one which just popcorned a chip.
Intermediatewet1
Date: November 10, 2004 @ 5:20 PM
So far there is no permanet media that is a guarrenty that will always be there. Unless you want to etch it in steel or something simular.

For average Joe, computers have come a long way. For each Joe the computer is some particular useful contraption for some particular useful task.

It does lack durablity over the long haul. It is either outmoded in several years to where the programs no longer work, or the storage media is such that you will have to purchase something else to continue to store on it. Everything runs out of space at some point.

Without backups of that data, you stand a good chance to lose it. All it takes is a good trojan, worm, hd failure, heck even a crash of the NFTS will take out the hd. File can still be there but won't be accessible to you without some sort of data recovery techniques. While drives are more dependable than ever, these events do happen.

As many corporations have found, without hard paper backups all can be lost. Many libraries have been worrying about this event for a long time. Acidic paper in books, archiving records for historic purposes and for retrival of the same data at some point in the future has been a headache for them. With the DMA being put in more and more programs it will only become harder to solve this.

Soon there will be no archiving of this or that public tv program for research. The broadcast flag will take care of that. No copying possible. The only winners in this are the money hungry corporations, not the public and certainly not historians or librarians.
AdminCodeWarrior
Date: November 10, 2004 @ 8:41 PM
Acid free parchment for me :) (Smile)
Advancedawehr
Date: November 10, 2004 @ 9:49 PM
blu-ray may be the best media of the future for preservation purposes.

The media can be paper based (is paper based in its current form), and thus can be made from the acid free derivitives used for print and photo preservation.
AdvancedDeadMan2003
Date: November 10, 2004 @ 11:23 PM
Once internet speeds reach the point at which size limits are not the issue then remote encrypted backup/storage will have an important role to play. I can't see why ISP's don't offer this service anyhow. They offer an FTP site. They could actually charge a small amount extra and offer hard drive backup facilities whilst retaining your privacy through encryption.

RAID arrays are good also in that they offer cyclic redundacy. I would do this myself but everytime I buy a new hard disk I fill it up so I never have enough room to do it. Maybe I should think about just buying a 3 drive array in one go and moving what I can to those and then do the other drives or something. Presently I am using the USB2 hard disk enclosure method. But they could fail obviously.
DMemberTechnoPuppet
Date: November 11, 2004 @ 3:18 AM

Timely article

I've been thinking of this recently. I started archiving all my programs, pic's, movies, music... back in 95. I now have a sizable collection of CD-R's. Although i have not encountered a bad CD as of yet, I'm starting to worry about the integrity of my collection.
Advancedgoldenpi
Date: November 11, 2004 @ 7:50 AM
Techno - I had the same problem. And still do. I am transfering much of my data to DVD-R now. Each disc contains 3.8G of data, 400M of par2 recovery files, and 200M from the previous disc. That does increase the cost a little, but it gives me enough redundency to recover from even fairly serious disc failures.
DMemberChaos2ndz
Date: November 11, 2004 @ 1:36 PM
I also archive all my stuff on Dvd-r but it's inevitable to find a disc that just will not work after some time for some oddball reason.

Otherindependentm...
Date: November 12, 2004 @ 4:10 AM
Does your chewing gum loose its' flavor on the bed-post overnight?

:) (Smile)
You must be logged in to post replies to news articles.
Log in or register with the form at the top of the page.

 

 

 

search

news tree


advertising



 

 
© DMusic LLC - Advertising | Employment | TOS | Subscribe