How do you fit 32 terabytes of storage into a hard drive? With a HAMR.
Seagate has been experimenting with heat-assisted magnetic recording, or HAMR, since at least 2002. The firm has occasionally popped up to offer a demonstration or make yet another “around the corner” pronouncement. The press has enjoyed myriad chances to celebrate the wordplay of Stanley Kirk Burrell, but new qualification from large-scale customers might mean HAMR drives will be actually available, to buy, as physical objects, for anyone who can afford the most magnetic space possible. Third decade’s the charm, perhaps.
HAMR works on the principle that, when heated, a disk’s magnetic materials can hold more data in smaller spaces, such that you can fit more overall data on the drive. It’s not just putting a tiny hot plate inside an HDD chassis; as Seagate explains in its technical paper, “the entire process—heating, writing, and cooling—takes less than 1 nanosecond.” Getting from a physics concept to an actual drive involved adding a laser diode to the drive head, optical steering, firmware alterations, and “a million other little things that engineers spent countless hours developing.” Seagate has a lot more about Mozaic 3+ on its site.
Drives based on Seagate’s Mozaic 3+ platform, in standard drive sizes, will soon arrive with wider availability than its initial test batches. The driver maker put in a financial filing earlier this month (PDF) that it had completed qualification testing with several large-volume customers, including “a leading cloud service provider,” akin to Amazon Web Services, Google Cloud, or the like. Volume shipments are likely soon to follow.
One of the things enterprise storage and destruction company Iron Mountain does is handle the archiving of the media industry’s vaults. What it has been seeing lately should be a wake-up call: roughly one-fifth of the hard disk drives dating to the 1990s it was sent are entirely unreadable.
Music industry publication Mix spoke with the people in charge of backing up the entertainment industry. The resulting tale is part explainer on how music is so complicated to archive now, part warning about everyone’s data stored on spinning disks.
“In our line of work, if we discover an inherent problem with a format, it makes sense to let everybody know,” Robert Koszela, global director for studio growth and strategic initiatives at Iron Mountain, told Mix. “It may sound like a sales pitch, but it’s not; it’s a call for action.”
Hard drives gained popularity over spooled magnetic tape as digital audio workstations, mixing and editing software, and the perceived downsides of tape, including deterioration from substrate separation and fire. But hard drives present their own archival problems. Standard hard drives were also not designed for long-term archival use. You can almost never decouple the magnetic disks from the reading hardware inside, so that if either fails, the whole drive dies.
There are also general computer storage issues, including the separation of samples and finished tracks, or proprietary file formats requiring archival versions of software. Still, Iron Mountain tells Mix that “If the disk platters spin and aren’t damaged,” it can access the content.
But “if it spins” is becoming a big question mark. Musicians and studios now digging into their archives to remaster tracks often find that drives, even when stored at industry-standard temperature and humidity, have failed in some way, with no partial recovery option available.
“It’s so sad to see a project come into the studio, a hard drive in a brand-new case with the wrapper and the tags from wherever they bought it still in there,” Koszela says. “Next to it is a case with the safety drive in it. Everything’s in order. And both of them are bricks.”
Entropy wins
Mix’s passing along of Iron Mountain’s warning hit Hacker News earlier this week, which spurred other tales of faith in the wrong formats. The gist of it: You cannot trust any medium, so you copy important things over and over, into fresh storage. “Optical media rots, magnetic media rots and loses magnetic charge, bearings seize, flash storage loses charge, etc.,” writes user abracadaniel. “Entropy wins, sometimes much faster than you’d expect.”
There is discussion of how SSDs are not archival at all; how floppy disk quality varied greatly between the 1980s, 1990s, and 2000s; how Linear Tape-Open, a format specifically designed for long-term tape storage, loses compatibility over successive generations; how the binder sleeves we put our CD-Rs and DVD-Rs in have allowed them to bend too much and stop being readable.
Knowing that hard drives will eventually fail is nothing new. Ars wrote about the five stages of hard drive death, including denial, back in 2005. Last year, backup company Backblaze shared failure data on specific drives, showing that drives that fail tend to fail within three years, that no drive was totally exempt, and that time does, generally, wear down all drives. Google’s server drive data showed in 2007 that HDD failure was mostly unpredictable, and that temperatures were not really the deciding factor.
So Iron Mountain’s admonition to music companies is yet another warning about something we’ve already heard. But it’s always good to get some new data about just how fragile a good archive really is.
There is the mental image that most people have of electronics recycling, and then there is the reality, which is shredding.
Less than 20 percent of e-waste even makes it to recycling. That which does is, if not acquired through IT asset disposition (ITAD) or spotted by a worker who sees some value, heads into the shredder for raw metals extraction. If you’ve ever toured an electronics recycling facility, you can see for yourself how much of your stuff eventually gets chewed into little bits, whether due to design, to unprofitable reuse markets, or sheer volume concerns.
Traditional hard drives have some valuable things inside them—case, cover, circuit boards, drive assemblies, actuators, and rare-earth magnets—but only if they avoid the gnashing teeth. That’s where the DiskMantler comes in. Garner Products, a data elimination firm, has a machine that it claims can process 500 hard drives (the HDD kind) per day in a way that leaves a drive separated into those useful components. And the DiskMantler does this by shaking the thing to death (video).
The DiskMantler, using “shock, harmonics, and vibration,” vibrates most drives into pieces in between 8–90 seconds, depending on how much separation you want. Welded helium drives take about two minutes. The basic science for how this works came from Gerhard Junker, the perfectly named German scientist who fully explored the power of vibrations, or “shear loading perpendicular to the fastener axis,” to loosen screws and other fasteners.
As Garner’s chief global development officer, Michael Harstrick, told E-Scrap News, the device came about when a client needed a way to extract circuit boards from drives fastened with proprietary screw heads. Prying or other destruction would have been too disruptive and potentially damaging. After testing different power levels and durations, Garner arrived at a harmonic vibration device that can take apart pretty much any drive, even those with more welding than screws. “They still come apart,” Harstrick told E-Scrap News. “It just takes a little bit.”
Improving the recovery and sorting ease of hard drives is itself a useful thing, but the potential for rare-earth magnet recycling is particularly attractive. Most rare-earth magnet recycling involves “long-loop” recycling, or breaking them down into rare earth elements and then putting those back into the magnet production stream, which is energy-intensive and not very cost-effective. Electric vehicles and wind turbines have huge amounts of rare-earth magnets in them but rarely see recycling. Hard drives, while individually small, are massive in scale, with roughly 259 million shipped in 2021.
One Canadian firm, based on a University of Birmingham-patented process, wants to reuse drive magnets more directly, creating new sources that don’t require extraction and aren’t quite so globally concentrated. That Canadian firm, HyProMag, uses robotics to find and extract drives’ permanent magnets, then sends the rest of the disk off for recycling.
The technology is not all there yet, but soon enough, it looks like something interesting will shake out.