Rony Sebok: Expansion System For Mac
Source:, 13 June 2000. Instructions from Steve Espinosa: When Steve hired me to put together the Macintosh documentation suite, he gave me a couple watchwords that completely changed the approach we took.
- Rony Sebok: Expansion System For Mac 2017
- Rony Sebok Expansion System For Mac And Windows
- Rony Sebok 1 Beyond Inc
First of all, I was hired to run pubs on Macintosh when the Macintosh group was only 6 or 7 people. It was fairly remarkable to get the Publications department in so early in the project. That's because Steve knew I had a lot of work to do in planning and figuring out what to write about. It wasn't just, 'Here's the product, write about it.' The second thing was that he really wanted to capture a value that he had captured osmotically from what people really valued from the Apple II: that with properly designed software, the system teaches you how to use it itself. If the menu structure and the purpose of the application and the user interface are clear enough, you don't need manuals.
So he told me that my job as publications manager on Macintosh was to put myself out of a job, in that in the best of all possible worlds, my job wouldn't need to exist, because the software would teach itself. And that was a real good lesson that a lot of people have forgotten: that the chief aspect of good user interface design is that people should be able to walk up to a system on their own, and figure out how to use it without having to read a book, or even having to read a help system. A help system is often not much better than a book, except you can't look at it and the system at the same time because you don't have the screen real estate. So I started hiring a bunch of people. Amnesia: the dark descent for mac. I was only 20 years old, but Steve was 24, so he didn't consider this that unusual.
Working with Programmers There were two major groups I worked with that got the publications process on Macintosh incredibly connected with the project as a whole. The first was with the software team. That started by doing tech documentation, and getting ourselves familiar with and well-connected with the programmers, by writing documentation by which they could get other people to write programs sitting on their operating system. I think that really really helped, because it proved to Jerome Coonen (Macintosh's software engineering manager) and Andy Hertzfeld and Steve Capps and everybody could trust me because we wrote the technical manuals that let people use their system software. You can't just publish APIs and hope people will understand how to do it: you need the low-level technical documentation to explain it. And when they started seeing these programs coming in from third parties that really used their software right, that helped confirm that the publications group was an integral part of the software design process.
Caroline Rose was just fiendish about that. She was our technical documentation lead, and her relationship with Andy was really, really funny. She was doing what I was talking about before, which was asking him the tough questions about what he was going to do next that he hadn't thought about before. She really made his life difficult, and helped him design better software. She would sit there and say, 'But I don't understand. Tell me again how you build a control?' And he'd go through it over and over again, until he finally came to the realization that, 'You know, if it's this hard to understand, I didn't do it right.'
Rony Sebok: Expansion System For Mac 2017
And he'd tell her to go away, and then he'd completely reinvent it overnight. The next day he'd say, 'Okay, this is how you do it now,' and she'd say, 'Oh, that's much clearer; thank you for explaining it.' Caroline Rose talks in her about her work, and her with Mac software developers. Well, he didn't explain it better; he completely redesigned it, because it was so hard to explain. That is when documentation really works. And Caroline is the best I've ever seen at that. She sits in an engineer's office, and she- she doesn't play stupid, she just asks them over and over and over again, to explain clearly what they mean.
And it forces them to think clearly about what they're designing. She's just without peer.
User Documentation But then I brought in my user documentation people. Lynnea Johnson did with Randy Wigginton on MacWrite what Caroline did with Andy and Steve Capps on the operating system. Lynnea had little if any formal experience as a technical writer, and she had little if any formal experience with computers. She didn't have very much experience working in business at all. She was working in the typing pool at Bechtel when I hired her. She had just come off of a three-year boat trip where she was part of a crew with rotating captainship; the ship just went around the world two or three times, and picked up cargo in one port and carried it to another, and that's how they got enough money to sustain themselves. Those were her credentials to be a technical writer.
I saw a writing sample and thought she had the right voice. I wasn't looking for- in hiring for the Macintosh project we weren't looking for credential and experience, we were looking for people who were a good fit, and who got it. And she had the right writing voice, and she got it. And she just sat down with Randy Wigginton, and while trying to write about the user interface design of the rulers she'd say, 'I can't explain this, it doesn't make sense.' And then she and Randy would work out, well, what if you dragged the tab from over here, and it did this motions with hands, as if dragging tabs.
So in those kinds of cases, the writing team that I hired and threw in with the programmers were really, really vital in designing the user interface. By being the people who had to explain it, they helped the programmers figure out how much better to do their work. Debate Over MacPaint The anti-case of that were the interesting interactions between Bill Atkinson and Carol Kaehler. Carol had been in various places before. She'd done some technical writing at Xerox PARC, and she knew Bruce Horn from there.
Her husband was Ted Kaehler, who worked with Alan Kay. She was writing the MacPaint manual, and Bill Atkinson had a different idea of how the MacPaint manual should be written.
The other group I was working with- and this fits in with the story- was the creative services team. We had an incredible creative services team.
It was first under James Farris and Tom Suiter, and then we hired our head of creative services for the Mac, and he put together a team under Clement Mok, who also later went on to do bigger and better things. Tom Suiter later cofounded CKS Partners (now part of marchFIRST), and was in Wired. Manual Structure Steve's original idea for the manuals was that they would be like magazines.
They'd be really readable, they'd be short articles, they'd be essays and things like that. The problem was that he didn't have a product to write about, and he we had all these traditional things we had to cover, like how to handle a floppy disk.
So we worked and worked and worked with the graphic designers to come up with a book design that would both aesthetically and structurally serve our purposes- what the typeface would be like, how the columns would be laid out. We separated the book into three sections. First there was the tutorial, which would take you step-by-step through an introduction to the product so you'd get a feel for what it's about. The middle section was a cookbook, where each two-page spread, magazine-like, would be about a single task, like how to change margins, or how to copy a disk.
It was originally designed with six columns, with substeps in the columns- the idea being, you'd open to the page, put the page on the desk, and without having to flip through the pages you'd follow the steps and you'd be done. The third section would be a more traditional reference section where we just kind of walked through the product, menu by menu, function by function, and would explain what everything looked like and everything did. There would be callouts on the side with a handy tip, or something you may need to know, or here's a warning.
It was somewhat derivative of the book design for Lisa and Apple II, though the cookbook section was novel, and the writing style was a lot chattier. We also got to spend a lot more money on photography and printing on our technical manuals, because- well, we worked for Steve. The expensive one was six-color process throughout.
For the less expensive ones he demanded that we do black-and-white duotones, rather than just split screen for the photographs. It was lavish, it was very, very nice. Nobody ever got to spend that much money on manuals, but Steve wanted the whole effect to be crisp and professional and very high-quality.
So the process of actual writing went fairly smoothly. Once we had the structure, we put together the tutorial, and then we tested it: we ran people through the tutorial over and over again, and just watched people do it, and saw where people got it and where they botched it. That was a traditional technique and it worked very well. The cookbooks, the hard part was figuring out what tasks people would want to do, and then cramming it into the grid. The reference section was traditional. So we worked with the graphic artists to get the book design, and we worked with the programmers to get the content right. 'MacPaint is Different' The one outlier was Bill Atkinson, who thought that MacPaint needed to be different.
Carol Kaehler had put together an alpha draft, a first draft, of the MacPaint manual, that was in our template: it had a longish tutorial, followed by a bunch of cookbook sections, and then it had a reference which led you through what the tools did, and what all the menu items were, step-by-step. Bill Atkinson thought that it was too big, too dry, too stupid, and too devoid of any kind of fun and exploration. We fought about it. I thought the books should be a suite, and they should have consistency, and continuity, and familiarity, and all the things we valued in the user interface.
If you looked for a cookbook section in one manual, you should find a cookbook section in every manual; all of the great Macintosh values, that you should be consistent wherever possible, and maintain the graphic look. But Bill's value was, MacPaint is different. And it was different: it took up the whole screen, you couldn't drag the window, you used the mouse in completely different ways.
He, out of the goodness of his own heart, he and Susan Kare- with a little help from Steve Capps and Rony Sebok and Andy Hertzfeld- and not much discouragement from Jerome Coonen- who knew how what they were doing would be received but just decided not to interfere- one night when they should have been coding, stayed up all night and wrote a MacPaint manual that was the way they wanted it to be written. And they presented it to Carol with this look in their eyes saying, 'We did this great thing for you: we saved you all this work by completely trashing everything you've spent the last 6 months on, and aren't you grateful for us helping you see the light on how your book should be written.' It was a challenging management moment. And because it was Bill Atkinson, after a couple long walks around the building and a couple of screaming fits with Steve, we just sat down and clenched our teeth and said, 'Thank you, that's wonderful, we'll print just what you've written.' And what came out what the MacPaint picture book. It delighted some and enraged others.
And several years later, they wrote a real manual for MacPaint, because they had to. Pang laughs So in the documentation process on Macintosh, we worked early and often with programmers, we started early on book design, and tried to keep a writing style that fit in with the whole character of the machine, and the character of the project as well: the sense of cohesiveness of the Macintosh team, and the fact that everybody got to work on and look at everybody else's process. Some of our best reviewers our books were people in Finance, who read our books voraciously. It was great having the Finance people review our books, and not for 'This is going to cost too much to print,' but 'I don't understand how you do this in the word processor,' because they were much more the target market than the programmers.
Contents. Macintosh Documentation.
Posted on by Please read my on product reviews. ThunderTape 2 is a brand-new LTO-6 tape drive announced this morning by 1 Beyond Digital Video Systems. It supports up to two LTO-6 drives in the same enclosure, which speeds and simplifies creating multiple backups at the same time. I’ve had the privilege of working with a prototype unit for the last week. If you are storing data on hard disks for the long-term, you WILL lose data. You need a Plan B.
But, up until now, Plan B was way too expensive. That situation has now changed – tape-based archiving is now affordable. I have long been a fan of using LTO tape for archiving media projects and have written for several years about the importance of using tape, rather than hard disks, for long-term archiving.
However, I’ve never actually owned an LTO drive because they were too expensive for my budget by thousands of dollars. This week two different companies each released a low-cost, Thunderbolt-based LTO-6 tape drive specifically designed for Macintosh media mavens. This review covers the new ThunderTape 2 unit from. In a, I write about the new mTape from. NOTE: Because I can’t be sure you will read both reviews, I have duplicated some of the LTO background material in both articles.
The product specific information is unique to each review. WHAT YOU NEED TO KNOW FIRST As someone who has not worked with LTO before, my immediate takeaway is that archiving is not about speed or storage capacity. It’s about workflow.
Everything we learned working with magnetic video tapes applies to working with LTO tapes. For backups and archiving to be successful, we need to:. Create backups on a consistent, regular schedule. Organize files before we archive them, don’t try to reorganize the tape itself. Properly store and track our tapes.
Properly track our files after they’ve been archived A tape drive may LOOK like a hard disk. But it isn’t a hard disk. It doesn’t operate like a hard disk. And you should not treat it like a hard disk.
It’s a tape unit and requires learning new skills. Use tapes for stuff you want to store for a long time or transfer somewhere else, not for files you need to access continuously. Storing files for the long-term is important.
FINDING the files you stored is even MORE important. Having the right hardware is one-half of the solution to archiving. The other half is tracking which files are stored on which tape. While 1 Beyond provides basic software in this regard, you should also plan to invest in additional software to supplement the software supplied with the ThunderTape unit. Also, up until now, tape drives have been so expensive, that only large organizations with established IT staffs could afford to purchase and install one. Now that prices are dropping, LTO systems are now affordable to people with no prior experience with tape.
And this can cause major problems, if you don’t know what to expect. In this review, I will discuss the tape drive hardware. Next week, I’ll review additional software you will need to make the most of an LTO-6 tape system. EXECUTIVE SUMMARY 1 Beyond began shipping LTO drives about four years ago and Thunderbolt drives in April, 2013.
The ThunderTape 2 is the latest iteration in their extensive tape product line. The ThunderTape 2, from 1 Beyond, is a rugged, LTO-6 tape drive designed for the small Macintosh workgroup or individual editor. Housed in an all-metal case, with a handy carrying handle, the Thundertape 2 has two bays that can be configured with 1 or 2 LTO drives, an internal hard disk or a RAID which can serve as a separate drive or staging area for files to be backed up. (The photo above is from the prototype. The shipping unit will have a machined aluminum front panel.) The ThunderTape 2 ships with all the software necessary to immediately start saving critical files to tape – though it will work even better with 3rd-party utilities, which are sold separately. It is quiet when powered on but not in use, reads and writes data around 150 MB/second (the speed of a single SATA hard drive), and holds about 2.5 TB of data per tape. It uses an LTO-6 drive from HP; one of the three founding partners of LTO technology.
NOTE: The process of shuttling tape is somewhat noisy. It is best done when you don’t need to concentrate on an audio mix or critical edits. Hardware setup requires two cords: power and Thunderbolt. However, 1 Beyond’s decision to locate the Thunderbolt port on the front of the unit may be awkward for some users, software installation is confusing, and loading a cartridge is unnecessarily complex. The system would benefit from a complete overhaul of their installation and operating software geared toward novice users. The price point is attractive, especially with the ability to add a second LTO tape drive for, essentially, the cost of the drive itself.
A second tape drive can be added after purchase either by the end-user or 1 Beyond. The ThunderTape 2 is a welcome addition to workgroups that need to turn out LTO backups on a frequent basis where time is of the essence, especially when someone in the workgroup is already familiar with how tape drives work. Unit: ThunderTape 2.
Manufacturer: 1 Beyond. Website:. MSRP: $3,895. Option: 4 TB SAS High-Performance Hard Drive – $495.00. Option: Second LTO-6 tape drive – $2,295.00. Warranty: 1-year factory warranty (extended warranty is available) LTO HISTORY LTO (Linear Tape Open) is a magnetic digital tape format designed for storing computer data, including media. It is administered by Ultrium LTO , who’s website states: “The LTO Program was formed in 1997 and three companies — HP, IBM and Quantum — jointly oversee the development and roadmap of LTO technology.
Providing open format specifications to simplify the complex array of tape storage options, LTO technology allows users to have multiple sources of product and media. The “open” nature of LTO technology also provides a means of enabling compatibility between different vendors’ offerings.” Ultrium has published a roadmap of the technology – – laying out plans, specifications and timing for current and future hardware technology.
There are currently only two manufacturers of LTO drives: HP and IBM (Quantum stopped manufacturing drives several years ago). Just like the hard drive industry, while there are only a few drive manufacturers there are lots of different vendors packaging those hard drives into different configurations for different purposes and industries. All current LTO drives use SAS as their connection protocol. SAS, on a Macintosh, requires a PCIe card in order to connect an LTO drive to the computer. The problem is that no currently shipping Mac supports PCIe plug-in cards. What 1 Beyond did was package an ATTO SAS card into the unit to provide a Thunderbolt to SAS bridge so that the drive can be attached via Thunderbolt to any currently-shipping Mac. LTO-6 is the current version of LTO.
This version supports recording about 2.5 TB of uncompressed data to a tape at about 150 MB/second. In practice, your total storage will be a bit less and actual data transfer speeds will vary. Unlike a hard disk, where speed is everything, when working with tape, we actually don’t care a whole lot. All LTO drives have separate read and write heads. During the write, the separate read heads are verifying that the file was written to the tape accurately.
If an error occurs, the error is sensed immediately and the file is rewritten to a different portion of the tape automatically. NOTE: LTO has the option to apply data compression to files when it records them.
However, since media files are already compressed, there is very little advantage – and no additional storage capacity – to using this compression during archiving. LTO tapes have a projected shelf life of about 20 years. While not as fragile as DigiBeta tapes, these are, after all, magnetic tapes storing irreplaceable data. Treat them with respect and avoid extremes of heat, humidity or dust. A key fact of the LTO roadmap that you need to know is that new versions arrive about every 18 months. These version changes affect both the hardware and the method of storing data on the tape. The current version – 6 – can read and write version 6 and version 5 tapes, but only read version 4.
This means that we need to factor into our plans upgrading LTO hardware every two to three generations which also requires copying existing tapes from the older generation to the newer generation of hardware. UNDERSTANDING LTFS LTFS (Linear Tape File System) was announced at NAB in April, 2010, and released shortly thereafter. What LTFS does is provide an interface to an LTO tape that:. Allows tapes formatted on drives from different manufacturers to read each other’s data. Allows you to drag and drop files onto a tape to store or retrieve files. Displays files using a standard Macintosh file window Traditionally, before LTFS, data written by a drive from one manufacturer could not be read on any other drive. LTFS seeks to fix that.
While this makes media management on tape similar to a hard disk, it is NOT the same. Everything on a tape takes time, because the tape needs to shuttle from wherever it is to wherever it needs to be. This shuttling is fast for a tape, but very, very slow compared to a hard drive. Creating a new folder, renaming a file, moving a file into a folder – each can take more than a minute; sometimes longer. In other words, LTFS makes file access easier than before, but you should never use a tape drive like a hard disk.
Tapes are for storing files that you can’t afford to lose, but don’t need to access very often or for making backups of your current files. Media that you need to constantly access should be kept on your hard drive. LTFS and the FINDER The Mac Finder is not LTFS-friendly. In fact, the Finder can’t “find” any files stored on an LTFS tape. Files stored on tape using LTFS do not show up in a Spotlight search.
You need to use some other method to find and catalog the files stored on your tapes. Trying to view files on a tape using QuickLook is an exercise in frustration.
The tape shuttled for five minutes without displaying anything, then I gave up. You can’t read and write files at the same time. You need to wait for one operation to be complete, before starting another. This is why queuing files and processing them in batches makes the most efficient use of your gear. NOTE: I’m also reviewing software from Imagine Products – PreRoll Post – and TOLIS Group – BRU – along with the 1 Beyond Copy Utility supplied by 1 Beyond to see how each can help with the process of managing and tracking files. More on those in future articles. If your computer goes to sleep with a tape loaded, it will take several minutes after you wake your computer before the tape finishes talking to itself and you can use your computer again.
In fact, it is STRONGLY encouraged that you never let your computer go to sleep when you are archiving to tape. NOTE: To avoid waiting for the tape drive to wake up after the computer goes to sleep, never leave a tape in the system when you are done archiving. HARDWARE DESCRIPTION The ThunderTape unit weighs about ten pounds. It’s roughly 8 inches wide, by 10 inches long, by 7 inches tall. It has a matte black metal case, a solid carrying handle, and a machined-aluminum front bezel. (The prototype unit I was sent had a plastic bezel, which is what you see in these photos.) Power connects in the rear and Thunderbolt connects in the front. The power switch is in the rear.
Here are some key bullet points about the unit:. LTO-6 tape drive with Thunderbolt connectivity. Thunderbolt certified by Apple & Intel. Compact, portable form-factor. Supports LTFS for drag and drop functionality.
2.5 TB native storage capacity per tape cartridge. Compatible with industry-leading backup and archiving software. Dual Thunderbolt ports enables daisy-chaining of Thunderbolt peripherals An LTO cartridge is 4 inches square and a little less than an inch thick. It feels very solid and is designed so that you can’t insert it incorrectly. A cartridge holds a maximum of 2.5 TB of data. To put that into perspective, that’s:.
3,500 CDs. 581 single-layer DVDs.
50 dual-layer Blu-ray Discs. 38 hours of ProRes 422 media An LTO-6 cartridge contains 846 meters of tape and the tape travels at up to 10 meters per second! INSTALLATION If the ThunderTape 2 has an Achilles heel, its installation. First and most important, do NOT read the HP Installation Instructions. These are written for someone with a graduate degree in Information Technology and assume a deep knowledge of Terminal and Unix shell commands. (Someone needs to explain to HP the concept of “consumer software.”) Instead, read the installation instructions that 1 Beyond ships with the unit.
Installing the system requires four different installations and they need to be performed in a specific order:. SAS Driver for the ATTO card. HP StoreOpen for LTFS and general utilities. 1 Beyond Copy Utility. Java RunTime Environment v1.6 (installed from within the 1 Beyond Utility) Don’t skip reading these installation instructions. It will save you a lot of grief. Also, I discovered that HP tape drive hardware will not work with IBM tape drive hardware when both HP and IBM software are installed on the same Mac.
This means that you can not mix and match tape drive manufacturers, if you want to add more than one tape drive to your system. Since multiple tape drives are one of the benefits of the new ThunderTape 2, it is critical that you make sure the drive manufacturers match. NOTE: Tape cartridges formatted for LTFS are interchangeable between different drives. OPERATION Getting a tape ready is a multi-step process that revolves around HP StoreOpen software, which is provided by 1 Beyond and installed as part of the ThunderTape 2 installation. Before starting the software be sure to turn the tape drive on and insert a cartridge. (The drive will automatically pull the cartridge into the drive as you insert it.) Launch HP StoreOpen and click the Start tab.
From the lower menu, select the tape drive you want to use. Most of us will only have one drive, so this is an easy choice. Then, click the Use This button. NOTE: You know you’ve done this correctly when the tape drive is displayed in the top text box.
Click the Prepare Cartridge tab, then, click Load under Physical control. This threads the tape from the cartridge into the unit. If this is a new tape, click the Format button under Logical Control to create an LTFS-formatted tape. Formatting a cartridge took about one minute.
NOTE: Formatting erases all data on a tape. Once a tape is formatted, you don’t need to format it again. Next, click the Mount Volume tab, then click Mount. This tells the Finder to display the tape on the Desktop.
The software will remind you to be SURE to turn sleep off on your Mac – disabling sleep is a REALLY good idea!! Click OK, then, after a few seconds of humming, the tape appears on the desktop. For this review, I’m using a unit that has both an LTO-drive and 4 TB hard disk installed in the same unit. Once the drive appears on your desktop, you can quit the HP StoreOpen software. NOTE: You must eject a tape from the Desktop, similar to removing a hard disk from the Desktop. Although you can do this using the HP StoreOpen software, the easiest method is to highlight the tape icon on the Desktop and type Cmd+E.
THOUGHTS ON THE 4 TB HARD DRIVE An LTO tape drive can not be shared over a network, it must be directly attached to a computer. Because of this, 1 Beyond provides the option to add a 4 TB hard drive to the system.
Rony Sebok, product marketing manager for 1 Beyond, explains: The reason we made the 4 TB drive option available is that it’s well-matched from a speed and size standpoint with the LTO-6 drive and it expands the customer’s storage at little additional cost. You can read the 4TB storage at 160 MB/sec which is the same speed you can write an LTO-6 tape. So, copying to LTO-6 from this drive will give optimal performance for backup/archive jobs — and you can store more than a tape’s worth of data on the drive. However, you won’t get optimal archive speeds if you’re also actively working off the drive at the same time. Tape archive jobs hog the system, so you really don’t want to be editing while archiving.
(This is actually why a lot of Mac houses still purchase our stand-alone LTO NetDrive box. That has the computer and tape drive all built into the same system, so you don’t have to connect it to a Macintosh and tie up the Mac for archiving while you also want to use it for editing.) The workflow I see with the ThunderTape 2 with 4 TB drive connected to the Mac is that you could work off the drive during the day and let archive jobs run at night. If you want to have redundancy (as everyone should) of their video data, you can offload your camera data to hard drive and tape simultaneously and then just work off the 4 TB drive knowing that your data is securely on tape. For small workgroups (eg.
3-5 editors on a network) who either work on local storage or shared storage, each editor/graphic designer may generate material that needs to be archived. While they could share a ThunderTape 2 by disconnecting from one system and connecting to another, this doesn’t make sense if they want some central organization of what’s on what tape. Our solution: share a folder on the 4TB drive in ThunderTape 2. Anyone who has something to archive to tape can copy it to the 4TB drive and at any time during the day. The editor on that system shouldn’t be affected by this if he/she is working off other storage.
In the evening, initiate the copy-to-tape of all the data on the 4TB drive marked for archive to tape (using PreRoll Post or whatever copy/database tools the company chooses). Even in an environment with shared storage, if certain assets need to be marked for archive, it’s usually easiest to move/copy them into a different folder.
Rather than take up more space on the SAN, these files can be copied to the ThunderTape 4TB and archived to tape from there. ADDITIONAL SOFTWARE When it comes to operation, I need to be clear: LTFS and the HP StoreOpen utility allow you to mount the drive on the desktop, format a tape and copy files to and from the drive with no problem. However, you won’t be happy using this system that way for very long – because while LTFS allows you to see your files, it does not keep a record of what files are on what tape.
For that, you will need to use other software. This “other software” falls into four groups:. Simple spreadsheets, using Excel or Numbers. Backup software, such as Carbon Copy Cloner or the 1 Beyond Copy Utility. Archiving software, such as Imagine Software’s PreRoll Post or the TOLIS Group’s BRU. Media Asset Management software, such as AXLE, CatDV, Cantemo Portal and others Understanding this relationship between tape hardware and software took me a few days.
The issue of which software to use with LTO tape is surprisingly complex; there are many choices with many options. I’ll be writing more on this next week. A very nice feature, made possible by LTFS, is that I formatted an LTO tape using the 1 Beyond unit which uses an HP drive and HP software. That tape loaded perfectly into the mTape unit and I was able to display all the files on it and copy a file from that HP-formatted tape to my hard disk using the IBM drive in the mTape unit.
However, I could not have both tape systems turned on and accessible at the same time. PERFORMANCE For those of us accustomed to the speed of a hard disk, tape is not fast:. Formatting an LTO-6 tape took one minute. Mounting a tape using HP StoreOpen, measured from inserting the cartridge until it appeared on the Desktop, took one minute and ten seconds. Copying 17 GB of media to the tape using LTFS took three minutes, PLUS another five minutes and 20 seconds for the tape to stop shuttling and return control back to the Finder. Ejecting a tape took 30 seconds. Rony Sebok suggests it can take up to five hours to fill a 2.5 TB tape.
Most of the time, backups and archives are best done overnight, when speed is not important. The key fact to keep in mind is that a tape drive may appear on the Desktop like a hard disk, but it operates very differently. Rony Sebok writes: “You’ll find, in your testing, that you’ll see faster copy speeds to tape when:.
The larger the file, the faster the copy; lots of little files will copy more slowly than a single large file. The faster the source drive, the faster the copy. Tape drives adjust to the speed of the source since they don’t like to speed up and slow down. (Larry adds: This is why using a RAID, or the optional 4 TB drive will help.). Data will copy faster if your source drive is consistently faster than the capability of the tape drive.
If you double-click on a tape with bunch of files using the Finder, you’ll have to wait a long time to see what’s there. Instead.install the 1 Beyond Utility and open it. Larry adds: With this beta release, I was not able to get the 1 Beyond Copy Utility to work. I’ll write about it next week when I can get the released version. While reading or writing to tape is not tracked using Activity Monitor, the speed of reading or writing to the hard disk is. Using Activity Monitor to measure data rates off the hard disk, I was seeing transfer speeds from 125 – 180 MB/second. This is as fast, or slightly faster, than a single SATA hard drive and totally acceptable performance.
The only downside is that the first time you archive files, there is SO MUCH data that needs to be transferred that archiving can take a long time. This is not the fault of the drive, but simply the fault that, as editors, we generate a ton of media. A CONVERSATION WITH 1 BEYOND One thing I’ve learned is that the folks at 1 Beyond LOVE talking about their products.
I have truly benefitted from a series of emails from both Rony Sebok and Terry Cullen, the CEO of 1 Beyond. I sent them several questions and Rony Sebok, their product marketing manager, sent the following responses: Larry: LTO drives are made by one of three manufacturers: HP, IBM, and Quantum. Since the LTO mechanism is at the heart of any archive system, should the end-user be concerned about which mechanism is used?
Rony: We’ve worked with both HP and IBM drives in both Mac and PC environments. They are both quality drives.
For a while we based our choice on which tape drive manufacturer had LTFS drivers for the OS version we were on (for example, for a while, IBM didn’t have LTFS drivers for Mac, but now they do) and which software utilities they have (IBM’s LTFS Tools offer some command line options we use in our EzPrep software and Discovery Compliance Checking software that HP did not have until a month ago.) HP has a nicer GUI for formatting and loading tapes, right now, in the Mac environment than IBM has – so we’re shipping more HP drives with our Mac LTO products. But, the bottom line (and short answer is): based on our experience to date I wouldn’t recommend one manufacturer over another. Larry: Since none of these manufacturers make native Thunderbolt LTO drives, is there a performance trade-off when converting the native SAS connection of LTO systems to Thunderbolt; and should editors be concerned about this? In our experience (at least with the hardware we build) we don’t see a performance difference between an LTO-6 drive that is connected to a SAS card in a PCI slot on a motherboard, vs the “converted SAS to Thunderbolt” Good performance of LTO-6 drives is 160 MB/sec read/write and we’re seeing that on our ThunderTape 2. (I’m guessing this is because 160 MB/sec is way below the 20 gbps technical throughput of Thunderbolt.) Larry: What maintenance is required, if any, for these units? Rony: LTO drives will tell you when they need cleaning.
So, there is no regular maintenance required. When the drive, during its normal operation, detects that it needs cleaning, it will alert you to this (with a “C” on the IBM’s single character display and with a light under “cleaning” on the HP drive).
It’s very simple. You can complete the copy you’re doing and then eject the tape and insert a cleaning cartridge. The drive will automatically detect that a cleaning cartridge has been inserted and will run its cleaning operation and then eject the cleaning tape. A cleaning tape is good for 50 cleanings and, even under heavy use, our customers are not seeing the need to clean more than once a month (more typical is once every 3 months — it depends on the level of usage on the drive). So one cleaning tape should last a customer several years. Larry: Does it make a difference which brand of LTO tape is used?
If so, do you have preferred brands? Rony: We recommend IBM, HP, Sony, or Fuji tape. Early on, Maxell tape was a bit rough/course and was wearing down tape heads. They may have improved since, but we’re guiding people to the brands I listed. Larry: What happens if the power dies in the middle of writing a tape?
Rony: Tape is no different from hard drives in this case. Assuming you are working with LTFS, if you’re lucky when the power died, and you weren’t actually writing anything to tape and it was more than 5 minutes since you did, so that the updated index got written to tape, then you’ll be fine. But I don’t recommend this!!!! When you reboot, the tape drive will go through mid-tape recovery (since it didn’t have a chance to rewind properly) and will probably be OK. But, more likely, you’ll find that it is “corrupt” (the file index wasn’t properly updated or only a partial file was written).
In this case you can run “Check Tape” (like chkdsk for disks) and the system will read the entire tape contents trying to rebuild the file index. This is a lengthy process (it has to read the whole tape) and there’s no guarantee all the data will be visible. So, it’s recommended to safely eject the tape before shutting down a system. The consolation is that tape is usually a backup or archive.
What this means is that you have the data somewhere, and you’re copying it to tape. So, if the tape becomes corrupt, you still have the data on the hard drive. If you’re READING from the tape (so you archived data a while back, and now you wish to retrieve it), the power outage does not have the same risk since you weren’t writing to the tape at the time, just reading from it. Nevertheless, we always recommend making two tape copies (or having two copies: one hard drive, one tape) at all times. Larry: There is a lot of debate in the industry about whether LTFS replaces archiving software. Does your drive require archiving software (such as BRU or PreRoll Post) in order to function.
If not, where can editors download the LTFS software needed for your drive? Rony: The simple answer is: NO, you do NOT need archiving software to archive to tape. That is EXACTLY what LTFS brings to the party. It’s a universal file system for tape.
It enables you to copy files to tape and read files from tape within the three major operating systems (Mac/OSX, PC/Windows, Linux) using native OS commands. No other software is required (LTFS drivers must be installed for the operating system). This is not true of other, older Tape Formatting: TAR, BRU, CPIO, PAX (check me on the last few, but I’m pretty certain its true for those, also). To read the data off a TAR tape, for example, you first need to know things that are not on the tape (there is data, external to the tape, that you need to know in order to give the proper instruction to read the contents of the tape) and you need special software to copy the files off — you can’t use the Operating Systems’s native copy command. With an LTFS formatted tape, on the other hand, the tape is “self-describing”, meaning all the info needed to know what files are on the tape and where they are on the tape is on the tape (a file index on the index partition).
And, with LTFS drivers installed (available for all operating systems: PC, Mac, Linux) you can use the standard, native Operating System commands to view the file listing, copy, rename, delete, etc files on the tape. What this also means, is that ANY software (not necessarily the software that wrote the data to the tape) that uses OS commands/subroutines to create files, rename files, browse the index, open files, etc, can interact with data on the tape and work with it. You are not limited to using the OS (Explorer or Finder) – you can use any program that knows how to talk to a disk. This includes backup software, asset management software — it opens the field. What this really enables is the use of tape as a medium of exchange in addition to a medium for internal archive within an organization. Now, if you need to share data with someone else, rather than ship a hard drive (which is not rugged) you can ship the files on tape.
They can read the data WITHOUT ANY PARTICULAR/PROPRIETARY archive/retrieval software. They can just browse and read it on their Mac, PC, or Linux box. Now, although you don’t need special software to archive to tape, you may choose to augment the copy routines in your OS with asset management software to keep track of what’s on what tape or fancy checksum copies for on-site DIT work. It’s your choice. And, you can mix and match. So, your asset management software need not be the software you used to archive the files in the first place. The asset management software can read the file index straight from the tape!
It doesn’t have to have created the tape. And, the tape you created in the field can be brought in and added to your robotic Tape Library, or vice versa. In fact, if your Tape Library, like 1 Beyond’s EzStor, is also PURE LTFS, you can remove a tape from the library and give it to anyone — they can read the data on it without the benefit of the Library system’s external index.
This is BIG!!!!!!) Larry: Why should an editor consider your product versus the competition? Hi, Larry, I am grateful for the articles on the LTO drives. I didn’t know much about this technology, but I wondered about whether a tape backup system would ever make sense for a small-scale operation like mine. Your article gave me a much greater base of information and understanding, and helped me verify that tape doesn’t make sense for me, in the current generation of equipment. In fact, I’m wondering how many businesses would truly find this a useful and cost effective approach.
In the spirit of friendly debate, I’d like to offer my reasoning. I disagree with your statement, “If you are storing data on hard disks for the long-term, you WILL lose data.” That’s too simple and absolute, and the same statement could be made about LTO-6 or any other data storage medium. While every hard disk will eventually fail, this does not mean that a given prudent user will lose data. Let’s take the well-documented example of Backblaze.com, who is very open about their hard drive experiences. They say that they have lost thousands of hard disks over the years, and have never lost a single bit of customer data. For a video editor, RAID, Drobo, and other kinds of redundancy can reduce the risk of hard disk data loss to a level superior to LTO tape.
So what can we say about the risk of data loss for hard disks, compared to LTO tape? Because of the tremendous number of hard drives in use, we know a great deal about their failure rate in various user scenarios, and we can plan for it. In contrast, we know next to nothing statistically about the reliability of LTO-6 tape in the less-than-optimum environment of the small video editing shop. This is a new version of the tape format, and new hardware. But let’s suppose that we can extrapolate from earlier versions of LTO. The site linked below has a nice chart on LTO tape life, at two common usage levels.
Assuming daily use, they estimate a 17 month lifespan. Assuming weekly use, they calculate a 4 year lifespan. Other sites give similar estimates. It’s fine to say that a tape will last 30 years, stored in the optimum climate-controlled vault. However, that assertion will never be tested, because the drive mechanisms change so quickly.
The LTO specification requires that each new LTO generation be able to read the format of two generations back. Over the history of LTO-1 to LTO-6, this has worked out to a fairly short obsolescence cycle. If you bought a new tape drive right when each new generation was released, drives able to read the tapes you created would disappear from the market at roughly the seven-year mark.
While used drives might be found for longer, a reliable archiving strategy shouldn’t depend on eBay for drive purchases. How about costs? You list the cost of the ThunderTape 2 at $3,895. Your listed options add another $2800 to that, without adding in the third-party software that you recommend. But let’s start with the MSRP. For the sake of argument, let’s suppose that some small video editor could get by with a total of 6 LTO-6 tapes, to cover their data archiving.
I’m calculating that this gives us a minimalist 7.5 TB of data (three tapes), and two sets of tapes, for off-site rotation. The drive and five additional tapes would cost about $4050.
How does this compare with hard disk costs? I’ve seen HGST 4 TB drives on sale for $119 in the last month, and prices continue to drop. Two drives would give us 8 TB of data storage, but let’s calculate on the basis of 4 separate drives, to give us RAID redundancy. That means that $476 would give us a bit more hard disk data capacity than the LTO-6 scenario above, and probably greater longevity and reliability. This would mean that I could buy 8.5 hard disk RAID sets, for the cost of the LTO-6 setup. Now I haven’t included the RAID enclosure cost, nor options other than free RAID software. But I could double the hard drive RAID cost, and double it again to rotate a RAID set into off-site storage, and still spend less than half the cost of the LTO-6 option.
Given the pace of change in hardware and standards, I’d much rather work with cheap, replaceable hard disks than lock myself into an expensive and short-lived standard like LTO-6. It’s far easier, and financially far more prudent, to spend a few hundred dollars on additional hard drives, from time to time, than to lock up $4,000 in a technology that has a long time to the break-even point. The two-year warranty on the $4,000 drive makes me a bit nervous, too.
It would seem like the cost picture becomes more favorable for LTO-6 as the amount of archived data increases, but I’m not sure how true impression is. LTO-6 tapes cost about $20/TB, while hard disks are currently at $30/TB. That favors the LTO-6, but as you move to higher count RAID arrays, excellent redundancy can be had with fewer disks.
If your business is archiving 20 or 30 TB, it still looks to me like the hard disk solution has the edge. Above that, with any storage technology, data management is moving toward a full-time job. I’m not sure how many terabytes of archived data I would need to make the LTO-6 look cheaper than hard disks. The slowness of the tape drives becomes ever more important as you increase the size of the archived data set. When you factor in the lack of real random access, and the workflow issues of having to maintain a separate index/contents list for what is on each tape, I’m not seeing where this ever becomes cost effective.
Larry’s article quotes Rony Sebok as saying it can take up to five hours to fill a 2.5 TB tape. If you can easily cue up all the data to fill the disk, then letting it run overnight is not a problem. But if your workflow is backing up tens to hundreds of gigabytes on a varying schedule, then the limitations of the LTO technology might be more concerning. I’ve thought of one scenario where the LTO-6 might fit well into a workflow. If your average project produces something like 1-2.5 TB data needing to be archived, then archiving one project per each LTO-6 tape might make sense. This would minimize the record keeping, and it would be easy to build into the project cost the $100 cost of archiving two copies of the project data onto two different tapes. If you do enough projects of this size to cover the capital investment in the drive, this could be a slick way to go.
Rony Sebok Expansion System For Mac And Windows
Larry asks, “What happens if the power dies in the middle of writing a tape?” Rony replies, “Tape is no different from hard drives in this case.” But the rest of his answer suggests important differences to me. Given the substantially longer time needed to copy data to tape, the chance that a power glitch would happen during writing is significantly higher for tape than for a hard disk. But more significant is that due to the technology, writing to tape is likely to be a cued batch process involving very large volumes of data, while copying to disk is more likely to be done in smaller chunks. If I understand Rony’s reply, it sounds like a error can corrupt the entire tape, including information that was written in previous sessions. In my experience, glitches during a hard disk write can usually be recovered, with the possible exception of the file currently being written at the time of the problem.
Rony Sebok 1 Beyond Inc
Perhaps with a proper UPS, this problem is not a serious concern, but I was not reassured to read that corrupting the entire tape was a possibility on errors. Once again, I thank you Larry, for the information that you provided me in your articles, and for the opportunity to present my viewpoint and calculations. Best wishes, Derek. Derek, Your analysis of a power failure is only partially correct. If the tape format being used is LTFS, you can be put into a situation that the mounted tape will no longer be recoverable. Because an LTFS write operation must update the index information periodically, a failure could (and often does) make the resulting tape unaccessible – even to the point of losing data that was previously written onto the tape completely.
On the other hand, when tape is used properly (as tape), the loss of power during a write operation should only affect the data being written at that point. As an example, when using our BRU format and writing 500GBs of data to a tape that already had 800GB of data written and losing power 300GB into the second set of data, you would still be able to fully restore data from the original 800GB and even restore data from the appended data set up to the point where power was lost. Therefore, losing power on a tape is NOT the same as losing it on a disk unless you are using the LTFS format.
One additional note – the ISC article that you point to is simply wrong on many points. The main one being the “sensitivity” of LTO media. As many folks who’ve met me at various trade shows will attest, I treat tapes like playing cards.
We transport them without their cases and in simple cardboard boxes. To demonstrate the sturdiness, we also toss them back and forth across the trade show aisles, drop them onto the concrete floor and then restore the data on them with no issues. The comments about humidity and temperature are also misleading. The only true temperature consideration is that the drive and the tape are at consistent ambient temps when used together. In other words, if the tape just arrive via courier and is still hot from their truck, let it sit for a while until it cools to your current ambient room temperature before you put it into your tape drive. Do I recommend that type of treatment?
Absolutely not. My point is to simply demonstrate that tape media is much more robust than any disk type. The discussion that implies obsolescence issues is also misleading. We can sell you a brand new HP LTO2 tape drive today (Ibelieve IBM still offers them, as well) that will still read and write LTO1 tapes.
Just because a new format has been produced doesn’t mean that the companies are dropping support for the prior drive levels. And finally – high levels of light? They are kidding, right? The cartridge is completely closed and the transport path in the drive is not exposed to any extraneous light. Plus, the mylar and glue used in modern LTO tape media is far, far, far removed from the stuff used to make 3/4″ tape in the 50’s and 60’s Hopefully, you’ll read this and decide to look further for more information that is correct.