Creative Communities of the World Forums

The peer to peer support community for media production professionals.

Activity Forums Storage & Archiving HP StoreOpen LTFS

  • HP StoreOpen LTFS

    Posted by Bob Cole on February 7, 2013 at 11:05 pm

    From HP’s website, describing HP StoreOpen with LTFS:

    “Linear Tape File System (LTFS) is an open format for storing data on tape that makes LTO-5 and 6 tapes self-describing and file-based.”

    This sounds great, but I’m sure there are aspects to this that I don’t know enough about even to ask the right questions.

    We have all the “ordinary” needs of a normal business (backing up our system drives, accounting and document information), but we also have massive amounts of video data. In addition, we need both to back up current work, and also to archive completed projects. The latter, it seems to me, is where the LTFS system would be wonderful.

    Considering that the video post-production environment (esp. with today’s tapeless video) is very different from the average business in terms of its data flow, what are the pros and cons of LTFS? And, is there anything special about HP StoreOpen as opposed to other flavors of LTFS?

    Please forgive my ignorance and decrease it a bit. Thanks!

    Bob C

    David Roth weiss replied 10 years, 3 months ago 6 Members · 16 Replies
  • 16 Replies
  • Tim Jones

    February 7, 2013 at 11:25 pm

    Of course, this is a bit slanted by our stand on the recoverability of all things written to tape, but for more depth on the subject, you can start here:

    https://knowledgebase.tolisgroup.com/?View=entry&EntryID=263

    Tim

    Tim

    Tim Jones
    CTO – TOLIS Group, Inc.
    https://www.productionbackup.com
    BRU … because it’s the RESTORE that matters!

  • Kevin Francis

    February 8, 2013 at 3:26 am

    Hi Bob,

    Not sure if you are Mac or PC. We’ve been using BRU PE for a couple of years and for the most part it works. Helps to have knowledge of Terminal commands because you will definitely need it from time to time to restore a tape or for other functions. Their support is good but not fast- if you have an urgent issue you’re pretty much out of luck. The interface has quirks and bugs that usually get addressed eventually but sometimes get broken again on a new update. When your archive library starts to get big, it takes a long time for the app to boot up as it reads all the archive data. If I had it to do all over again, I would have invested a little extra in one of the Cache-A appliances and saved myself a lot of time and headaches.

    Using LTFS from the Finder in Mac isn’t ideal, but it is an up and coming standard which nearly every vendor supports at this point, even BRU. But since you probably read the article Tim mentioned above, you know all about the idiosyncrasies of LTFS.

    Hope that helps.

    Kevin

  • Bob Cole

    February 8, 2013 at 4:44 pm

    [Kevin Francis] “Their support is good but not fast- if you have an urgent issue you’re pretty much out of luck. “

    Well, you’ve hit the nail on the head. Few of us have our own IT Department – we’re “it” so to speak. So, finding a solution with outstanding support is of paramount importance. That’s why I bought a CalDigit – at the time anyway, it seemed the best at support. And that is also why so many of us have bought AJA products. I would love to see a ranking of how well various companies “back up” their backup solutions.

    Thanks for the warning about needing to learn Terminal commands. I’d just as soon spend that time getting better at After Effects. If I can avoid Terminal, I’d like to try to do that!

    Thanks too, to Tim, for the very helpful white paper. The premise about support for LTFS is valid. (It reminds me of the classic investment advice: “Put ALL of your eggs in one basket – and watch that basket like a hawk.”) One of the big arguments in favor of LTFS is that an open standard does not depend on any one company’s support; but perhaps it is not such a bad idea to have one company solidly behind a product (unless that company goes belly-up, leaving you without support). I would place very low confidence on getting any support from HP. When I’ve succeeded in reaching the right person at HP, they’ve been excellent; but getting to that person has been problematic.

    BRU PE looks pretty impressive, but it may be academic for me, as BRU PE is Mac only (right?). I’m currently in a mixed environment, but am leaning toward PC, due to the relative performance of the Mac Pro. I already own Retrospect Professional, which has been okay, though I’ve never really attempted anything sophisticated with it.

    Bob C

  • Frank Gothmann

    February 9, 2013 at 6:07 pm

    Throwing in my 5 cents:
    Bru PE is a very reliable app, there are some minor oddities when you run it via the GUI but no deal breakers there. The biggest problem of Bru is that it’s Mac and Linux only.
    That’s also the main reason why we’ve been looking deeper into LTFS as we wanted a small, dedicated machine sitting in the machine room doing nothing but writing to and from tape which anyone, even without Terminal knowledge, can operate. We also wanted something that wasn’t tied to any specific backup software or platform. Now that HP has it LTFS libraries ready for windows we started doing all our backups on LTFS on a 300 dollar pc rather than going with a Macpro or a Mini with a 1.000 dollar TB breakout box.
    So far, we’re happy with LTFS. Again, it’s early days, there some quirks with HP’s implementation in it’s current 2.0 flavour, but nothing major so my suggestion would be to give it a try.

    ——
    “You also agree that you will not use these products for… the development, design, manufacture or production of nuclear, missiles, or chemical or biological weapons.”
    iTunes End User Licence Agreement

  • Bob Cole

    February 9, 2013 at 7:31 pm

    [Frank Gothmann] ” we started doing all our backups on LTFS on a 300 dollar pc rather than going with a Macpro or a Mini with a 1.000 dollar TB breakout box.”

    Interesting! How exactly did you set this up? I’ve seen this done as two-step process. Make one PC an LTO station (call it PC-LTO), write over the network to the PC-LTO’s hard drive, then let the PC-LTO write to its attached LTO at its leisure. Or, one-step: write over the network directly to the PC/LTO station. I assume that if you are using LTFS, you’re writing directly to the LTO over the network.

    Currently, we backup up individual computers separately, with a combination of external hard drives and LTO. I love the idea of using a single LTO tape station to make regular backups of all (five) computers on our network. I don’t want to have to think about backups, because if I have to think about it, then one day I won’t think about it, and that will be the day a critical hard drive fails.

    LTFS sounds very appealing, but I just wonder about the details. Tim’s white paper pointed out LTFS’s inability to span, for example.
    On this forum, some bright people have mentioned that there is a difference between backups and archives. I wonder whether proprietary software (BRU PE, ArchiWare, Retrospect??) might be better for everyday, system-wide backups (for disaster recovery), and LTFS might be better for archiving completed projects.

    Comments welcome! I need to replace our old LTO drive, and I want to set this up right, to carry us through the next several years.

    Thanks!

    Bob

  • Frank Gothmann

    February 9, 2013 at 9:44 pm

    Yes, we’re writing directly to LTO5 over the network. We have all our projects stored on Linux servers sharing out via 10GB Ethernet. The LTO PC simply hooks in via regular 1GB Ethernet.
    LTFS cannot span, that’s true, BRU can. However, with the arrival of LTO6 and the even greater capacity I am not sure if that’s really a big issue. I had to “span” only a couple of times and I did what you’d also do if you were to copy the files to a hard drive – ie. divide the files in two folder chunks and copy one after the other.
    Regarding system back-ups:
    LTFS is really like copying data to an external hard drive. Simple. If you want to back-up your systems for disaster recovery you want software for that.
    From what you have written, I’d consider the following: Install some dedicated hard drives for online availability according to your needs on the LTO-PC (I don’t know how big your business is but system back-ups are usually not that big in size), back-up your system drives with something like Acronis True Image (incremental or whatever you want/need). Have the LTO-PC write them to LTFS.
    If one of your systems need a fix you can simply restore from the Acronis images on the LTO-PC over network in a very short period of time. Since it’s hooked up to the network, you can access it from any machine in you facility. If something happens to the LTO-PC or the backed-up images or drives, you have the golden LTFS back-up on the shelve.
    Projects and video stuff you can write directly to LTFS. We don’t even have a monitor attached to it. We access it via remote desktop and simply copy the files from the source locations on the servers to the attached tape drive once a project is out of the door. Once a tape is full the next tape goes in.

    ——
    “You also agree that you will not use these products for… the development, design, manufacture or production of nuclear, missiles, or chemical or biological weapons.”
    iTunes End User Licence Agreement

  • Kiki Muchtar

    February 22, 2015 at 10:07 am

    Hi Frank,

    If I have to make a double copy of everything I want to archive, how can I do that smoothly and fast? Let’s say I have 2 PC-LTOs and 2 LTO drives. Can both PC-LTOs access the same storage to archive to LTOs at the same time? Is it maybe a mirror RAID network drive can be used for the purpose?

    Thanks,
    Kiki

  • Tim Jones

    February 22, 2015 at 4:16 pm

    Hi Kiki.

    This is what BRU PE’s “Doubler Mode” is specifically designed for. If you have 2 drives connected to the system, there will be a checkbox enabled on the QuickArchive mode settings panel that will write your selected data to two tapes at the same time.

    Tim

    Tim Jones
    CTO – TOLIS Group, Inc.
    https://www.tolisgroup.com
    BRU … because it’s the RESTORE that matters!

  • Kiki Muchtar

    February 22, 2015 at 5:07 pm

    Hi Tim, does that mean the process time is just as long as if you copy to one LTO tape?

  • Tim Jones

    February 22, 2015 at 5:27 pm

    Correct. The only slow down would occur if your disk drive(s) can’t supply the data fast enough.

    I recommend looking at BlackMagic’s Disk Speed Test tool to get an idea of how fast your disks are. If you can’t read 180MB/sec off of the disk, you’ll never be able to stream 1 LTO-6, let alone 2. A 4 disk, USB 3 Striped array using 7200RPM drives is capable of delivering the data fast enough to feed 2 LTO-6 drives. On the other hand, a mirrored, 2 drive USB solution isn’t.

    Remember, if your backup tool can’t read the data faster than the tape drive can write it (180MB/sec with BRU for example), then the backup application (BRU, LTFS, etc.) will spend most of its time waiting on the filesystem rather than writing to the tape.

    Tim

    Tim Jones
    CTO – TOLIS Group, Inc.
    https://www.tolisgroup.com
    BRU … because it’s the RESTORE that matters!

Page 1 of 2

We use anonymous cookies to give you the best experience we can.
Our Privacy policy | GDPR Policy