Bryson Jones
Forum Replies Created
-
This depends on the file type and data size, obviously.
I have used commercial services for proxy sync before in small shops but it can obviously get expensive. (Tip: SugarSync lets you specify any folder to sync, unlike Dropbox and you can do a terrabyte for $550 per year.)
If it’s got to be big and enterprise ready, check out StorageDNA. We talk about their LTO here but they do WAN sync and it’s rock solid and also accelerated (think like a constant super fast Aspera sync.)
https://www.storagedna.com/solutions/wan_synchronization/
There’s a client here in LA getting their XDCAM dailies from Nova Scotia over the internet. Several hundred gigs a day. I didn’t believe it until I saw it.
bryson
bryson “at” northshoreautomation.com
northshoreautomation.com
-
I’ve not see that one either, as I said.
Scott, we generally base it on “can the user perform their work?” It’s really not a supported config per se, in my mind, but we find that it works for moderate use. The NY to LA folks are just sending 100 clips a day or so to the db and performing mild searches so it works out fine.
We’ve had another NY to LA client who’s run for like 2 years and the NYC guy has never even called for support. Note that both of these are a single user outside the LAN and not doing lots of work.
bryson
bryson “at” northshoreautomation.com
northshoreautomation.com
-
Simple fixes here.
1 – Get a good dealer/integrator to set up your system and train you.
2 – Don’t scan 1073 directories at once. That’s simply not how the app works. (Try dragging 1073 directories into your NLE at one time and report the results.)
3 – Search this forum for Catalog size and out of memory errors.
bryson
bryson “at” northshoreautomation.com
northshoreautomation.com
-
Well said Rolf.
Fred, you can get more info on the variables by clicking “Help” in the Watch Action editor and then the “Fields” button. That gives you the syntax for meta fields. You can hover over them in the CatDV Catalog to find out the ID.
Remember that scripting outside apps and the shell is a grey area. Squarebox doesn’t make EXIF Tool and can’t really control how your system is set up so it’s a dicey thing to support over a forum.
Extensive testing and solid backups are key. We always maintain a development environment for setting up and testing scripts so that no live data is harmed by a misplaced character in a command.
bryson
bryson “at” northshoreautomation.com
northshoreautomation.com
-
Man, we haven’t seen that over here but we just rolled out a system that’s running between NY and LA that’s got a user and a worker node connecting between the two over a WAN.
The user hasn’t been doing much so I’m not sure how the client is rolling, but the Worker has been online ingesting clips in NY and making and sending proxy to LA for a few weeks with no stale sessions.
Keep us posted on this but can you let us know what the pipe speed is like?
Is it a dedicated line or over the internet (more open?) And are they on the same provider or different ISP?
I think these guys are on 100Mb on the same provider but we have people down as low as 20-30 Mb.
bryson
bryson “at” northshoreautomation.com
northshoreautomation.com
-
Thanks Scott, let’s clarify a few things for the folks who may not read all the way back in the thread.
This deletes ALL the thumbs for all clips in your database. (Am I correct here?)
That means that if you have assets in an archive and not online, you’ll need to restore all of them (perhaps not possible/feasible for some folks) in order to recreate the thumbs for those assets.
Also, I’d not only have a backup, but a very clear understanding of the restore process ready to go before performing this action if you have a system in production.
bryson
bryson “at” northshoreautomation.com
northshoreautomation.com
-
I believe imagemagick should be able to do this for you.
Have fun, and keep us posted on your progress!
bryson
bryson “at” northshoreautomation.com
northshoreautomation.com
-
Hey there,
Yes, thumbs load no matter what and so limiting them (how many do you really need per clip anyway?) is a good idea. You can set CatDV to just take a couple and then add them later if you need more. Default extraction should be low.
We have many clients nearing 1,000,000 assets and one that’s over 3 million. (They are having speed challenges with a “regular” server and MySQL and we are working on tweaks now.)
Squarebox recommends that you move to MS SQL if you are going to run a db in the millions of assets.
One note, North Shore is evaluating MariaDB currently and are seeing 25 to 30% speed increases on the same hardware over MySQL. It’s not currently officially supported and there is no compiled version for OS X so it’s a challenging install. But if the tests prove solid it may become a supported db for CatDV.
We are working on hardware configs for deployments larger than 1,000,000 assets and know that each version of CatDV Server gets faster and more efficient. (Imagine that from a software company!) So I’d expect CatDV to grow along with its clients very well.
Note that most other DAM/MAM products in this price range top out far below this number. Axle currently supports 300k and Cantemo Portal’s base license is for 300k with a license option to expand to 1 million before you must move to the enterprise product.
I’ll be discussing some of this at NAB in sessions on the floor, as how you choose to use a DAM and your archive system can really impact your database size.
All assets are not created equal. 😉
bryson
bryson “at” northshoreautomation.com
northshoreautomation.com
-
You didn’t mention the clip count in your db. How many do you have in there? That’s a big part of performance in CatDV db’s.
One other way to check that something’s not amiss is to search on a copy of CatDV local to the server, to eliminate any chance that your network is causing issues.
bryson
bryson “at” northshoreautomation.com
northshoreautomation.com
-
We stay away from anything but hardware beef ups. CatDV does it’s setup upon install and we mostly leave it alone. As it’s annoying to call support for anything and find out that you’re out of spec, or in an unsupported config.
That said, if you’re a solid sys admin and for some reason can’t run stock, I’m sure there are things you could do.
Is there something you’re looking for in specific? North Shore is testing MariaDB currently for our larger installs but we’ve run MySQL unaltered for years now.
bryson
bryson “at” northshoreautomation.com
northshoreautomation.com