welcome to the Digital Delivery forum
Hey, Tim Wilson started this, so don't blame me.
I am finding that transmitting MPEG-2 files over the internet is wonderful, but slow. I had a file from Columbia in South America uploaded to an ftp server (in MPEG-4 Quicktime format), and the download time of a 176MB file was 40 minutes. My actual daily demand is 3 Gig files, not under 200MB files (but this was a test).
So, no matter what cool hardware you own, no matter what free, or paid service you suggest, is there a faster way to move 3Gig files (in MPEG-2 or MPEG-4) format over the internet ? Satellite service is not an option (too expensive).
I beg to differ.
Re: Following up re: digital delivery
I simply agreed. :-)
Associate Publisher, Editor-in-Chief
Creative COW Magazine
My Blog: "Is this thing on? Oh it's on!"
Don't forget to rate your favorite posts!
I seem to dimly recall there was a "speed send" system out there where your file was cut up into smaller pieces, and those pieces all fed simultaneously, to be reassembled at the other end. The internet is good at that kind of thing, packets are packets. But I think that presupposes you have enough bandwidth access and the hardware to handle the simultaneous reception of the files, and their integration at the reception end. And if you had that much hardware and capacity, then you probably didn't need the simultaneous multi-send strategy in the first place anyhow...
I am fascinated by AP Snapfeed, what they do is automatically scale the quality or the send time, according to what your priority is, speed or quality, and what's available to the system, from Inmarsat or fly-away VSAT satellite terminal, down to twisted copper POTS lines. If you absolutly need to get *something* out ASAP, it will send out a tiny, jumpy screen movie, but it send it in the time you allot to the system. The more time you have, the better the quality it offers you.
The part of Snapfeed I really like for news is that should the FTP get cut off at any point, the receiving location can still play whatever part of the file was sent right up to the break. With other FTP systems, you spend 30 minutes feeding it up, and if the feed gets interrupted in the last 10 seconds, the file on the receive side is unplayable.
the issue is not file size, the issue is the speed of delivery.
You can use YouSendIt for up to 2 Gig files - but even with that, it still takes a LONG TIME to download that file. Like I said, using an alternate method (which I will discuss in the Digital Delivery Cow forum), it took 40 minutes to download an under 200Meg file.
Bob, I just did a YSI test and downloaded a 50 meg file in 40 seconds. A second test on a 700 meg file I sent last week to an editor downloads for me in 11 minutes.
Something is clearly wrong on the receiver's end. If there's a bottleneck, I suspect it's not with YSI or anything you can control. If the receiver has supposedly superfast internet, suggest they speak with their IT network engineer. I bet money there's a speed cap placed on each hub on their network. This happens with Discovery and there's nothing we can do about it.
YSI is fast man. Much faster than 40 minutes for 200 megs when you don't have IT guys screwing with speeds.
I think I mentioned this before, but DMG Chopper will break up larger than 2 gig files and rebuild them on the other end once everything is downloaded. It's a nice way to get around that 2 gig limit, and it's free and easy.
please excuse my ignorance, but what is YSI ?
YSI = You Send It.
Like has been said its not a problem with YSI, the problem is the person downloading it has a poor internet connection.
Internet providers limit the how fast you can download things. Many times internet providers have different levels of service that you can pay for, so often you can pay more to have a faster connection.
**Hindsight is always 1080p**
And what has been your experience with 2 Gig files with YSI ?
How long is the transfer (not with a T1 or faster line) ?
Mileage will vary of course, but we use YSI quite a bit, and find it to download rather significantly faster than FTP. Certainly easier to manage for folks on the other end of what you send. They click a secure link in an email, and save the file wherever they want to.
Not that you won't have to get them on the phone and walk them through figuring out where they saved the dang file.
The 2GB limit can be a pain for sure, but boy howdy, is it easy to use.
I wonder if there is a way to harness the technology used in torrenting files for our special purposes? Probably create more security issue than it is worth, I guess.
If a 700 meg file with YSI (you send it) comes in at 11 minutes, a two gig file comes in at about 25 minutes. This is on regular old Time Warner / road runner southern california internet.
Here are some handy questions for slow receivers to troubleshoot their download speed if you send a file.
1. Are you on DSL? DSL is the worst.
2. Do you use comcast and pay for super fast speed? Well, Comcast in your area might be throttling specific sites like 'you send it' (Google 'net neutrality').
3. Are you using a wireless internet connection on the computer you're downloading? Try using an ethernet connection to the router/modem rather than wireless. It can make a HUGE difference.
4. What speed results does 'speedtest.net' give you? It will help identify slow connections quickly.
5. Are you on a mac and most of your IT guys are pc people? PC IT guys are notorious for handicapping macs - because they can't admit they have no idea what they're doing.
Most FTP hosts (like host gator, etc) can almost hit 1 meg per second on a download, but since those systems are feeding multiple sites off of one or two servers, they will rarely go faster than that (most go much slower actually - in the 100kbps - 600kpbs range). With YSI I'm hitting 1.3 mbps consistently. I believe my nephew in Bucheon, SKorea had 80mbps download speeds and was able to go even faster than 1.3. I'd be interested in seeing what speeds you guys get on your downloads.
Many networks I've worked with have their own internal ftp. One network has a fantastic one. Downloads came off their server ridiculously fast, and uploads fully maximized my upload bandwidth. Large files didn't have a limit on size. Another network's is throttled to a specific speed and if you go over 1 gig in file size, the upload will drop. Their internet speeds internally are also slower, so when I send a YSI file, it takes nearly an hour for them to download a 1 gig file.
There's not going to be a perfect system unfortunately. I like You Send It because it's fast and easy. Net Neutrality isn't going to happen it looks like, so I doubt it's going to get easier for us to find a consistent method of online delivery. We will all have to have multiple options for uploading and transferring files. I currently use mobile me (slowest), 2 FTP services, and You Send It.
I think You Send It has a 2GB limit on uploads...so in Bob's case it wouldn't help unless he sent two separate files that were then put back together on the other end...which is likely not an option.
The only solution that I know of for files as large as 3GB would be a T3 line, which has a (supposedly) constant speed of 44.6 Mbps. So you could theoretically upload about 250MB per minute, or 3GB in roughly 12 minutes.
Of course the downside is the cost of a T3 line would be in the thousands per month!
As a comparison, a T1 line would take about 30 times longer...or 6 hours on average to upload a 3GB file, but where we're located it only costs a few hundred a month and you can also put your phone system on it since it's actually a telephone based copper line. So in our case, it's about the same as paying for a separate phone system and internet cable.
But I can't imagine trying to use it to upload a 3GB file.
Somebody mentioned breaking it into packets...which is I believe what bit-torrent does. But I think for that to work you have to have mutliple people (peers) downloading the file at the same file. So if only one person is doing downloading, I don't think you're able to take advantage of the principals of torrents. Maybe that poster was talking about something else...but I know I've uploaded and downloaded 1GB or larger files in an hour via bit-torrent, but in those cases there were dozens of peers and also "seeders"...which are others who were uploading the same file while I was downloading it.
Magnetic Image, Inc.
Read our blog http://www.videomi.com/blog
Sorry, it's called DMG Chop.
Check it out.
The torrent idea won't work - you'd need several hosts across multiple locations feeding simultaneously, not multiple computers at a single location. Chop DMG will break a 3 gig file into multiple files of whatever size you want. All you have to do is make a disk image out your file in Disk Utility (a DMG), then run DMG Chop on it to break it into as many smaller files as you need. Upload your files via YSI. When all files are downloaded on the other end, the user only has to click the first file (which should have a name like 30spot-open me) and their mac will rebuild the original file - nobody on the receiver end has to install anything. This works - and you don't have to get some insanely expensive T1 line.
If you're on a PC, I don't know what to tell you. I don't do PC's. Try kicking it.
ps- I have no idea why my subject changed earlier to that HDW subject. Sorry!
John Davidson wrote: When all files are downloaded on the other end, the user only has to click the first file (which should have a name like 30spot-open me) and their mac will rebuild the original file - nobody on the receiver end has to install anything.
The problem you're likely going to run into with stations and cable systems is that most of their systems are automated...people are not involved and trying to convince a station to give your file special treatment will be difficult if not impossible. Not to mention if they're using Telestream's Flip Factory, adManager or Traffic Manager software...they're all Windows only.
We can't even get stations to implement Telestream provided fixes for the field reversal issue, which is just a tiny, simple plug-in that Telestream will provide and help setup for the station.
The reason? It would mean setting up a special watch folder for these problem files...which the stations and cable systems refuse to do. And believe me...we've asked...in fact we got telestream to figure out the problem by sending them several of the files stations were having problems with....within an hour they emailed back and said that there was nothing wrong with our encoded files, but that some of their presets for playout servers did indeed reverse the fields (usually a 720x480 to 720x486 conversion issue or vice-versa). They said it was an EASY fix...but the station would need to set up that special folder since the plug-in wouldn't need to run on "non-problem" files. The stations refused (several)...saying they couldn't do that because their engineers and IT people wouldn't allow changes to the system (despite the fact that it FIXED a glaring problem with the quality of their spot playback).
Perhaps some networks would be willing to do something like DMG chop for a program length file, but my guess is many would not, especially if they're PC based with Telestream products as well.
We've researched this issue of speed since the early part of this decade when we first started FTP'ing spots (2002 to be exact)...and there is no good, affordable solution that we've found works for both the sender and the receiver when it comes to files over about 250MB.
Magnetic Image, Inc.
Read our blog http://www.videomi.com/blog
I haven't done any speed comparisons with the similar options like YouSendIt, but http://www.filedropper.com offers a 5Gb limit rather than the 2Gb limit at YouSendIt and most similar sites I've seen.