any tip to handle mass game upload

kk999 · 09-14-2007, 10:04 PM

I am uploading using Coreftp from my PC a thousand games into a new arcade,
less than 1gb but took my pc 2 days already over an adsl line.

After it's almost done, the ftp crashed. So I know 90% games are ok, maybe 10% are
half uploaded, and a few not loaded at all, but the problem is I don't know which.

Any possibility to find out the delta, so that I can just reload those that are not complete?
Or is there a good ftp program which upload faster and better?

2GrandArcade · 09-15-2007, 12:04 AM

the only way i know is to upload them again and check the size at the overwrite prompt and it'll upload the ones missing,but that alot of clicking "no".

it's best not to add all the files to the queue because if the client crashes,well you already know what happens.
for any client it takes longer to upload small files then big ones.
if you have cpanel and the zip module installed,make a bunch of zip files and uplaod them one by one.extract them in file manager.

RickyG · 09-15-2007, 03:21 AM

I have been in the same spot as you many times. Now I do it as2grand suggests. The only advice I have is lots of coffee and red bull. It's going to be a long night

RickyG

brendgard · 09-15-2007, 03:45 PM

Yea, been there done that too. I have such rotten access to the internet/computer that I usually just upload it in small chunks(like upload all the "a" files, then the "b" files etc), or zip it together and upload it as a single file, then use cPanel to unzip it at the other end.

Depending on your version of cPanel, and how it's configured, you might be able to zip the files into a set of files instead of one huge one. Some cPanels wont work with a set, just individual files. It also depends on what you use to zip them up, whether or not it will make a zip file set. You tell it to break it into files of say 250 megs, and it makes a set of files about 250 megs each, then upload them all and unzip the master file.

kk999 · 09-18-2007, 01:04 AM

Thank you guys for all the tips. I wasn't aware that cpanel supports zip and so finally I've got my games up there, after another 2 nights and plenty of caffeine =).
(yeah my line sucks!)

john274 · 09-18-2007, 10:24 PM

CoreFTP is an FTP program I have been using for a few years now and is the best one I have actually used. I don't get how you managed to not even know where you are. Didn't you have the games in alphabetical order while they were uploading or in date order. You can easily then go to the last 1 game where it had crashed and then delete that 1 game that it finished on before the crash and then just highlight all of the games again and put then in the upload gueue. Once it starts uploading it will say to you want to overwrite this game and you should check the box where it says something like "overwrite if newer file" That will only overwrite the files if they are newer than the files that you currently have so in other words it will skip all of the ones that you have done and then carry on from where you left of.

All this can be done in CoreFTP Lite.

kk999 · 09-19-2007, 05:00 AM

Yea I like CoreFTP so far too. For games that're not loaded fully, it'll skip to the next in line, put the failed one to the end of queue and auto retry later.

I was too lazy and selected all 1000 games to do in one go and there were about 100 half loaded files which were queued for reload. (Yes my line not so good so about 10% need to retry). So when it crashed, this list is gone which is a big problem.

Like everyone suggested, if I chopped it up into smaller batches, and zipped them up, it should be ok.

09-14-2007, 10:04 PM	#1 (permalink)
kk999 Member Join Date: Jun 2007 Posts: 17	any tip to handle mass game upload I am uploading using Coreftp from my PC a thousand games into a new arcade, less than 1gb but took my pc 2 days already over an adsl line. After it's almost done, the ftp crashed. So I know 90% games are ok, maybe 10% are half uploaded, and a few not loaded at all, but the problem is I don't know which. Any possibility to find out the delta, so that I can just reload those that are not complete? Or is there a good ftp program which upload faster and better?

09-15-2007, 12:04 AM	#2 (permalink)
2GrandArcade Senior Member Join Date: Feb 2007 Posts: 512	the only way i know is to upload them again and check the size at the overwrite prompt and it'll upload the ones missing,but that alot of clicking "no". it's best not to add all the files to the queue because if the client crashes,well you already know what happens. for any client it takes longer to upload small files then big ones. if you have cpanel and the zip module installed,make a bunch of zip files and uplaod them one by one.extract them in file manager. __________________ Arcade banner exchange online games

09-15-2007, 03:21 AM	#3 (permalink)
RickyG Moderator Senior Member Join Date: Dec 2006 Location: Under Your Mouse! Posts: 1,208	I have been in the same spot as you many times. Now I do it as2grand suggests. The only advice I have is lots of coffee and red bull. It's going to be a long night RickyG __________________ Arcade Banner Exchange, game packs, top site, arcade script and forum for all of your arcade needs http://www.mibbi.com This site stinks!! www.farting.us Coming soon MibbiJr!

09-15-2007, 03:45 PM	#4 (permalink)
brendgard Gamer FX Staff Senior Member Join Date: Oct 2006 Posts: 681	Yea, been there done that too. I have such rotten access to the internet/computer that I usually just upload it in small chunks(like upload all the "a" files, then the "b" files etc), or zip it together and upload it as a single file, then use cPanel to unzip it at the other end. Depending on your version of cPanel, and how it's configured, you might be able to zip the files into a set of files instead of one huge one. Some cPanels wont work with a set, just individual files. It also depends on what you use to zip them up, whether or not it will make a zip file set. You tell it to break it into files of say 250 megs, and it makes a set of files about 250 megs each, then upload them all and unzip the master file. __________________ http://gamersgo.com A list of arcade related sites, add yours. http://auntiefondy.com Lists, add your site. http://kbsplace.com

09-18-2007, 10:24 PM	#6 (permalink)
john274 Full Member Join Date: Aug 2007 Posts: 97	CoreFTP is an FTP program I have been using for a few years now and is the best one I have actually used. I don't get how you managed to not even know where you are. Didn't you have the games in alphabetical order while they were uploading or in date order. You can easily then go to the last 1 game where it had crashed and then delete that 1 game that it finished on before the crash and then just highlight all of the games again and put then in the upload gueue. Once it starts uploading it will say to you want to overwrite this game and you should check the box where it says something like "overwrite if newer file" That will only overwrite the files if they are newer than the files that you currently have so in other words it will skip all of the ones that you have done and then carry on from where you left of. All this can be done in CoreFTP Lite. __________________ Free Online Games \| Funny Videos \| Funny Pictures Providing you with some of the best humor on the web which is updated daily!

09-18-2007, 01:04 AM	#5 (permalink)
kk999 Member Join Date: Jun 2007 Posts: 17	Thank you guys for all the tips. I wasn't aware that cpanel supports zip and so finally I've got my games up there, after another 2 nights and plenty of caffeine =). (yeah my line sucks!)

09-19-2007, 05:00 AM	#7 (permalink)
kk999 Member Join Date: Jun 2007 Posts: 17	Yea I like CoreFTP so far too. For games that're not loaded fully, it'll skip to the next in line, put the failed one to the end of queue and auto retry later. I was too lazy and selected all 1000 games to do in one go and there were about 100 half loaded files which were queued for reload. (Yes my line not so good so about 10% need to retry). So when it crashed, this list is gone which is a big problem. Like everyone suggested, if I chopped it up into smaller batches, and zipped them up, it should be ok.

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Arcade Script Reviews	arcadillo	Scripts & Software	6	08-08-2008 02:35 AM
1500 games for GameSiteScript with SQL database for $10	ArcadeMan	GameSiteScript	1	05-10-2007 10:56 AM
Have an Arcade? Need Games? 2229 Games Inside!!!	admin	Game Packs	3	09-15-2006 10:30 AM
Nintendo Cleans Up @ Game Critics Awards	Creature	The Lounge	0	06-20-2006 06:55 AM
GameSiteScript Arcade Game Packs As Low As $0.045/GAME!!	admin	Game Packs	3	06-19-2006 04:34 AM