Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length
Pages: [1] 2 3 ... 7
Print
Topic: Free Hosting Hardware Issues  (Read 6394 times)
« on: September 27, 2008, 01:58:45 AM »
Alex Melen Offline
President / Founder
Administrator
Addict

View Profile WWW
*****
Posts: 2,205



We are having some issues with our free hosting hardware and are currently working on it. I'll keep everyone posted in this thread.

In the mean time your websites might load to a not-found page since the storage array with the free hosting member files is the one having the problems. This does not mean we deleted your site, it's a hardware issue that we are working on fixing.

9/20 9am update - It looks like there have been severe hardware failures even pn the "backup" drives of the storage array. The hardware raid card failed completely taking down a lot of the drives with it. We're still assessing the damage, but it's starting to look like some of the data might be lost. I really hope people have backups (since you upload the files to us, you have to have them on your pc first!) as we keep recommending. I'll keep everyone posted throughout the rest of the day. We usually have extra drives ready for something like this, but with the amount of drives that failed I have placed an emergency order for new ones (that should come within 6 hours). I again apologize for any inconvenience this has caused. As you can tell, I am working around the clock (worked all night) to try to get this back up as soon as possible.

9/20 10am update - The problem is starting to look more severe, we are going to need to replace most of the free hosting hardware, which means costs in the high $xx,xxx range. I'm trying to get the money secured for this as we speak so we can have the hardware asap. I am still hoping to be back online later today, but with some data loss. Current best estimate is 6:30pm EST (in 8 hours).

9/27 4pm update - I just got back from the data center and the new hardware is currently being installed. ETA for up-time is being pushed back 2 hours to 8:30pm EST.

9/27 11pm update - Still having issues... heading back to the data center.. will keep everyone posted.

9/28 1am update - Re-install is 50% done. Hope to be done in about an hour and begin the software installs (considering everything goes to plan).

9/28 6am update - The new server is now up. We are still working to recover some data and install things, but you can now upload your files back.

9/28 4pm update - All usual upload limits (speed, etc..) have been removed to let you guys re-upload your accounts quicker.

9/28 10pm update - Just took the machines down for some final software upgrade. Should be back online and 100% operational within 20minutes. Then comes the attempt to recover data..

9/29 11am update - Final update. Everything is up and working for about 12 hours now. I will be sending the broken hardware to a disaster recovery company so that we might be able to recover some more of the data. I want to personally apologize for this loss and reassure everyone that we are taking steps to make sure this does not happen again. At the same time, we (as always) strongly recommend that all members keep local backups of all the files. Since you upload them from your PC to begin with, just leave a copy on the PC!

Quote from: T35 Free Hosting Terms Of Service
Item 7 - Section C) ... INDIVIDUAL MEMBERS ARE RESPONSIBLE FOR MONITORING AND CREATING BACKUPS OF THEIR PAGES ...

I again apologize for any inconvenience and will follow up later in the week if we are able to recover any more data.
« Last Edit: September 29, 2008, 10:01:18 AM by Alex Melen » Logged


 
« Reply #1 on: September 28, 2008, 11:05:15 AM »
Mr.TrungHieuNguyen Offline
Newbie

View Profile
*
Posts: 3



Dear Mr. Alex Melen!
Now I'm writing this reply at 11h 00 pm (Vietnamese hour _ GMT +7) on 09/28/2008, and I want to describe some problems I still meet until now, I hope the information can help you to fix better Smiley
If I haven't login to my website manage page (since the errors appeared), when I access to my website, I always see the notice "Not Found...". But when I login successfully, my website (subdomain) can be accessed, but there is not any files in my website, and the "Index /" page appears.
Especially, it's so so difficult to login successfully, because I usually meet the notice "cannot login" at the red page, and I must try so much, after a long time, I login ok.
But when I login, almost time I am logged out automatically, so I cannot upload or creat anything at the manage site.
And if I try so much to keep logging in, when I try to upload 1 file (html _ some KB, very small), the server always denied and notice "File ... is OK. Cannot transfer to FPT server", so all my try is nothing.
All things above are my problems, and I think they are the popular problems of another webmasters using t35.com service now, so I hope you can solve them as soon as well.
The last, I thank you so much because of your try to fix the errors. I hope you'll keep the best health to develop your service to be better and better.
Thanks again and hope that you have nice time Smiley
Logged
« Reply #2 on: September 28, 2008, 11:48:02 AM »
Alex Melen Offline
President / Founder
Administrator
Addict

View Profile WWW
*****
Posts: 2,205



Some files/data might have been lost. I'm not having any problems logging in though? Can you try again?
Logged

« Reply #3 on: September 28, 2008, 12:42:16 PM »
Mr.TrungHieuNguyen Offline
Newbie

View Profile
*
Posts: 3



Uhm, I have tried much. And I see that if user login in the homepage (t35.com), user'll meet the error. But when I login in the red page, after several times, I do successfully.
And the uploading files meets a little difficulty, because the error "cannot transfer to FTP server" often appears. But fortunately, if I try to do several times (refresh "upload" page), I can upload ok.
Now, the biggest problem is: user often is logouted automatically, example: when finish uploading, when go up to the parent directory...
Hope that everything will be as good as before.
Thanks much for your try Smiley

« Last Edit: September 28, 2008, 12:48:45 PM by mr.trunghieunguyen » Logged
« Reply #4 on: September 28, 2008, 12:46:14 PM »
Alex Melen Offline
President / Founder
Administrator
Addict

View Profile WWW
*****
Posts: 2,205



Just give it a few minutes or an hour or two more.. we are still working some things out.
Logged

« Reply #5 on: September 28, 2008, 01:31:07 PM »
chickenmeister Offline
master of chickens
Global Moderator
Member

View Profile WWW
*****
Posts: 223



Ouch! This one hurts, bad.
I don't have any recent backups. Though it's my own dumb fault.  embarassed  huh

How can so much hardware fail at once?
Logged

Hello world!
« Reply #6 on: September 28, 2008, 01:32:29 PM »
Alex Melen Offline
President / Founder
Administrator
Addict

View Profile WWW
*****
Posts: 2,205



The raid card failed and caused major corruption... I'm going to be working with a disaster recovery company once the current machines are up and working.
Logged

« Reply #7 on: September 28, 2008, 05:18:25 PM »
Christian271 Offline
Newbie

View Profile
*
Posts: 7



When I log in all my files are gone, dose that mean they are lost? I have some backups but there not the newest.
Logged
« Reply #8 on: September 28, 2008, 05:20:54 PM »
fredyossa Offline
Newbie

View Profile
*
Posts: 6



thank you very much!
restoring and uploading data
I imagine qu must be tired and sleepy.
luck and thanks again
Logged
« Reply #9 on: September 28, 2008, 05:35:16 PM »
Alex Melen Offline
President / Founder
Administrator
Addict

View Profile WWW
*****
Posts: 2,205



Christian271 ... Some of the files have already been restored. I'm going to be working with a disaster recovery company later in the week to try to salvage the rest of them. Unfortunately, there is going to be a lot of data that won't be recoverable.

fredyossa ... Yup. On day 3 without sleep now..
Logged

« Reply #10 on: September 28, 2008, 05:51:38 PM »
scylla Offline
Newbie

View Profile
*
Posts: 19



Ouch, hope you guys get it fixed soon.  At the moment I'm in the middle of uploading around 137 megs of my backup... on dialup tongue  14,811 files in about 160 folders
« Last Edit: September 28, 2008, 05:54:02 PM by scylla » Logged

« Reply #11 on: September 28, 2008, 06:05:27 PM »
Alex Melen Offline
President / Founder
Administrator
Addict

View Profile WWW
*****
Posts: 2,205



Ehh.. with dial up removing our previous 10kb/s upload speed limit won't really help :\
Logged

« Reply #12 on: September 28, 2008, 07:18:15 PM »
eagleflight Offline
Newbie

View Profile
*
Posts: 20



Thank you Alex. I know you have been working very hard and long hours to try and fix these problems People have to understand that it's not Alex's fault we all need to give him space to deal with the problems I'm also having problems.


P.s I've been with other hosts before, that don't even keep you informed to what is going on when theirs a problem. So we should all be very gratefull Alex and his team are trying hard to fix the problems, these things can take time i understand.  They are also keeping everyone up to date to where their at with these problems.




Alex thank you.
« Last Edit: September 28, 2008, 07:20:39 PM by eagleflight » Logged

« Reply #13 on: September 28, 2008, 07:26:53 PM »
Alex Melen Offline
President / Founder
Administrator
Addict

View Profile WWW
*****
Posts: 2,205



Thanks eagleflight! New hardware array we setup has more redundancy, so hopefully we'll never have to go through this again. I'm also going to be upgrading the front end machine (cpu & ram) in the next few days.. so that should help load speed and such. And ftp upload speed will be permanently increased (it's currently un-capped to allow quick re-uploads)... but at the very least it won't go back to the 8kb/s we had before.
Logged

« Reply #14 on: September 28, 2008, 08:33:51 PM »
skitty54 Offline
Newbie

View Profile
*
Posts: 20



How come all the sudden, i cant log in. i was fine one seconed, then gone the next.  shocked shocked i cant even see my site.
« Last Edit: September 28, 2008, 08:39:59 PM by skitty54 » Logged
 
Pages: [1] 2 3 ... 7
Print
Jump to:  

Powered by SMF | SMF © 2006-2008, Simple Machines LLC