SQL Server 2000 Databases

Discussion in 'Databases' started by DavePo, Oct 23, 2014.

  1. Has anyone else received any pertinent information regarding the inability to connect to SLQ Server 2000 Databases? We have a ticket in but there has been no updates for hours. We continue to lose $ales as our website is non-functional due to this. Does anyone have any information? Also we noticed that our backups have disappeared, we uploaded the one backup in currently in our Database folder
     
  2. mjp

    mjp

    Dave, we're working on that, if you opened a ticket you should have a response. We'll also be updating everyone on the affected SQL 2000 servers in a couple of hours when we know where we stand. Sorry.
     
  3. Could you please provide an update on How things are looking?

    Why wouldn't the production database files not be usable? I get that the backups weren't available but what happened to the production files? Shouldn't they still be sitting on the server? Please provide details for what happened to those files.

    I'm trying to judge whether I should spend the rest of the weekend trying to reconstruct data.

    Thank you.
     
  4. mjp

    mjp

  5. I,m from Thursday whitout running forms connected to you re database. All customers use our forms which they cant now. I only use you re server for that matter. I dont even host a WEBSITE with you. It has come to my attention that i recieved multiples emails with updates and server changes during the last year. Which also caused in bad running servers and lost of my email passwords....!!! Are you gonna recover the data or are you just pushing everything on the long term, so hopefully we move on and take other solutions!!! I really want to know. Frustrating....
     
  6. You have reported that 3 of 6 disks have been imaged. Does each disk correspond to one server? Can you move forward trying to recover the 3 disks that have been imaged?

    If so, can you provide an update on how that step goes?

    Thank you.
     
  7. mjp

    mjp

    I don't know. We are trying. If we couldn't and there were no possibilities left to try, we would say so.

    Not really. And we won't have access to any of the data until the entire recovery is complete. We won't have any information to pass along regarding individual databases until we get all of the data back from recovery. Sorry.

    We are updating the last post in the outages thread whenever there is a status update.
     
  8. I have been hosting our database and SQL for over 8 years and everything was fine until recently where the team brings down servers for 6 hrs every month for update. In this case, windows updated and the entire database is gone. I have 8 yrs worth of customer sales record and my current inventory status. I really don't know what to do if we cannot get the data back.

    What happened exactly ? How come three disks went bad at the same time ? Shouldn't there be some sort of back up (On tape or raid) ? I am very disappointed and frustrated with the service level recently. I hope if you recovered the data this time and manage to retain customers, you can seriously review the back up process (if there is one). I know i read in other post we are not paying for redundancy and fail over, but this experience will drive a lot of customers away.
     
  9. whats the deadline for DISCOUNTASP in trying to recuparate the data? After a certain point i need to make the necessary changes to the site and pay someone to do this.
    Thank you for letting me know
     
  10. Can we have an update please ?
     
  11. mjp

    mjp

    MS SQL runs on Windows servers. They have to be updated, that's the nature of Windows. If they are not updated, you only have additional problems and security issues. But no Windows server update ever lasts six hours. It would be extremely unusual if it took an hour. It's usually closer to 10 minutes, and sometimes the servers don't need to be restarted at all, in which case there's zero downtime. But again, these aren't linux servers that can run for six months without being touched. That's just the nature of the technology that we use.
    Yes. We manage hundreds of servers, and they are all backed up every day. It's an automated system, but as with any automated system, someone has to verify that the automation is working correctly. The failure to verify the backups of these SQL 2000 servers was a human failure, and it's all ours.
    There isn't a deadline, per se. We aren't going to stop trying at some point. On Friday we were told the process could expect to be completed within 48 hours at the most. But there are variables in any data recovery operation that can increase the time needed to retrieve the maximum amount of data.

    We are updating the last post in the outages thread whenever there is a status update.
     
  12. Can we have another update please?
    Thank you
     
  13. It seems like disk 3 is going very slowly. If we recover 5 out of 6 disks, is it possible to rebuild the remaining one ?

    Also in case imaging is successful how long are we looking at to get all the SQL serves up and running ?
     
  14. mjp

    mjp

    We won't know anything until we have the data back from recovery. I don't want to speculate or promise anything. Sorry, I know that's vague, but it has to be right now. When we get the data we'll know what we can do.
     
  15. I have recovered all of my data from my backups and am 100% operational on the new SQL server you guys transferred me to. If your data recovery is successful will you ask us if we want to have the data restored as I DO NOT need mine restored, if you restore without asking it will be another setback for us. Please let us know. Thank you
     
  16. mjp

    mjp

    Dave, what will happen if all of the data is retrieved and usable is we will spin up the old servers - so your new database wouldn't be affected. The old database would be in its old location, and you could choose to use it or not.
     
  17. When are we getting the data back ??
    Disk 3 is going at the speed of 1% every six hours. What's going on there ?

    Isn't it possible to rebuild the remaining disk with the others given this is raid ???

    The database has been down for a week already !!
     
    RickG83 likes this.
  18. I would also like the answer to those questions. I'm having a real tough time understanding why in this day and age...

    1. The database disks were not on SAN with cloning and snapshots
    2. There was not a functioning and TESTED backup/recovery strategy

    Looking at the progress on the recovery, it's easy to see it could be another 4-7 days before it completes then god knows how long to get the system up and running. Second week of November if we're being honest here? Wow.
    I'm sorry but I have serious doubts about how this will look when the dust settles given how it has unfolded so far. No confidence.
     
  19. mjp

    mjp

    If you look at the updates overall, the recovery process isn't working at a consistent rate. Some updates show more progress than others, some less. The final disk is at 80% now. If 80% took a week I wouldn't suspect that the remaining 20% will take another week. But we don't know anything for sure other than what the recovery specialists tell us.

    Once we have the data from them one of two things will happen. If all of the data is retrieved and usable is we will spin up the old servers and they'll be back up immediately. If that doesn't happen we'll have to see what we can do to restore the databases individually. But again, we can't say anything for sure until the data is in hand.

    We back up hundreds of servers every day. The size and scope of our backup system is actually larger than the production system, which is pretty large. We routinely make use of those backups to provide to customers or in server restoration. Where we failed with this group of SQL 2000 servers was in the verification of the backups. That was our mistake, and we've made changes in our daily processes so we don't ever have another situation like this.

    When a system works over time you can begin to take it for granted. That's what we did, and we shouldn't have. It was our failure and I can't tell you how horrified everyone here was to have put you all into this mess. It's embarrassing and we're really sorry that it's making things tough on you while we dig out from under it. We care about what we do and the quality of our service, and we place your satisfaction above everything else we do. We don't like disappointing you for any reason, so we're doing all we can to get your data back and make sure it's always safe from here on out.

    When you say, "no confidence," I get that, and I don't blame you. We all rely on databases every day, our lives kind of revolve around them, so we do put ourselves into your shoes, and we all know that we let you down and your anger and disappointment is justified. I'm sorry, and I know everyone else here who is involved is sorry, and we're hoping for the best outcome here so everyone can get back to where they were before this happened.
     
  20. You have reported:
    Will that take as long as the imaging? Or, do you have an estimate of how long it will take?

    Thank you.
     
  21. mjp

    mjp

    No, it will not take anywhere near as long as imaging. I believe it would just be a matter of obtaining/downloading the data and getting to work on it here. Which we will do the minute it is available.
     
  22. Do they have a successfully restored image?
     
  23. Can we get an update please ? There has been no update since 10/31 12pm

    You said you will update as soon as you have it, but i believe everybody who has been affected by this has been extremely patient. So asking for more frequent update is totally understandable, and that should what exactly you should do. Your post gave me a strong feeling that you are annoyed by the constant requests for update from your customers.

    The database has been down more than a week, and multiple business has been affected. All your customers (at least the ones that doesn't have the backup) are just sitting ducks waiting for any good news. So it's only natural that we need to know something.
     
  24. martino

    martino DiscountASP.NET Staff

    Our customers who have been affected by this has been very very patient indeed. We asked our system administrators for the latest information they have from the data recovery company. They stated that their still working on the current step that was last provided in the forum post. So literally no further information has been provided by the data recover company. As soon as we get more information we'll update the forum post.

    We can say thank you for your patience but trust me here at discountasp.net we really really do thank you for your patience and we really do mean this. This whole situation has been bad for all of us especially our customers.

    We will update the forum post the moment we receive more information. We're checking it every hour and the moment we get it, we'll update everyone.

    According to the update on our forum post. They finished imaging the drives but now their working on the files on the drives.
     
  25. mjp

    mjp

    I'm posting every update we get as soon as we get it. There isn't a new update since Friday because they haven't given us one. Our DBA is in phone contact with them and I check for an update every hour. There's just nothing there right now. We're getting no feedback from them.

    No one here is annoyed at requests for updates. I'm surprised there aren't more, to tell you the truth. I am annoyed with the data recovery company, but not any of you. If it comes across that way, I'm sorry. It's the furthest thing from my mind.
     
  26. mjp

    mjp

    Bad news: I've just been told that the testing has to be done on the data recovery specialists side and it is going to take some time to prep/complete. By "some time" I mean a couple more days. If all goes well we'll have the physical drives on Wednesday night. Sorry to announce yet another delay.

    Good news
    : They've indicated that they were able to rescue all of the data on the drives. Which means - if testing over the next couple of days is successful - once we get the physical drives to our data center on Wednesday night it should only be a matter of minutes before all the SQL servers come back to life.

    This will likely be the last update we have until Wednesday night.
     
  27. Will they test through the night? It seems like they took the weekend off and will soon be done working for the day? Meaning at least another day?
     
  28. mjp

    mjp

    I can't say. The last update we got from them said, "Should be ready by Wednesday." But I don't know the schedule over there. I know we are (were?) paying for expedited service - working weekends, etc. But I'm afraid I don't know specifically what goes on over there.
     
  29. Let's give these guys more pressure !!! You being the customer surely should be allowed to request for updates, especially the expected schedule has been delayed time over time.

    It seems to me that they took the weekend off last week and just left us in the dark. Let's not drag our feet on this issue. There are businesses to be run.
     
  30. mjp

    mjp

    When we have information or news I post it. I understand requesting more frequent updates from us, because who else are you going to ask?

    The frustrating thing for all of us is that this has been out of our hands since the evening of the crash, when we handed the drives over to the data recovery company. We're not in a much better position than you are when it comes to details.

    I know our DBA is still calling them every two hours, and I have been checking for updates from them in our customer portal every hour.

    I hope we have some good news for everyone today.
     

Share This Page