Great Western Coffee Shop

Sideshoots - associated subjects => News, Help and Assistance => Topic started by: grahame on April 03, 2018, 20:52:09



Title: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: grahame on April 03, 2018, 20:52:09
In the middle of last night, our server suffered a severe hardware malfunction (the hard disc crashed!) and I have spend most of today rebuilding.   Snapshots of the database are taken every hour ... but kept on the disc.   And I download a couple of times a week.   So ... I'me very sorry but we have lost an exciting Easter weekend.

There are a lot of web sites on the server, and we are rebuilding with a new underlying operating system - so not everything is back yet, and indeed testing is not completed to please keep a copy of anything you post in case I something goes pair shaped.   I will be stopping for the evening soon, as I am likely to make errors if I do too much more tonight

What happened over the weekend?

* A complete meltdown of Bath and South Wales services on Sunday

* A complete TransWilts meltdown on Monday, and overcrowding from the West Country

* A poll which was suggesting that passengers would prefer a published achievable one, rather than an overambitious one, during engineering

* End of month - 2490 posts which was a near-record, and I mused I wished we were quieter because lots of posts tends to equate with lots of problems

* New proposals for the South East Wales and West of England Business rail link at http://www.sewweb.info

Now - I'm going to copy and paste this to a text file in case it fails to register!




Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: bobm on April 03, 2018, 21:01:37
Feel like the crew of Apollo 13.  It’s good to be back!


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: Birdie100 on April 03, 2018, 21:04:38
A huge thanks for the hours of effort it takes to bring this all back online again! As a long time lurker I’m amazed at the dedication it takes to get a forum like this back up and running. The loss of a weekend of posts doesn’t reflect the minor miricle you’ve managed to perform in recovering everything else from before then!


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: SandTEngineer on April 03, 2018, 21:08:37
....and thanks from me as well.  Think the spellchecker needs a bit of a boost though.... ;)


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: rogerw on April 03, 2018, 21:14:13
my thanks to you Grahame for the immense amount of work you have put in today


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: eXPassenger on April 03, 2018, 21:23:04
Well done on all the hard work involved in recovering a service like this.


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: Oberon on April 03, 2018, 21:35:47
Well done Grahame, your hard work really is appreciated


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: johnneyw on April 03, 2018, 21:42:31
Yes, a well earned rest this evening is highly deserved and perhaps gin and tonic too? Just go easy on the tonic! 😀


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: johoare on April 03, 2018, 21:52:03
Thanks from me too graham.. Your hard work is really appreciated..And just a reminder that you might need to put the clock forward again once all is recovered on here  ;D


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: grahame on April 03, 2018, 21:58:08
Thanks from me too graham.. Your hard work is really appreciated..And just a reminder that you might need to put the clock forward again once all is recovered on here  ;D

Ah - I hadn't noticed the clock!


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: johoare on April 03, 2018, 22:03:51
Thanks from me too graham.. Your hard work is really appreciated..And just a reminder that you might need to put the clock forward again once all is recovered on here  ;D

Ah - I hadn't noticed the clock!
I've worked in IT application support for too long.. it was one of the first things I noticed


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: grahame on April 03, 2018, 22:16:26
Some graphics that were lost (at least temporarily)

(http://www.wellho.net/pix/dawlish_november_2033.jpg)

(http://www.wellho.net/pix/winchester_1949.jpg)

(http://www.wellho.net/pix/2018_03_members.jpg) 

(http://www.wellho.net/pix/2018_03_online.jpg)

(http://www.wellho.net/pix/2018_03_posts.jpg)

(http://www.wellho.net/pix/2018_03_topics.jpg)

(http://www.wellho.net/pix/2018_03_totalposts.jpg)


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: grahame on April 03, 2018, 22:22:05
Some graphics that were lost (at least temporarily)

And the rest

(http://www.wellho.net/pix/padstow_1949.jpg)

(http://www.wellho.net/pix/padstow_1963.jpg)

(http://www.wellho.net/pix/cover_1963.jpg)

(http://www.wellho.net/pix/20180331_01.jpg)

(http://www.wellho.net/pix/20180331_02.jpg)

(http://www.wellho.net/pix/20180331_03.jpg)

(http://www.wellho.net/pix/20180331_04.jpg)


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: grahame on April 03, 2018, 22:31:54
And if anyone would like a reminder of what we were talking about 24 hours ago, courtesy of the Google Cache:

Quote
Great Western Coffee Shop > Recent Posts

1  Journey by Journey / London to the West / Re: More dangerous overcrowding to the Westcountry
 on: Today at 10:25:12 PM
Started by TaplowGreen - Last post by TaplowGreen
Quote from: Timmer on Today at 10:05:33 PM
A quick scroll through Twitter shows pics of many very well loaded trains with people asking why do GWR still sell tickets when they know the service is going to be busy.

Welcome to the flexible turn up and travel railway. Just don’t turn up when everybody else does.

I must admit I've taken to using National Express Reading-Plymouth for exactly these reasons....it's far cheaper, far more comfortable, guaranteed seats, no overcrowding and (amazingly) they seem to have sufficient drivers & "rolling stock" 🙂

Only drawback is that it's a roughly 1hr longer journey but 30 mins of that is generally spent at Sedgemoor or Leigh Delamere. I'll take some persuading to get back on overcrowded, unreliable & overpriced trains, especially back from the Southwest on a Sunday.

On the upside I guess that's a few more square inches freed up for someone else to squeeze on!

2  All across the Great Western territory / Introductions and chat / Re: Looking for a more peaceful life??
 on: Today at 10:22:14 PM
Started by grahame - Last post by stuving
Quote from: ellendune on Today at 09:18:30 PM
Ok so the water levels might have increased, but even so you don'e need to be a drainage engineer to see that lowering the level of the track is not going to improve things. 

I guess the choice would have been either to abandon the planned design of electrification and delay its completion even more while an alternative treatment for the bridges is wrestled through planning, or go ahead strongly suspecting that the identified drainage improvements will be left undone until a few incidents of flooding give it enough priority.

 3  All across the Great Western territory / Diary - what's happening when? / Re: TransWilts AGM - 28th April 2018
 on: Today at 10:22:05 PM
Started by grahame - Last post by ellendune
Quote from: TaplowGreen on Today at 10:16:57 PM
Quote from: ellendune on Today at 09:20:37 PM
Quote from: grahame on Today at 06:21:43 PM
I thought they were the folks who started this whole "Sunday is a day of rest" mullarkey!

They have another day off instead

Time & a half for weddings on Saturdays.

Dream on

 4  Journey by Journey / London to the West / Re: More dangerous overcrowding to the Westcountry
 on: Today at 10:18:56 PM
Started by TaplowGreen - Last post by Timmer
Thinking about the situation of people not being able to board at Taunton. With the work taking place at Bristol, there was no alternative train service by travelling to Bristol and changing there to go to London.

 5  All across the Great Western territory / Diary - what's happening when? / Re: TransWilts AGM - 28th April 2018
 on: Today at 10:16:57 PM
Started by grahame - Last post by TaplowGreen
Quote from: ellendune on Today at 09:20:37 PM
Quote from: grahame on Today at 06:21:43 PM
I thought they were the folks who started this whole "Sunday is a day of rest" mullarkey!

They have another day off instead

Time & a half for weddings on Saturdays.

 6  Journey by Journey / London to the West / Re: More dangerous overcrowding to the Westcountry
 on: Today at 10:05:33 PM
Started by TaplowGreen - Last post by Timmer
A quick scroll through Twitter shows pics of many very well loaded trains with people asking why do GWR still sell tickets when they know the service is going to be busy.

Welcome to the flexible turn up and travel railway. Just don’t turn up when everybody else does.

 7  Journey by Journey / Heathrow Express, Connect etc / Re: Heathrow Express to transfer to GWR (management contract)
 on: Today at 09:55:03 PM
Started by Ollie - Last post by devonexpress
Quote from: grahame on Today at 09:08:33 PM
The other day I was accused (in jest) of being an apologist for GWR and now I'm accused of having a pathetic dig at them.  I've probably got it about right then!

Let's move on.

Or maybe don't put silly sarky comments, and dare I say it, say nothing at all?

8  Journey by Journey / London to the West / Re: More dangerous overcrowding to the Westcountry
 on: Today at 09:46:05 PM
Started by TaplowGreen - Last post by PhilWakely
Quote from: phile on Today at 07:41:37 PM
According to a complaint on Twitter somebody was unable to board 3 consecutive trains heading towards London at Taunton.

I felt for one passenger who boarded the 1400 PNZ-PAD at Totnes and, like me, had to stand in a door vestibule. At Newton Abbot, she had to step out onto the platform to let other pax off the train, but the TM refused to let her get back on [along with many others waiting on the platform]. I do not blame the TM as said passenger could not get her point across that she'd only got off to let others off and the TM was desperately trying to stop anybody from boarding because of the already dangerous overcrowding.

9  Journey by Journey / Plymouth and Cornwall / Re: Cutdown 125's to operate Penzance to Plymouth clockface service
 on: Today at 09:45:47 PM
Started by RailCornwall - Last post by Adelante_CCT
Quote from: bignosemac on March 23, 2018, 07:05:30 PM
Quote from: phile on March 23, 2018, 05:46:57 PM
Quote from: PhilWakely on March 23, 2018, 05:19:33 PM
Available in public service from Monday, 26th March on....
2E12 – 0600 Penzance to Exeter;
2C45 – 0924 Exeter to Penzance;
2A85 – 1257 Penzance to Newton Abbot;
2P49 – 1555 Newton Abbot to Plymouth (which then continues to Penzance)
2C48 15 57 Plymouth to Penzance
2P96 20 18 Penzance to Plymouth
2C54 22 42 Plymouth to Penzance (SX)

2C48 is 1755 Plymouth to Penzance.

2C48 is the 15:57
2C51 is the 17:55 - which is the planned HST one

 10  All across the Great Western territory / Diary - what's happening when? / Re: TransWilts AGM - 28th April 2018
 on: Today at 09:20:37 PM
Started by grahame - Last post by ellendune
Quote from: grahame on Today at 06:21:43 PM
I thought they were the folks who started this whole "Sunday is a day of rest" mullarkey!

They have another day off instead



Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: Chris from Nailsea on April 03, 2018, 22:37:38
Thanks from me too graham.. Your hard work is really appreciated..And just a reminder that you might need to put the clock forward again once all is recovered on here  ;D

Ah - I hadn't noticed the clock!
I've worked in IT application support for too long.. it was one of the first things I noticed

Bean counter.  ::)

Just for the record, johoare and I happen to work for the same business.  ;) :D ;D

And may I add my own grateful thanks to grahame for his sterling work, over many hours, in retrieving as much as he could from the original disaster.



Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: grahame on April 04, 2018, 06:29:47
I am planning to rebuild PHP to include Jpeg generation once again - overnight tonight - which will allow a return of the disruption map at the top of these pages.


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: TaplowGreen on April 04, 2018, 07:34:41
Thanks for all your hard work Graham


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: CyclingSid on April 04, 2018, 09:04:21
Can I echo all the others and say thank you for all the hard work sticking it back together.

I liked the Western Region timetable. If the current GWR put out similar with Gratuitous on the bottom it would probably be taken as an insult by the travelling public.


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: Jason on April 04, 2018, 10:05:07
Likewise, excellent to see everything back.


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: Witham Bobby on April 04, 2018, 11:07:31
Thanks for all you do to keep this site running.  Well done on getting it back and operational so swiftly after such a major problem.  "more servers than usual requiring repairs"?  :-\


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: broadgage on April 04, 2018, 15:29:23
Thanks for all your hard work. Glad to see it working again.

Pedant mode alert.
If it all goes wrong, surely that is  PEAR shaped and not PAIR shaped :)



Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: trainer on April 04, 2018, 18:14:47
Thanks for all your hard work. Glad to see it working again.

Pedant mode alert.
If it all goes wrong, surely that is  PEAR shaped and not PAIR shaped :)

As always, a fruitful interjection.


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: SandTEngineer on April 04, 2018, 18:40:00
I told you earlier the smell checker needed an update... :P ;)


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: Richard Fairhurst on April 04, 2018, 21:34:29
If it all goes wrong, surely that is  PEAR shaped and not PAIR shaped :)

If grahame is rebuilding PHP, then PEAR-shaped is absolutely right...

(sorry, terrible geek joke)

I had an vicarious heart-in-mouth moment when reading the holding page for the "unplanned downtime": absolutely the one thing no sysadmin ever wants to happen, and I know the feeling of scrabbling wildly to find what, if anything, still works. I think we all owe grahame a lot of very large drinks.


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: Electric train on April 04, 2018, 22:34:39
Worst nightmare ever a HDD crash, had one on my own PC end of last year luckily it was the Windoz operating HDD my files are on other SSD now the operating system is on a SSD.

So i have a lot of empathy Graham ................... thanks for all the hard work you do keeping this message board online  :)


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: stuving on April 04, 2018, 23:15:44
Worst nightmare ever a HDD crash, had one on my own PC end of last year luckily it was the Windoz operating HDD my files are on other SSD now the operating system is on a SSD.

I had the same happen - though I used the SSD for the system, so I lost my data and the last backup copy was a couple of weeks back. Having replaced it (I'm not convinced the SSD is any less fallible) it struck me that having two drives provides a way of doing a simple extra backup. I have a process that I run each night (pending a bit of upgrading) to copy the most recent stuff from each drive to the other one.


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: Surrey 455 on April 04, 2018, 23:41:37
Worst nightmare ever a HDD crash, had one on my own PC end of last year luckily it was the Windoz operating HDD my files are on other SSD now the operating system is on a SSD.

So i have a lot of empathy Graham ................... thanks for all the hard work you do keeping this message board online  :)


I had my HDD crash in 2010 and lost 3-6 months of photos plus other stuff after my last back up. I learnt my lesson and now back up weekly (Although Windows thinks I should be doing it daily)


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: grahame on April 05, 2018, 05:52:11
Many MANY thanks for all the messages of support; "incident" map on the top of the site is back. The click through for individual stations is not - last major backup was done during that work and so that needs to be re-completed.  I will probably re-factor but that's a significant amount of time against returns to other sites I need to work on today.


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: bobm on April 05, 2018, 07:08:32
I think we all owe grahame a lot of very large drinks.

I bought him a half of cider yesterday.  ;D


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: grahame on April 05, 2018, 07:44:05
I think we all owe grahame a lot of very large drinks.

I bought him a half of cider yesterday.  ;D

Thank you Bob - how appropriate that we have a "like" button on these pages!


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: eXPassenger on April 05, 2018, 09:16:11
Worst nightmare ever a HDD crash, had one on my own PC end of last year luckily it was the Windoz operating HDD my files are on other SSD now the operating system is on a SSD.

So i have a lot of empathy Graham ................... thanks for all the hard work you do keeping this message board online  :)


I had my HDD crash in 2010 and lost 3-6 months of photos plus other stuff after my last back up. I learnt my lesson and now back up weekly (Although Windows thinks I should be doing it daily)
My neighbour is a keen photographer and local historian.  The hard disk on her 7 year old computer failed and we found that her last (partial) backup was 2 years previously.  I managed to use recovery tools to restore all 195GB of data.  I am not sure if she is now using the backup procedure that I set up for her.


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: Bmblbzzz on April 05, 2018, 09:51:16
I'll add my vote of appreciation of all the hard work that goes into keeping this place running.

On another note, I've just worked out (I think) that the 16 jours in the thread title do not relate to days spent in France but hours!


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: grahame on April 05, 2018, 10:49:32
Link farm  ;D   ... I think I have more or less restored the following domains.   Moved from 32 to 64 bit o/s, at a new I address (so some may take a few hours to click in for you at 83.170.93.77 ) and done some tidying up.   There remain some dusty old domains to restore and a number of things to test, correct, etc ...

http://www.wellhousemanor.co.uk
http://www.wellho.net
http://www.savethetrain.org.uk
http://www.grahamellis.co.uk
http://www.firstgreatwestern.info
http://twhc.org.uk
http://twcrp.info
http://train.fyi
http://sewweb.info
http://option247.uk
http://mrug.org.uk
http://melkshamwell.org.uk
http://melksh.am
http://mbug.uk
http://gwr.passenger.chat
http://gettinghere.info
http://fiab.wellho.net
http://chrug.org.uk

Please help publicise any of these ;-) ...


Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: Chris from Nailsea on April 06, 2018, 03:54:08
....and thanks from me as well.  Think the spellchecker needs a bit of a boost though.... ;)

If it all goes wrong, surely that is PEAR shaped and not PAIR shaped :)

I told you earlier the smell checker needed an update... :P ;)

On another note, I've just worked out (I think) that the 16 jours in the thread title do not relate to days spent in France but hours!

With my own thanks also to grahame, for his incredible work behind the scenes in rebuilding the Coffee Shop forum from the ruins, so to speak - I've also taken this opportunity to update and clarify the heading of this particular topic - purely for ease of future reference.  ;)

Not that anything like this will ever happen again, obviously / hopefully!  :o

CfN  ;D





Title: Re: Coffee Shop forum - server crashed, major disruption - 2 April 2018
Post by: Adelante_CCT on April 06, 2018, 10:34:58
Quote
Not that anything like this will ever happen again, obviously / hopefully! 

Do you mean the server crashing or Grahams inaccurate spelling?


Hopefully not the former, but the latter is guaranteed!



This page is printed from the "Coffee Shop" forum at http://gwr.passenger.chat which is provided by a customer of Great Western Railway. Views expressed are those of the individual posters concerned. Visit www.gwr.com for the official Great Western Railway website. Please contact the administrators of this site if you feel that content provided contravenes our posting rules ( see http://railcustomer.info/1761 ). The forum is hosted by Well House Consultants - http://www.wellho.net