Train Graphic
Great Western Passengers' Forum Great Western Coffee Shop - [home] and [about]
Read about the forum [here]. Register and contribute [here] - it's free.
Random Image
Train Running @GWR Twitter Acronyms/Abbreviations Station Comparator Rail News GWR co. site Site Style 1 2 3 4 Chat on off
June 23, 2018, 01:23:56 am *
Welcome, Guest. Please login or register.

Login with username, password and session length
Forgotten your username or password? - get a reminder
Most liked recent subjects
[97] The end of civilisation in Cornwall as we kernow it?
[82] Public Consultation on next Cross Country franchise
[62] FirstBust ?
[58] MetroBus
[41] Who we are - the people behind firstgreatwestern.info
[19] Nothing to go on.
News: A forum for passengers ... with input from rail professionals welcomed too
 
   Home   Help Search Login Register  
Pages: [1]
  Print  
Author Topic: Server issues  (Read 532 times)
grahame
Administrator
Hero Member
*****
Posts: 20594



View Profile WWW Email
« on: May 05, 2018, 05:31:05 pm »

Just to let members know ... few funnies going on.  I am away with limited access / just note may be some service issues
Logged

TransWilts Rail - Linking North to West and South 9 times a day. [see here]
SandTEngineer
Hero Member
*****
Posts: 2017


In a Linemans Hut in the far Southwest


View Profile
« Reply #1 on: May 07, 2018, 11:24:06 am »

Hi Grahame.  Just to let you know (not a criticism) that message still cropping up at odd times saying 'database gone away' or 'unable to connect to server'.  Usually solved by retrying a few times.
« Last Edit: May 07, 2018, 11:29:19 am by SandTEngineer » Logged

Out of this nettle, Danger, we pluck this flower, Safety.
[Henry IV, Part 1, Act 2, Scene 3]
grahame
Administrator
Hero Member
*****
Posts: 20594



View Profile WWW Email
« Reply #2 on: May 07, 2018, 01:47:04 pm »

Hi Grahame.  Just to let you know (not a criticism) that message still cropping up at odd times saying 'database gone away' or 'unable to connect to server'.  Usually solved by retrying a few times.

Totally known ... but thanks for confirming it's not just me.

From where I am this week,  I dare not try too much; very limited access (no shell access to server, no scp, Lisa's vpn left her dead in the water.  And that's on what's called "the works".  A grumble to the provider here, and I'm told "funny you should ask - someone else was asking just this morning".
Logged

TransWilts Rail - Linking North to West and South 9 times a day. [see here]
grahame
Administrator
Hero Member
*****
Posts: 20594



View Profile WWW Email
« Reply #3 on: May 09, 2018, 12:07:33 pm »

Just to let members know ... few funnies going on.  I am away with limited access / just note may be some service issues

Pinging this to the top ... normal service should resume from Friday, perhaps with some engineering overrun to Saturday.  Problems due to lack shortage of technical admins on one of the rare occasions we needed them!
Logged

TransWilts Rail - Linking North to West and South 9 times a day. [see here]
grahame
Administrator
Hero Member
*****
Posts: 20594



View Profile WWW Email
« Reply #4 on: May 12, 2018, 01:28:52 pm »

Just to let members know ... few funnies going on.  I am away with limited access / just note may be some service issues

I am now back with regular access ... and have been looking around at flakiness during the week.  And I note from our logs that the Ahrefs Bot has been making up to 42,000 requests of our server per day - that's an average rate of one request for a page every 2 seconds!

So what is this robot?

Quote
AhrefsBot is a Web Crawler that powers the 12 trillion link database for Ahrefs online marketing toolset. It constantly crawls web to fill our database with new links and check the status of the previously found ones to provide the most comprehensive and up-to-the-minute data to our users.

Link data collected by Ahrefs Bot from the web is used by thousands of digital marketers around the world to plan, execute, and monitor their online marketing campaigns.

This data has immense value for SEO community as it helps marketing professionals to better understand the fundamental algorithms of the world's largest search engines so that they could optimize websites accordingly. Every 24 hours our crawler visits over 6 billion web pages and updates Ahrefs’ index every 15-30 minutes.

Looking around, I see we're not the only ones to have this issue:

Quote
Not sure when Ahrefs went dark side, but with the amount it was hitting my forum I had to make it stop. It was killing everything.

And whilst it may be of value to the advertising community, I'm not sure what value if any it adds to our site.

They describe themselves as a "good bot":
Quote
According to a recent third-party study of “good bots”, AhrefsBot is the second most active crawler after Googlebot.
Now - Googlebot is certainly most welcome ... but in our site is far less active than AhrefsBot - averaging about 6,000 requests per day, with a peak of just over 10,000.   Me thinks that the AHRefsBots folks describe themselves as a "good bot" in the hope that none-technical people will believe them.   As far as we're concerned, they're aggressive users of bandwidth for purposes of their own business profit - harvesting data the harvesting of which is no use to us.  And indeed they've been so aggressive that they caused a great deal of worry while I was supposed to be forgetting everything for a week's holiday!

Logged

TransWilts Rail - Linking North to West and South 9 times a day. [see here]
grahame
Administrator
Hero Member
*****
Posts: 20594



View Profile WWW Email
« Reply #5 on: May 20, 2018, 08:45:42 am »

Unscheduled outage from about 04:30 for about 3 and a half hours - sorry folks.  My alarms went off but I was sleeping like a log.     Since the Ahrefs bot problems described a week ago and the banning of that naughty bot, the server has returned to a much more stable state.   I have been watching but refraining from making other adjustments until convinced with a good degree of certainty that it really was that loading that gave the truly massive problems I had the previous week.  Once I did wake, fix was minutes rather than hours and I would have wasted time (and left debris) had I shifted to our backup status page on another server.  So decision was few more minutes of no data for a quicker return.

Also been watching things like Google Analytics to ensure that there were no indirect consequences of banning the bot, and I'm delighted to confirm that telling it to go away has - thus far - had zero effect on visits.   Big sigh of relief as it confirm that Analytics data is a meaningful statistic.
Logged

TransWilts Rail - Linking North to West and South 9 times a day. [see here]
grahame
Administrator
Hero Member
*****
Posts: 20594



View Profile WWW Email
« Reply #6 on: May 24, 2018, 10:19:46 pm »

I will be rebuilding some tables overnight after the backup system has started to play up in last hour.  Tiny chance of losing late evening posts.
Logged

TransWilts Rail - Linking North to West and South 9 times a day. [see here]
Chris from Nailsea
Administrator
Hero Member
*****
Posts: 17371


I am not railway staff


View Profile Email
« Reply #7 on: May 25, 2018, 01:44:44 am »

As ever, grahame, may we offer you our very grateful thanks for your sterling efforts - usually behind the scenes - in maintaining the Coffee Shop forum.  Wink Cheesy

Logged

William Huskisson MP was the first person to be killed by a train while crossing the tracks, in 1830.  Many more have died in the same way since then.  Don't take a chance: stop, look, listen.

"Level crossings are safe, unless they are used in an unsafe manner."  Discuss.
grahame
Administrator
Hero Member
*****
Posts: 20594



View Profile WWW Email
« Reply #8 on: May 25, 2018, 01:55:07 am »

I will be rebuilding some tables overnight after the backup system has started to play up in last hour.  Tiny chance of losing late evening posts.

As ever, grahame, may we offer you our very grateful thanks for your sterling efforts - usually behind the scenes - in maintaining the Coffee Shop forum.  Wink Cheesy

I feel a bit of a fraud tonight ... no need to to do the rebuild in the end.
Logged

TransWilts Rail - Linking North to West and South 9 times a day. [see here]
Chris from Nailsea
Administrator
Hero Member
*****
Posts: 17371


I am not railway staff


View Profile Email
« Reply #9 on: May 25, 2018, 02:16:34 am »

No worries - you can credit our collective thanks to your previous sleepless nights instead. Wink

Logged

William Huskisson MP was the first person to be killed by a train while crossing the tracks, in 1830.  Many more have died in the same way since then.  Don't take a chance: stop, look, listen.

"Level crossings are safe, unless they are used in an unsafe manner."  Discuss.
Adelante_CCT
TransWilts Member
Hero Member
******
Posts: 1010



View Profile
« Reply #10 on: May 25, 2018, 08:37:13 pm »

I will be rebuilding some tables overnight....


Logged
bobm
Administrator
Hero Member
*****
Posts: 6524



View Profile
« Reply #11 on: May 25, 2018, 09:33:42 pm »

My pet hate.  Always seem to end up with bits left over.
Logged
grahame
Administrator
Hero Member
*****
Posts: 20594



View Profile WWW Email
« Reply #12 on: May 25, 2018, 09:48:41 pm »

My pet hate.  Always seem to end up with bits left over.

Pocket screws ... the ones you put in your pocket after you've rebuilt the table?
Logged

TransWilts Rail - Linking North to West and South 9 times a day. [see here]
Do you have something you would like to add to this thread, or would you like to raise a new question at the Coffee Shop? Please [register] (it is free) if you have not done so before, or login (at the top of this page) if you already have an account - we would love to read what you have to say!

You can find out more about how this forum works [here] - that will link you to a copy of the forum agreement that you can read before you join, and tell you very much more about how we operate. We are an independent forum, provided and run by customers of Great Western Railway, for customers of Great Western Railway and we welcome railway professionals as members too, in either a personal or official capacity. Views expressed in posts are not necessarily the views of the operators of the forum.

As well as posting messages onto existing threads, and starting new subjects, members can communicate with each other through personal messages if they wish. And once members have made a certain number of posts, they will automatically be admitted to the "frequent posters club", where subjects not-for-public-domain are discussed; anything from the occasional rant to meetups we may be having ...

 
Pages: [1]
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.2 | SMF © 2006-2007, Simple Machines LLC Valid XHTML 1.0! Valid CSS!
This forum is provided by a customer of Great Western Railway (formerly First Great Western), and the views expressed are those of the individual posters concerned. Visit www.gwr.com for the official Great Western Railway website. Please contact the administrators of this site if you feel that the content provided by one of our posters contravenes our posting rules (email link). Forum hosted by Well House Consultants