Board index › Administration › WrongPlanet.net discussion

Website Offline, No Cached Version Available

Page 5 of 7 [ 110 posts ]  Go to page Previous  1, 2, 3, 4, 5, 6, 7  Next

Previous topic | Next topic

nat4200
Veteran
Veteran

User avatar

Joined: 10 Jan 2011
Gender: Male
Posts: 704
Location: BANNED

03 Apr 2012, 5:25 pm

Redacted



Last edited by nat4200 on 21 Apr 2012, 2:06 am, edited 1 time in total.

sliqua-jcooter
Veteran
Veteran

User avatar

Joined: 25 Jan 2010
Age: 38
Gender: Male
Posts: 1,488
Location: Burke, Virginia, USA

03 Apr 2012, 5:30 pm

nat4200 wrote:
sliqua-jcooter wrote:
TallyMan wrote:
Cornflake wrote:
... over the last 10 hours or so on WP.


Ten hours! Do you live here? Alex will be charging you ground rent soon.

I've only been online here for a mere 6 or so hours today.


Ahem...my server, my network. I believe I'm the one owed rent here. :P

OK, so we probably found *a* problem with how the site was working with cloudflare...but it seems that we now have a brand new set of issues to work out now. *Yaay*

Any details, for those of us playing along at home?

And, what's this talk I here 'bout charging Cornflake rent? If anything you should be doubling his mod salary in lieu of overtime / services rendered...


Basically, one of the httpd modules that provides DoS protection was misbehaving and ignoring the cloudflare whitelists. It wasn't blocking requests, it was simply enforcing rate-limits that were causing requests to be queued to the point that cloudflare gave up. It also wasn't logging anything, so we couldn't even tell this was going on. Once we unloaded the module, the mass amounts of reports on that one error stopped coming in. Now we appear to be seeing a different error being reported much less often, and conveniently we've confirmed that all other security-related httpd modules are whitelisting correctly, and also logging correctly - so this is something else entirely.


_________________
Nothing posted here should be construed as the opinion or position of my company, or an official position of WrongPlanet in any way, unless specifically mentioned.


nat4200
Veteran
Veteran

User avatar

Joined: 10 Jan 2011
Gender: Male
Posts: 704
Location: BANNED

03 Apr 2012, 5:35 pm

Redacted



Last edited by nat4200 on 21 Apr 2012, 2:03 am, edited 1 time in total.

Cornflake
Administrator
Administrator

User avatar

Joined: 30 Oct 2010
Gender: Male
Posts: 73,321
Location: Over there

03 Apr 2012, 6:18 pm

sliqua-jcooter wrote:
Basically, one of the httpd modules that provides DoS protection was misbehaving and ignoring the cloudflare whitelists. It wasn't blocking requests, it was simply enforcing rate-limits that were causing requests to be queued to the point that cloudflare gave up. It also wasn't logging anything, so we couldn't even tell this was going on.
Ooh, sneaky... 8O

nat4200 wrote:
And, what's this talk I here 'bout charging Cornflake rent? If anything you should be doubling his mod salary in lieu of overtime / services rendered...
Mod salary? :chin: What is this "salary" you speak of?


_________________
Giraffe: a ruminant with a view.


bcousins
Veteran
Veteran

User avatar

Joined: 1 May 2011
Age: 31
Gender: Male
Posts: 809
Location: On a failed Tangara set at Blacktown

03 Apr 2012, 8:39 pm

Cornflake wrote:

nat4200 wrote:
And, what's this talk I here 'bout charging Cornflake rent? If anything you should be doubling his mod salary in lieu of overtime / services rendered...
Mod salary? :chin: What is this "salary" you speak of?


Double $0...?



nat4200
Veteran
Veteran

User avatar

Joined: 10 Jan 2011
Gender: Male
Posts: 704
Location: BANNED

03 Apr 2012, 9:20 pm

Redacted



Last edited by nat4200 on 21 Apr 2012, 2:06 am, edited 1 time in total.

Cornflake
Administrator
Administrator

User avatar

Joined: 30 Oct 2010
Gender: Male
Posts: 73,321
Location: Over there

03 Apr 2012, 9:28 pm

Yep. 8)


_________________
Giraffe: a ruminant with a view.


Cornflake
Administrator
Administrator

User avatar

Joined: 30 Oct 2010
Gender: Male
Posts: 73,321
Location: Over there

06 Apr 2012, 6:32 pm

At about 00:28 BST I got the first CloudFlare error since Tue Apr 3.
The "No cached version available" error.


_________________
Giraffe: a ruminant with a view.


TenPencePiece
Veteran
Veteran

User avatar

Joined: 11 Dec 2009
Age: 31
Gender: Male
Posts: 46,009
Location: Greater Manchester, United Kingdom

07 Apr 2012, 7:36 am

*raises hand*

Just now


_________________
I'm always here, all you have to do is ask and you shall receive


Cornflake
Administrator
Administrator

User avatar

Joined: 30 Oct 2010
Gender: Male
Posts: 73,321
Location: Over there

08 Apr 2012, 7:14 pm

"No cached version available" error occurring now - first time since my previous post here.


_________________
Giraffe: a ruminant with a view.


Cornflake
Administrator
Administrator

User avatar

Joined: 30 Oct 2010
Gender: Male
Posts: 73,321
Location: Over there

17 Apr 2012, 2:34 pm

"This website is offline
No cached version is available"
Error occurring now.

Shiny new dialog, but still the same bogus error.


_________________
Giraffe: a ruminant with a view.


nat4200
Veteran
Veteran

User avatar

Joined: 10 Jan 2011
Gender: Male
Posts: 704
Location: BANNED

18 Apr 2012, 10:54 am

Redacted



Last edited by nat4200 on 19 Apr 2012, 4:12 am, edited 2 times in total.

Cornflake
Administrator
Administrator

User avatar

Joined: 30 Oct 2010
Gender: Male
Posts: 73,321
Location: Over there

18 Apr 2012, 11:12 am

nat4200 wrote:
Cornflake, I got that Cloudflare message just now, trying to make a post but it seemed to be legitimate - when I selected the try again option I was able to get to the live site.

Suggest you might clarify whether you are getting just the error or the similar issue as has previously been described where the error persists until you restart your browser.
It persisted until I restarted the browser much later.
I couldn't restart it immediately because I had several things "on the go" which had nothing to do with WP and I really didn't want to lose those.

I have never had a cached post served up to me - whenever I've tried I just get the error display refreshed, with "#" appended to the URL.
During this last error I was able to retrieve a cached forum - which was at least two days old...

Quote:
BTW: WP has been slower even than usual over the last 2-3 days... plenty of times it's been around 10 seconds before the page I was on (before navigating to another) cleared and I saw signs that the browser was receiving content. at this stage I haven't troubleshooted this further to narrow down what the additional delay might be.
I believe the very worst of that was identified as a DoS attack on CloudFlare, although the site is still slower than it was before any of these recent delays started.


_________________
Giraffe: a ruminant with a view.


nat4200
Veteran
Veteran

User avatar

Joined: 10 Jan 2011
Gender: Male
Posts: 704
Location: BANNED

18 Apr 2012, 11:27 am

Redacted



Last edited by nat4200 on 19 Apr 2012, 3:54 am, edited 1 time in total.

sliqua-jcooter
Veteran
Veteran

User avatar

Joined: 25 Jan 2010
Age: 38
Gender: Male
Posts: 1,488
Location: Burke, Virginia, USA

18 Apr 2012, 7:07 pm

nat4200 wrote:
EDIT: Also Sliqua people PLEASE consider putting an expires header on resources like images, etc. An Etag is nice but my browser still has to make to a bunch of HTTP requests to confirm the images have not changed. As the site's cookies also get sent to the WP CDN domain and are several KB in size, a single page load (even with a primed cache) results in quite a bit of data going back and fro in HTTP headers :(


We don't control the CDN or what headers it exposes, nor is it within our right to enforce an expiry header on our customers' data. Furthermore, since practically every modern browser can do concurrent requests, and we're talking about <120 bytes per request, I fail to see how this change would make any substantial difference to 90% of the visitors here.


_________________
Nothing posted here should be construed as the opinion or position of my company, or an official position of WrongPlanet in any way, unless specifically mentioned.


nat4200
Veteran
Veteran

User avatar

Joined: 10 Jan 2011
Gender: Male
Posts: 704
Location: BANNED

18 Apr 2012, 8:02 pm

Redacted



Last edited by nat4200 on 19 Apr 2012, 3:55 am, edited 2 times in total.