Page 1 of 1 [ 14 posts ] 

DevilKisses
Veteran
Veteran

User avatar

Joined: 3 Jul 2010
Age: 30
Gender: Female
Posts: 3,067
Location: Canada

10 May 2014, 8:11 pm

I've noticed that threads on WP get a lot of views very quickly. Most of those views are probably bots. It confused me for a while because some of my threads would have about 100 views, but only one or two replies.


_________________
Your neurodiverse (Aspie) score: 82 of 200
Your neurotypical (non-autistic) score: 124 of 200
You are very likely neurotypical


886
Veteran
Veteran

User avatar

Joined: 15 Jan 2008
Gender: Male
Posts: 6,664
Location: SLC, Utah

25 May 2014, 7:48 am

It's tough to say if they're bots or not, you get a lot of lurkers. A lot of people just want to read about asperger's, weather it's psychologists wanting to learn about how we interact, authors wanting material for their works, autistics who just like to lurk to learn social skills, or people who just read and didn't care to respond.

Having said that, advertising is a huge industry with incredible market value, don't be surprised if there are bots. :?


_________________
If Jesus died for my sins, then I should sin as much as possible, so he didn't die for nothing.


TallyMan
Veteran
Veteran

User avatar

Joined: 30 Mar 2008
Gender: Male
Posts: 40,061

25 May 2014, 7:51 am

As a site admin I get to see who is browsing the site and yes, there are lots of bots, sometimes as many as a hundred! I'd say the vast majority of page views are down to bots + unregistered guest users. There are usually far more guests browsing the site than registered members.


_________________
I've left WP indefinitely.


kraftiekortie
Veteran
Veteran

Joined: 4 Feb 2014
Gender: Male
Posts: 87,510
Location: Queens, NYC

25 May 2014, 9:12 am

What's a bot?



TallyMan
Veteran
Veteran

User avatar

Joined: 30 Mar 2008
Gender: Male
Posts: 40,061

25 May 2014, 9:15 am

kraftiekortie wrote:
What's a bot?


Robot. i.e. an automated process from sites such as Google, Yahoo, Bing etc that scan webpages to build up their search engine data. They usually have multiple bots running scanning everything that is visible to non-registered members including profiles and posts to most of the WP forums (not Members or Adult).


_________________
I've left WP indefinitely.


Cornflake
Administrator
Administrator

User avatar

Joined: 30 Oct 2010
Gender: Male
Posts: 73,341
Location: Over there

25 May 2014, 11:29 am

TallyMan wrote:
As a site admin I get to see who is browsing the site and yes, there are lots of bots, sometimes as many as a hundred!
Likewise - and one day I knocked up a few noddy scripts to try and get an idea.

At that time there were 22 registered users connected and 3,216 connections from lurkers/bots.
Before I gave up counting I found that of those 3,216 connections, 2,202 were coming from 8 unique IPs assigned to Microsoft and 428 were coming from 6 unique IPs assigned to Google.

Going by the very small number of unique IPs involved I'd say that most, if not all of these, were bots and not lurkers.
This probably goes part way to explaining why the site is under such a heavy load...


_________________
Giraffe: a ruminant with a view.


ImeldaJace
Veteran
Veteran

User avatar

Joined: 16 Jan 2014
Age: 30
Gender: Female
Posts: 622
Location: North East USA

25 May 2014, 10:55 pm

Cornflake wrote:
Going by the very small number of unique IPs involved I'd say that most, if not all of these, were bots and not lurkers.
This probably goes part way to explaining why the site is under such a heavy load...

Is there anyway to block that from happening or something to help save the site? How do other forums manage it? Are they just not stressed by the load?



wozeree
Veteran
Veteran

User avatar

Joined: 23 Aug 2013
Age: 65
Gender: Female
Posts: 2,344

26 May 2014, 12:03 am

Google picks posts up posts from websites really fast, where it used to take them days or weeks. I'm not surprised at that number of bots.



Cornflake
Administrator
Administrator

User avatar

Joined: 30 Oct 2010
Gender: Male
Posts: 73,341
Location: Over there

26 May 2014, 7:41 am

ImeldaJace wrote:
Is there anyway to block that from happening or something to help save the site? How do other forums manage it? Are they just not stressed by the load?
It's certainly possible to block them on the site's webserver but the standard method of doing this seems to be more concerned with the bot's source, not the quantity - so blocking (say) the IP address will probably have too great an effect on what they do (which in general, is a good thing and ensures that articles and WP are easily found).
I'd guess that many sites would have much less of a problem with... well, practically everything, because their forum software isn't so ancient.

wozeree wrote:
Google picks posts up posts from websites really fast, where it used to take them days or weeks. I'm not surprised at that number of bots.
Yes, it's ridiculously fast.
I thought the huge number of connections from Microsoft simply reflected the poor quality of their search engines, but then I tend to have a dim view of the activities in Redmond. :wink:


_________________
Giraffe: a ruminant with a view.


ImeldaJace
Veteran
Veteran

User avatar

Joined: 16 Jan 2014
Age: 30
Gender: Female
Posts: 622
Location: North East USA

26 May 2014, 11:04 am

Cornflake wrote:
I thought the huge number of connections from Microsoft simply reflected the poor quality of their search engines, but then I tend to have a dim view of the activities in Redmond.


This phrase is already on google :D



sliqua-jcooter
Veteran
Veteran

User avatar

Joined: 25 Jan 2010
Age: 38
Gender: Male
Posts: 1,488
Location: Burke, Virginia, USA

26 May 2014, 2:56 pm

ImeldaJace wrote:
Cornflake wrote:
Going by the very small number of unique IPs involved I'd say that most, if not all of these, were bots and not lurkers.
This probably goes part way to explaining why the site is under such a heavy load...

Is there anyway to block that from happening or something to help save the site? How do other forums manage it? Are they just not stressed by the load?


We could technically block or throttle bots, but it wouldn't do anything for the performance of the site.


_________________
Nothing posted here should be construed as the opinion or position of my company, or an official position of WrongPlanet in any way, unless specifically mentioned.


wozeree
Veteran
Veteran

User avatar

Joined: 23 Aug 2013
Age: 65
Gender: Female
Posts: 2,344

26 May 2014, 5:34 pm

Cornflake wrote:
ImeldaJace wrote:
Is there anyway to block that from happening or something to help save the site? How do other forums manage it? Are they just not stressed by the load?
It's certainly possible to block them on the site's webserver but the standard method of doing this seems to be more concerned with the bot's source, not the quantity - so blocking (say) the IP address will probably have too great an effect on what they do (which in general, is a good thing and ensures that articles and WP are easily found).
I'd guess that many sites would have much less of a problem with... well, practically everything, because their forum software isn't so ancient.

wozeree wrote:
Google picks posts up posts from websites really fast, where it used to take them days or weeks. I'm not surprised at that number of bots.
Yes, it's ridiculously fast.
I thought the huge number of connections from Microsoft simply reflected the poor quality of their search engines, but then I tend to have a dim view of the activities in Redmond. :wink:


Notice how I avoided even mentioning the MS bots? :D

I just spent half the day trying to set up a new Windows 8 computer. Set up you say, don't you just turn it on and go? Haha. It's like if you computer was a big bowl of spaghetti and meatballs - all over the place and tangled up and - no that's not even a good analogy because at least you know what to do with spaghetti and meatballs. Their mindset when they created this is beyond incomprehensible.

I love Apple, but they are not without their own issues - but nothing like this.

Ok, my vent is over! (It was half the day really, I had a reason)~ :D Plus I'm still trying to get all the updates to download. :x



Cornflake
Administrator
Administrator

User avatar

Joined: 30 Oct 2010
Gender: Male
Posts: 73,341
Location: Over there

26 May 2014, 5:54 pm

wozeree wrote:
Their mindset when they created this is beyond incomprehensible.
Often spoken of Microsoft products, I believe... :lol:


_________________
Giraffe: a ruminant with a view.


wozeree
Veteran
Veteran

User avatar

Joined: 23 Aug 2013
Age: 65
Gender: Female
Posts: 2,344

26 May 2014, 9:47 pm

Cornflake wrote:
wozeree wrote:
Their mindset when they created this is beyond incomprehensible.
Often spoken of Microsoft products, I believe... :lol:


I am now fully convinced that Bill Gates uses Apples. Because if he ever used Windows 8, he'd be like - this is stupid, I can't spend my life dealing with the problems created by this program, off with it's head! I mean if you think about it, a buggy program isn't less buggy because the guy using it runs the company or is super rich. Yep, he's an Apple man for sure.