You are not logged in.

1

Wednesday, January 25th 2012, 7:58am

3.1.7 Suggestion

I would like to deny forum access for all Guest users, but doing this keeps Search Bots from viewing my content which is not good for SEO purposes. I would like to suggest that WBB 3.1.7 have an option to allow Search Bots their own user group so I can allow Search Bots access to my site.

Thanks :)

2

Wednesday, January 25th 2012, 9:43pm

If search bots can index your forum but normal users can't, it's called "black hat SEO". If you use "black hat SEO" (forbidden SEO), it's possible for you'll to be banned from search indexes.
Thus, it will be impossible to integrate such a feature in a future version.
Mit freundlichen Grüßen
Best regards
KittBlog Stile - Ihr Kit für Stile, Software und Knowhow
Your kit for styles, software and knowhow
Erste Linkliste zu Erweiterungen und Support rund um Burning Board©
First linklist for plugins and support around Burning Board©

  • "Netzwerg" is male

Posts: 5,170

Location: Ruhrpott

Occupation: Student

  • Send private message

3

Wednesday, January 25th 2012, 11:07pm

A search bot IS a guest. What you wan't to do is cheat, in making the bot belive your content is available, while it is not. Most search engine don't really like this and you geat easily banned for that. Moreover, i don't think that woltlab likes cheaters, therefore i don't really think this will be implemented. You want to get registrations up? provide something the user wants to _contribute_ to. Because forcing users to register only to view the content only produces many, many inactive accounts. And havin inactive accounts is not really the goal, is it?

Oh, and new features were only introduced in new major version (this would be WBB 4.0), and not in security updates.
Best regards,
Sebastian Teumert

4

Thursday, January 26th 2012, 1:34am

There are many forums, hundreds infact, which allow access to Google but force people to register to view.
I don't see why this is considered bad?

RouL

Sage

  • "RouL" is male

Posts: 4,169

Occupation: computer scientist in application development

  • Send private message

5

Thursday, January 26th 2012, 6:00am

Google is checking that and bans those sites from the Google index after some time.
MfG RouL (马库斯) [ Blog | Twitter ]

Meine Plugins [ WoltLab Pluginstore | WBB3Addons ]
Entwickler Links [ WCF Entwickler Tutorial ]
Probleme mit Spam? reCAPTCHA!
Kein Support per PN oder Messenger.

6

Thursday, January 26th 2012, 9:13am

Netzwerg sad, what's bad in such configurations.
And yes, this configuration is very common, above all in the USA and in UK, however it's not allowed by search engines.

It is fact that search engines don't want a special treatment and thus it is normal that they will be handled as normal guests. Otherwise, it is a special treatment, thich is simply not allowed.
Mit freundlichen Grüßen
Best regards
KittBlog Stile - Ihr Kit für Stile, Software und Knowhow
Your kit for styles, software and knowhow
Erste Linkliste zu Erweiterungen und Support rund um Burning Board©
First linklist for plugins and support around Burning Board©

  • "Netzwerg" is male

Posts: 5,170

Location: Ruhrpott

Occupation: Student

  • Send private message

7

Thursday, January 26th 2012, 9:29am

I don't see why this is considered bad?

A search engine shows the user content that is publicly available. If that content is not publicly available, but you make it appear to the search engine as if it was, then you cheat. You don't think that is a questionable way of doin things?

Besides, you only annoy people with that. Maybe they will make an account on your site to see the content. Maybe they will even use a trashmail for that (and don't bother, you will never manage to ban all trash mail providers), then they will see what they want and will most likely never come back. Congrats, you have a new dead account in your system. The other thing is that someone who is annoyed is nt likely to come back to your site. He will use the search engine again when he has a similar problem and then most likely visit another site. But if he was pleased with what he found at your site, he might considered searching for a solution to a related problem directly on your site.

And as i said, is the goal of a community not to have _active_ members, members that feel comfortable on your plattform and contribute to it, instead of just bloating the members list with dead accounts?

And last but not least:
You can fake browser strings yourself. Cheating at your board and making it believe your a bot is not that hard at all. Because technically a bot is just someone who browses your board without logging in. I can do the exact same thing and your board believes I#m a bot. And i see all your nice content that you wanted to hide.

If you take all that into account, i don't think such a function will be implemented. Besides, you _could_ possibly write a plugin for that. You can check wether a user is a spider with an event listener and generate a session for it if you want to. So way every bot could be logged in and have rights from a user. you could place this user in a separate user group and be just fine.
Best regards,
Sebastian Teumert

Daddi

Professional

  • "Daddi" is male

Posts: 1,050

Location: Berlin

Occupation: Web Entwickler / Student (AI)

  • Send private message

8

Thursday, January 26th 2012, 8:02pm

There is no way to allow bots to see the content, while normal visitors can't see the content. :)
It just takes seconds to fake your "User-Agent" and thats mostly everything that's different to a normal visitor.

Synoxis

Moderator

  • "Synoxis" is male

Posts: 13,381

Occupation: Webdesigner

  • Send private message