Clever Geek Handbook

Dynamic content and search engine optimization

I have a web forum that I have coded in Python for the App Engine platform. I noticed that Google is not indexing and I am trying to fix it. I used Google Webmaster to submit a Sitemap with almost 400 URLs, but apparently only 8 were indexed!
I even get a warning that:

All URLs in your Sitemap are marked with dynamic content (value "always"). Since dynamic content makes it difficult for search engines to crawl and index, it can affect your site's performance in search results. Check your sitemap to make sure your site information is correct.

One thing I am considering is the way my urls are formed. Almost all urls use arguments and I highlight every post, thread, forum, user, etc. ID.

So for example one of my forums:

http://silicon.appspot.com/readforum?id=2075

If the forum id is 2075. I heard this is bad practice, so I plan on changing this, but I'm not sure if it will make any difference. Can anyone give me some advice on how to get Google to index my entire site?

0


source to share


3 answers


The real thing to look at is for example:

 http://www.example.com/forum.py?thread=1000
 http://www.example.com/forum.py?thread=1000&mode=printer


The web crawler sees two different URLs with the same content and assumes that you are trying to do something fishy. You need to make sure that your "Print This Page" links have rel = "nofollow" in them. The goal is to have only one link to a unique dataset on your website.

Forums will of course be a duplicate content issue all the time. But for articles / blogs, you should be able to approach URLs at a 1: 1 ratio.

0


source


These statistics in Google Webmaster Tools are never updated. The following google search reveals that almost all of your sitemap urls are indexed and so you don't have a problem:



site:silicon.appspot.com
0


source


The content of the URL is part of the image, but only a small part.

If the url says readforum2106 instead of / readforum? id = 2106 does nothing unless someone searches for the word "readforum". For the URL to really help, you need to include some good search terms in the text, which just doesn't make sense for forums.

I don't think url matching will really help you. Maybe you should be looking for ways to dynamically create a sitemap?

-1


source






More articles:


All Articles