Should I put forum topics in my sitemap?
I have a startup website with a forum. Should I put each thread in my file sitemap.xml
, or will Google just find links to each thread through the forum itself? Don't worry: it doesn't require registration to read the forum.
If so, what is the best way to keep him informed? Doing it manually is obviously not an option for this amount of data.
One way I looked at was to write Apache mod_rewrite
that redirects requests to sitemap.xml
to navigate to sitemap.php
, which then generated the whole thing on the fly.
Another way I can think of is to create a cron job to create the map and upload the file to a file once a day. Are these good options, what else can I do?
source to share
If you have a good structure, Google will most likely find your streams, but it is always a good idea to put all your pages in an XML sitemap, as Google crawls your site more often than not.
As for the generation method, I would suggest a PHP-script that just fetches the entire stream and then caches it for X minutes, depending on the server load.
source to share
Depends on the number of sites. Too many entries in your sitemap.xml file can be counterproductive.
If you have a huge forum, your best bet is to build your sitemap.xml dynamically. Rewriting .xml to .php and having a script solve that list in your sitemap sounds like a good way to handle this.
Topics with high activity or those that contain desired keywords should be listed, others (e.g. new streams, empty streams, or streams that do not provide important content) may be omitted. For sitemap.xml, sometimes less.
source to share