Bay 12 Games Forum

Dwarf Fortress => DF Gameplay Questions => DF Wiki Discussion => Topic started by: draeath on May 02, 2016, 08:20:47 pm

Title: robots.txt limit to current release namespace?
Post by: draeath on May 02, 2016, 08:20:47 pm

Is there any way we can tweak for crawlers like google, so that search results tend to point to current namespace pages instead of older ones? For example, if one searches Google for "dwarf fortress materials" the first hit that comes up is v0.34:Material, the current version equivalent is actually the third result.

I'm thinking something like this (https://www.mediawiki.org/wiki/Manual:GenerateSitemap.php) would be called for (or if already present, adjustments could stand to be made)

Title: Re: robots.txt limit to current release namespace?
Post by: Brightgalrs on May 11, 2016, 08:11:11 am

I agree, the default results should be for the latest version.

Title: Re: robots.txt limit to current release namespace?
Post by: lethosor on May 12, 2016, 09:59:59 pm

Briess/Locriani says it's hard, from what I remember. It might be possible to block older versions from search listings entirely, but that's not really something we want either. Another possibility is making a more visible "old version" warning, like at https://docs.djangoproject.com/en/1.7/