Wednesday 17 March 2010

Students' home pages are not searchable

I am not sure about other departments, but every single CS student at Seneca College has its own web page http://matrix.senecac.on.ca/~username. None of those sites can be found through the search engines because crawling's blocked by the line 7 "Disallow: /" in robots.txt file. All respectable search engines carefully follow these instructions.

Currently most students have automatically generated page which is not very informative. Some students spent time developing it only to find out that content will never be found. This fact is very disapointing.

I think that Seneca will encourage more students to develop their personal pages if it allows search engines to crawl it.