iSONEWS

General => Website Feedback => Topic started by: g on January 09, 2013, 03:12:03 PM

Title: Archive.org block
Post by: g on January 09, 2013, 03:12:03 PM

I was checking archive.org wayback machine, and isonews is sadly blocked wayback (http://web-beta.archive.org/web/*/http://www.theisonews.com/)

Now there isn't even a robots.txt file on this domain, but I'm curious if something can be done about this. Only a person who operates the site would be able to fix it. Isonews and the early days is a piece of internet history, would be sad if it would be blocked from the archive forever. Even if the site is up now, archive has the old designs and first looks and stuff. Or at least, hopefully they didn't delete those now.

Title: Re: Archive.org block
Post by: Shwaggy on January 09, 2013, 03:54:23 PM

I renamed the robots.txt awhile back and Google has adjusted by now. I will try contacting them.

Title: Re: Archive.org block
Post by: Shwaggy on January 09, 2013, 03:59:28 PM

Looked into it a bit, I fixed the robots thing a few months back and their FAQ says it could take over 6 months to crawl/register again. We got plenty of time, hosting isn't going anywhere anytime soon.

Title: Re: Archive.org block
Post by: g on January 09, 2013, 04:46:53 PM

OK cool, thanks for looking into it.