nesdev google refresh test
This is an archive of a topic from NESdev BBS, taken in mid-October 2019 before a server upgrade.
View original topic
NESdev BBS
>
Other
>
Test Forum
nesdev google refresh test
by
neviksti
on
2008-07-19
(
#35061
)
I'm curious how fast google notices this page.
...
or follows links to already cached pages at zsnes?
...
A
B
C
D
...
or already cached pages at nesdev
...
E
...
by
atari2600a
on
2008-07-19
(
#35080
)
I thought /bbs/ had a robots.txt shielding the forums from google...
by
tepples
on
2008-07-20
(
#35087
)
atari2600a wrote:
I thought /bbs/ had a robots.txt shielding the forums from google...
It used to.
Discussion
by
neviksti
on
2008-07-31
(
#35398
)
Well, the answer seems to be 5 days:
http://64.233.167.104/search?q=cache:6m ... faf320cec2
Wow, that is fast.
It however doesn't appear to follow the links in the messages and update the cache for those.
Well, that's it I guess.