In addition to Google, Bing and Majestic 12 bots, and a Baidu spider, we now also have a Heritrix crawler.
No screenshot because I'm at my phone atm.
And now we have a crawler
-
Archduke Daynel, PhD
- Rear Admiral
- Posts:1940
- Joined:Thu Dec 06, 2012 1:18 pm
- Affiliation:ZIF
BASH THE FASH CLASS WAR NOW
-
Ivan2006
- Fleet Admiral
- Posts:3021
- Joined:Fri Dec 07, 2012 12:10 pm
- Affiliation:[redacted]
- IGN:Ivan2006
- Location:In a universe.
- Contact:
Re: And now we have a crawler
Quotes:
Spoiler:
Re: And now we have a crawler
But, spider is here right now... watching.
EDIT: Here
EDIT: Here
"The Sky is the Limit"
Commander Error wrote:"Titan" - Moves slightly quicker than a glacier, on a good day.
Prototype wrote:F-14s are just gay Tornados.
Catsonmeth wrote:Which meant every two weeks, Tuesday night was reserved for mainlining coffee and getting sensual with a keyboard
-
Prototype
- Developer
- Posts:2968
- Joined:Fri Dec 07, 2012 1:25 am
- Affiliation:NSCD
- IGN:Currently:Small_Bear
- Location:Yes
Re: And now we have a crawler
What? A Heretic crawler?
HERESY!
HERESY!
Spoiler:
Mistake Not... wrote: This isn't rocket science, *!
Spoiler:
-
Vinyl
- Fleet Admiral
- Posts:3217
- Joined:Wed Dec 05, 2012 9:54 pm
- Affiliation:Hexalan
- IGN:PCaptainRexK
- Location:Hexalan
Re: And now we have a crawler
prototype wrote:What? A Heretic crawler?
HERESY!
cats wrote:I literally cannot be wrong about this fictional universe