- My Forums
- Tiger Rant
- LSU Recruiting
- SEC Rant
- Saints Talk
- Pelicans Talk
- More Sports Board
- Fantasy Sports
- Golf Board
- Soccer Board
- O-T Lounge
- Tech Board
- Home/Garden Board
- Outdoor Board
- Health/Fitness Board
- Movie/TV Board
- Book Board
- Music Board
- Political Talk
- Money Talk
- Fark Board
- Gaming Board
- Travel Board
- Food/Drink Board
- Ticket Exchange
- TD Help Board
Customize My Forums- View All Forums
- Show Left Links
- Topic Sort Options
- Trending Topics
- Recent Topics
- Active Topics
Started By
Message
Who's crawling my website (besides Google)??
Posted on 1/19/15 at 12:15 pm
Posted on 1/19/15 at 12:15 pm
My page tracker keeps returning this result:
Is Amazon getting into the Search Engine business?? Who else could this be? And it's always from Ashburn, VA.
I also get frequent visits from these guys:
Is Amazon getting into the Search Engine business?? Who else could this be? And it's always from Ashburn, VA.
I also get frequent visits from these guys:
This post was edited on 1/19/15 at 12:18 pm
4
Posted on 1/19/15 at 12:23 pm to tigerpawl
probably something with amazon web services
Posted on 1/19/15 at 12:26 pm to mctiger1985
quote:I understand that, but how would it benefit them by indexing my webpages?
probably something with amazon web services
Posted on 1/19/15 at 12:27 pm to tigerpawl
Well, Amazon has loads of AWS customers, and any of them could be crawling sites. And the second one could just be an error, because I looked up both those IPs and the majority say they are both for Amazon, but Merck is sprinkled in for both of them.
Posted on 1/19/15 at 1:01 pm to tigerpawl
NSA
Posted on 1/19/15 at 1:04 pm to colorchangintiger
quote:Can I tell you - that was my first thought when I saw "Virginia".
NSA
Posted on 1/19/15 at 1:05 pm to tigerpawl
If you have nothing to hide, there's no need to worry
Posted on 1/19/15 at 1:09 pm to Korkstand
quote:Only when I move my daily $Million to the Caymans or call cousin Ahkmed. Oh shite...
If you have nothing to hide, there's no need to worry
Posted on 1/19/15 at 2:22 pm to tigerpawl
One of my friends used to run a little conspiracy theory blog. He then noticed all of his traffic was being routed through the pentagon so he shut the blog down.
Posted on 1/19/15 at 4:34 pm to tigerpawl
quote:
NSA
Can I tell you - that was my first thought when I saw "Virginia".
NSA is in Maryland. CIA is in Virginia.
Posted on 1/19/15 at 5:17 pm to AUin02
quote:A stone's throw. In a technical sense, next door neighbors.
NSA is in Maryland. CIA is in Virginia.
Posted on 1/19/15 at 6:30 pm to tigerpawl
It's probably these guys.
quote:
Our DC data centers, located in Ashburn, VA, and Vienna, VA, are strategic communications hubs for the eastern United States.
quote:
Direct connect available to Amazon Web Services
Posted on 1/19/15 at 6:39 pm to foshizzle
Maybe I'm just a little slow on the draw, but what's the point of them dinging my pages?
Posted on 1/19/15 at 7:36 pm to tigerpawl
No idea. Maybe some computer operator employed there is just bored and decided exploring your site was more interesting than playing Candy Crush on his phone.
Posted on 1/19/15 at 7:44 pm to foshizzle
Notice that the OS from Ashburn is Linux. Just might be a bored operator.
The guy who is using an iPhone is trying to get past his employer's connection. Are you serving porn?
The guy who is using an iPhone is trying to get past his employer's connection. Are you serving porn?
Posted on 1/19/15 at 8:36 pm to foshizzle
quote:But the screen resolution is "unknown", suggesting that it's a monitor-less bot.
Notice that the OS from Ashburn is Linux. Just might be a bored operator.
Posted on 1/20/15 at 5:08 am to tigerpawl
Maybe it's me.
Posted on 1/20/15 at 10:45 am to foshizzle
Two more hits today. 1 minute apart; 2 different IP addresses. No monitor info. Their Chrome is 10 versions behind the times.
Posted on 1/20/15 at 3:40 pm to tigerpawl
what the hell are you hosting because you have their attention. 
Posted on 1/20/15 at 4:19 pm to tigerpawl
It could be a competitor/customer/link acquirer that's using an Amazon hosted proxy server to check out your site. It could also be one of many web marketing/search engine optimization services hosted on Amazon. There are a lot of companies that have their own index of the web so I can go to their site and see information about my site, what terms I'm targeting, links to/from my site, etc. or my competitors sites.
Page 1 of 2
Popular
Back to top
Follow TigerDroppings for LSU Football News