- My Forums
- Tiger Rant
- LSU Recruiting
- SEC Rant
- Saints Talk
- Pelicans Talk
- More Sports Board
- Fantasy Sports
- Golf Board
- Soccer Board
- O-T Lounge
- Tech Board
- Home/Garden Board
- Outdoor Board
- Health/Fitness Board
- Movie/TV Board
- Book Board
- Music Board
- Political Talk
- Money Talk
- Fark Board
- Gaming Board
- Travel Board
- Food/Drink Board
- Ticket Exchange
- TD Help Board
Customize My Forums- View All Forums
- Show Left Links
- Topic Sort Options
- Trending Topics
- Recent Topics
- Active Topics
Started By
Message
Potentially dumb questions about searching the web from a late gen Xer
Posted on 10/6/23 at 8:39 am
Posted on 10/6/23 at 8:39 am
If I wanted to search a particular website's database of old text based records, and those records seemed to not be coming up using "site:" on google, what is the easiest way to accomplish that? Is there another search engine that might work or do I need to set up a custom web crawler? And why wouldn't it come up with "site:" on google ? Does google exclude stuff that looks archival so it doesn't clutter up the results?
Posted on 10/6/23 at 9:08 am to SpidermanTUba
quote:
a particular website's database of old text based records
Search engines catalog web pages, so database results may not be available depending on how that website outputs the data.
quote:
Does google exclude stuff that looks archival so it doesn't clutter up the results?
If these are results you used to be able to find, it's possible the website deleted those pages so they are no longer in Google. It's also possible that Google isn't showing the results because it's a big company or government agency that doesn't want it's stuff found.
If it's old enough to have been removed, see if you can find it in the wayback machine LINK /
If it's something you think Google might be hiding, try the site: search on another search engine like duckduckgo
This post was edited on 10/6/23 at 9:09 am
Popular
Back to top
