- My Forums
- Tiger Rant
- LSU Recruiting
- SEC Rant
- Saints Talk
- Pelicans Talk
- More Sports Board
- Fantasy Sports
- Golf Board
- Soccer Board
- O-T Lounge
- Tech Board
- Home/Garden Board
- Outdoor Board
- Health/Fitness Board
- Movie/TV Board
- Book Board
- Music Board
- Political Talk
- Money Talk
- Fark Board
- Gaming Board
- Travel Board
- Food/Drink Board
- Ticket Exchange
- TD Help Board
Customize My Forums- View All Forums
- Show Left Links
- Topic Sort Options
- Trending Topics
- Recent Topics
- Active Topics
Started By
Message
re: Daily COVID Updated as of 11/2/20 8:00 PM
Posted on 5/27/20 at 3:28 pm to Chromdome35
Posted on 5/27/20 at 3:28 pm to Chromdome35
I finally got screen scraping to work so I could pull some numbers from the WoM site. I made the header of the tracker look like this
This shows you New Cases and Deaths for the day from WoM along with a comparison to the previous day which shows as Down or UP X from the previous day.
I also added a WoM States reporting so we could see how many states currently have reported numbers on the WoM site. Just because a state has updated, doesn't mean they won't update again during the day. Florida, Georgia and NY all seem to update more than once a day.
The screen scrape runs once an hour on the hour.
This shows you New Cases and Deaths for the day from WoM along with a comparison to the previous day which shows as Down or UP X from the previous day.
I also added a WoM States reporting so we could see how many states currently have reported numbers on the WoM site. Just because a state has updated, doesn't mean they won't update again during the day. Florida, Georgia and NY all seem to update more than once a day.
The screen scrape runs once an hour on the hour.
This post was edited on 5/27/20 at 3:29 pm
1
Posted on 5/28/20 at 8:08 pm to Chromdome35
quote:
I finally got screen scraping to work so I could pull some numbers from the WoM site.
If you don't mind my asking, did you write all the screen scraping code yourself, or did you use some tools from the internet?
Also, apologies if you know this already, but some sites are kind of sensitive about screen scrapers. I've done it from maybe a dozen sites over the last 15-20 years, ranging from US govt to football data pages, and if you hit too many pages too fast, some of them will block you. Sometimes it helps to put a timer in between page hits so you look more like a regular user.
Page 1 of 1
Popular
Back to top
Follow TigerDroppings for LSU Football News