Started By
Message

re: Daily COVID Updated as of 11/2/20 8:00 PM

Posted on 5/28/20 at 6:15 pm to
Posted by Chromdome35
NW Arkansas
Member since Nov 2010
6833 posts
Posted on 5/28/20 at 6:15 pm to
Cases up 4.4K over yesterday; however, testing was up by 168K, so even though the % positive was lower, the testing qty drove the increase in cases. Cases were down 11% from last week. The 7 day rolling average continues to decline.

Deaths were up 94 over yesterday but down 91 from last week. The 7 day rolling average for deaths still moving down rapidly.

Mortality ticked down slightly to 5.59%

I've made a few more updates to the tracker, I put a section in where you can see the total cases, deaths, & tests for the current week and each of the last 4 weeks.

I also added new sparkline graphs (the small graphs at the top) to show active cases, current hospitalizations, current ICUs and current vents. These healthcare numbers are HIGHLY suspect but I felt it was an important to the overall trend analysis.

This post was edited on 5/28/20 at 8:51 pm
Posted by roobedoo
hall summit
Member since Jun 2008
1089 posts
Posted on 5/28/20 at 6:36 pm to
So, I have this spreadsheet with empty values in column A. I want the same value to appear 10 times in 10 rows. Do I have to type it 10 times?
Posted by Chromdome35
NW Arkansas
Member since Nov 2010
6833 posts
Posted on 5/28/20 at 7:10 pm to
why don't you just copy and paste the value into the 10 rows you want it in?
Posted by auisssa
Member since Feb 2010
4173 posts
Posted on 5/28/20 at 7:42 pm to
No. Just make A2 = A1, A3 = A2, etc
Posted by roobedoo
hall summit
Member since Jun 2008
1089 posts
Posted on 5/28/20 at 8:02 pm to
Sorry, trying to make a funny! Your ability to manipulate data is so awesome.

I monitor one site for local data and your thread for national data.

Many thanks for doing this!
Posted by wdhalgren
Member since May 2013
3025 posts
Posted on 5/28/20 at 8:08 pm to
quote:

I finally got screen scraping to work so I could pull some numbers from the WoM site.


If you don't mind my asking, did you write all the screen scraping code yourself, or did you use some tools from the internet?

Also, apologies if you know this already, but some sites are kind of sensitive about screen scrapers. I've done it from maybe a dozen sites over the last 15-20 years, ranging from US govt to football data pages, and if you hit too many pages too fast, some of them will block you. Sometimes it helps to put a timer in between page hits so you look more like a regular user.
Posted by Chromdome35
NW Arkansas
Member since Nov 2010
6833 posts
Posted on 5/28/20 at 8:47 pm to
wdhalgren, Google Sheets has a function ImportHTML that will import whatever HTML into your sheet that you point it to.

In the case of the WoM data the function call looks like

=Importhtml(A1,"Table",1)

Where A1 is the cell that contains URL for the WoM site, in my case I'm using "www.worldometers.info/coronavirus/country/us/" as the URL.

The ImportHTML function will only update once an hour unless you write code to force an update. I'm good with once an hour for my purposes so I'm not worried about them noticing.

If you open google sheets and type in the formula Importrange("XXXXX://www.worldometers.info/coronavirus/country/us/","Table",1) you'll get the main data table from the WoM site. substitute https: for the XXXXX. the TD software keeps displaying it as a link instead of text

Once you have the table then it's just formulas to pull the data such as =vlookup(State, Range of the WOM table, column needed, false)

If you go to my new tracker, the WoMUSData tab has the WoM table.

OH, and the reason I said I finally got Screen Scraping to work, is that I'm a dumbass and wasn't using the importhtml function correctly.
This post was edited on 5/28/20 at 8:53 pm
Posted by wdhalgren
Member since May 2013
3025 posts
Posted on 5/28/20 at 9:30 pm to
Thanks for the info. It's nice that Google is making it easier to gather data, but what you've done putting it all together is impressive.

I've mainly used the old fashioned method where you parse the html strings yourself (using mostly C# code). It's more flexible to do it that way, but more work too. Next time maybe I'll look at Google Sheets if it's suitable.
Posted by Chromdome35
NW Arkansas
Member since Nov 2010
6833 posts
Posted on 5/29/20 at 11:44 am to
I made some MAJOR performance improvements to the tracker today. It will update much faster now when you change something. The page refresh is down to about 3 seconds now.
This post was edited on 5/29/20 at 12:45 pm
Posted by Chromdome35
NW Arkansas
Member since Nov 2010
6833 posts
Posted on 5/29/20 at 1:03 pm to
Now that the performance issues are resolved, I created a tab for each state in the SEC for my SEC brothers on the board.
Posted by TigerDoc
Texas
Member since Apr 2004
9902 posts
Posted on 5/29/20 at 3:10 pm to
The tracker is seriously cool, Chrom. The heat map is my fave.

I came across this dataviz that I thought gave a nice look at where things are changing & which directions.

Posted by the808bass
The Lou
Member since Oct 2012
111507 posts
Posted on 5/29/20 at 3:17 pm to
Blah. Increasing cases is almost useless.
Posted by Chromdome35
NW Arkansas
Member since Nov 2010
6833 posts
Posted on 5/29/20 at 6:24 pm to
This is the link to the New COVID-19 tracker that I have shared on Google Drive.
If you want to view the shared sheet, follow this link New COVID-19 Tracker
If you want to download a copy of this sheet and manipulate it follow this link Downloadable New COVID-19 Tracker
The source for the data is from https://covidtracking.com/data/

NOTE: Be sure to view the READ ME page on the new tracker

Links to the old Tracker
Chromdome's Old COVID Tracker
Chromdome's Old COVID State Tracker

Old Tracker


New Tracker










Posted by Chromdome35
NW Arkansas
Member since Nov 2010
6833 posts
Posted on 5/29/20 at 6:30 pm to
New Cases were down slightly from yesterday with the 7 day average turning more sharply downward. This is a good sign given that testing was the highest it's ever been at 492K for the day! At this testing volume, the % positive was only 4.61%.

Deaths were down 12% from yesterday and 7% Week over Week. This is the lowest Friday number of deaths since 4/3!

Mortality @ 5.58%



Posted by RadioactiveTiger
Chernobyl
Member since Aug 2007
166 posts
Posted on 5/29/20 at 6:47 pm to
I have looked at this daily since you began. I appreciate your extensive efforts and wanted to take this evening to thank you.
Posted by Chromdome35
NW Arkansas
Member since Nov 2010
6833 posts
Posted on 5/29/20 at 7:04 pm to
Thank you
Posted by Chromdome35
NW Arkansas
Member since Nov 2010
6833 posts
Posted on 5/29/20 at 7:26 pm to
I had an epiphany tonight and coverted the data grid into heat map format. It's a great way to look at the data. I'll be converting the old tracker over to this as well.

Posted by NoHoTiger
So many to kill, so little time
Member since Nov 2006
45735 posts
Posted on 5/29/20 at 7:40 pm to
quote:

Chromdome35

I'm sure I missed this somewhere...why the difference in the number of deaths in the two trackers? Is it to account for the reclassification of some by the CDC?

Thanks for all your help on this. You've done such a great job!!

I'm in for the beer fund with the gofundme is set up.
Posted by Chromdome35
NW Arkansas
Member since Nov 2010
6833 posts
Posted on 5/29/20 at 7:50 pm to
WoM and CTP have always had some differences in their numbers, even though there is a difference they track pretty close together. I built this series of graphs when I was looking at this very issue.

You can see that WOM's numbers are consistently slightly higher than CTP's, no idea why.






Posted by LSUSUPERSTAR
TX
Member since Jan 2005
16307 posts
Posted on 5/30/20 at 2:57 pm to
Do we have any data that shows the percent of cases requiring hospitalization? That would be a good one to track if the data is available. Serious cases (needing hospitalization) and deaths are the only that that really matters.

Long term they should look at the lungs of people who've had the virus and recovered to see any potential lasting effects.
first pageprev pagePage 225 of 331Next pagelast page

Back to top
logoFollow TigerDroppings for LSU Football News
Follow us on Twitter, Facebook and Instagram to get the latest updates on LSU Football and Recruiting.

FacebookTwitterInstagram