Started By
Message

re: Facebook Seems to be Down

Posted on 10/4/21 at 2:36 pm to
Posted by Roll Tide Ravens
Birmingham, AL
Member since Nov 2015
42277 posts
Posted on 10/4/21 at 2:36 pm to
I'm noticing that Twitter is starting to have issues.
This post was edited on 10/4/21 at 2:37 pm
Posted by CGSC Lobotomy
Member since Sep 2011
80096 posts
Posted on 10/4/21 at 2:37 pm to
quote:

What's odd though is that should be an easy revert to previous config, not a multi-hour total outage.


What if they hadn't changed their routes in decades because they didn't imagine THEY would be a target?

Also, they could have MPLS chokepoints that got attacked.
Posted by Centinel
Idaho
Member since Sep 2016
43334 posts
Posted on 10/4/21 at 2:38 pm to
quote:

What if they hadn't changed their routes in decades because they didn't imagine THEY would be a target?

Also, they could have MPLS chokepoints that got attacked.


Ya, it's odd that they've been down this long. The longer this goes on, the less likely it's just an inside "oops".
Posted by Korkstand
Member since Nov 2003
28707 posts
Posted on 10/4/21 at 2:40 pm to
quote:

If they sporked the BGP routes, the routers that bookface uses to connect to the web would have no idea how to route traffic in and out of their data centers.

What's odd though is that should be an easy revert to previous config, not a multi-hour total outage.
They're two-blocked because they do the config remotely, and now they don't have remote access to the routers. And I think the people on-site either don't have access or the knowledge to fix it.
Posted by udtiger
Over your left shoulder
Member since Nov 2006
98702 posts
Posted on 10/4/21 at 2:40 pm to
Hate to see it happen
Posted by CGSC Lobotomy
Member since Sep 2011
80096 posts
Posted on 10/4/21 at 2:41 pm to
quote:

Hate to see it happen


You should, because this could be a vector to go after banking and investment sites.
Posted by BluegrassBelle
RIP Hefty Lefty - 1981-2019
Member since Nov 2010
98968 posts
Posted on 10/4/21 at 2:42 pm to
quote:

They're two-blocked because they do the config remotely, and now they don't have remote access to the routers. And I think the people on-site either don't have access or the knowledge to fix it.



That would be insane considering the size of FB. I know the SO has gone on site a few times when remote access has gone down/been compromised. But to not have anyone who knows how to fix it? That’s nuts right?
Posted by BluegrassBelle
RIP Hefty Lefty - 1981-2019
Member since Nov 2010
98968 posts
Posted on 10/4/21 at 2:43 pm to
quote:

Hate to see it happen


This shite is generally practice (if hacked) to hit into larger, more important infrastructure shite.
Posted by adp
Member since Jul 2015
2735 posts
Posted on 10/4/21 at 2:45 pm to
Suburban moms and can't get dick girls will be displaced but will go to instagram competing with models! haha
Posted by Pettifogger
Capitol Hill Autonomous Zone
Member since Feb 2012
79188 posts
Posted on 10/4/21 at 2:46 pm to
Twitter and Tik Tok need to go toward the light
Posted by CGSC Lobotomy
Member since Sep 2011
80096 posts
Posted on 10/4/21 at 2:47 pm to
quote:

Suburban moms and can't get dick girls will be displaced but will go to instagram competing with models! haha


You do know that EVERYTHING under the Facebook name is down, including WhatsApp and Instagram, right?
Posted by adp
Member since Jul 2015
2735 posts
Posted on 10/4/21 at 2:50 pm to
I know that.
Posted by Noryev
Member since Aug 2018
953 posts
Posted on 10/4/21 at 2:51 pm to
quote:

This is a DNS fault, just not sure why

If it was DNS causing the issue, wouldn’t the IP work for connecting?
Posted by Centinel
Idaho
Member since Sep 2016
43334 posts
Posted on 10/4/21 at 2:52 pm to
On the brighter side, there are bound to be multiple network engineer jobs opening up at Facebook soon....
Posted by BluegrassBelle
RIP Hefty Lefty - 1981-2019
Member since Nov 2010
98968 posts
Posted on 10/4/21 at 2:56 pm to
Considering the clown show it sounds like, gonna be a hard pass if that was my profession.
Posted by ShaneTheMaster
Tampa, FL
Member since Nov 2009
2929 posts
Posted on 10/4/21 at 2:56 pm to
It’s only down for Republicans
Posted by FreddieMac
Baton Rouge
Member since Jun 2010
20990 posts
Posted on 10/4/21 at 2:56 pm to
quote:

network engineer jobs opening up at Facebook soon....


so, who would want to work for that evil empire.
Posted by Centinel
Idaho
Member since Sep 2016
43334 posts
Posted on 10/4/21 at 3:11 pm to
A technical explanation of what's going on with BookFace right now. I've pasted the text below, but it's cleaned up better if you go to the link:

SANS Internet Storm Center

quote:

Here is a quick view of what may have happened.

1 - Does facebook.com resolve?

% host facebook.com
facebook.com has address 31.13.79.35
facebook.com has IPv6 address 2a03:2880:f141:82:face:b00c:0:25de
facebook.com mail is handled by 2560 smtpin.vvv.facebook.com.


% host www.facebook.com
www.facebook.com is an alias for star-mini.c10r.facebook.com.
star-mini.c10r.facebook.com has address 31.13.88.35
star-mini.c10r.facebook.com has IPv6 address 2a03:2880:f138:83:face:b00c:0:25de
Yes! (at least for me, it does). But was that just a cached response? Let's follow the DNS chain.

2. What is the NS record for facebook.com according to the .com zone?

(abbreviated output)



% dig NS facebook.com @h.gtld-servers.net


;; AUTHORITY SECTION: facebook.com. 172800 IN NS a.ns.facebook.com. facebook.com. 172800 IN NS b.ns.facebook.com. facebook.com. 172800 IN NS c.ns.facebook.com. facebook.com. 172800 IN NS d.ns.facebook.com. ;; ADDITIONAL SECTION: a.ns.facebook.com. 172800 IN A 129.134.30.12 a.ns.facebook.com. 172800 IN AAAA 2a03:2880:f0fc:c:face:b00c:0:35 b.ns.facebook.com. 172800 IN A 129.134.31.12 b.ns.facebook.com. 172800 IN AAAA 2a03:2880:f0fd:c:face:b00c:0:35 c.ns.facebook.com. 172800 IN A 185.89.218.12 c.ns.facebook.com. 172800 IN AAAA 2a03:2880:f1fc:c:face:b00c:0:35 d.ns.facebook.com. 172800 IN A 185.89.219.12 d.ns.facebook.com. 172800 IN AAAA 2a03:2880:f1fd:c:face:b00c:0:35
3. Let's use one of these NS records

% dig NS facebook.com @129.134.30.12
; <<>> DiG 9.10.6 <<>> NS facebook.com @129.134.30.12
;; global options: +cmd
;; connection timed out; no servers could be reached
4. So let's see why we can't reach these servers

% traceroute 129.134.30.12
traceroute to 129.134.30.12 (129.134.30.12), 64 hops max, 52 byte packets
1 [redacted] 0.628 ms 0.159 ms 0.101 ms
2 [redacted] 2.333 ms 1.715 ms 1.706 ms
3 96.120.21.201 (96.120.21.201) 9.123 ms 10.691 ms 10.338 ms
4 96.110.66.37 (96.110.66.37) 9.254 ms 8.754 ms 10.311 ms
5 ae-13-ar02.westside.fl.jacksvil.comcast.net (68.86.168.1) 9.332 ms 11.930 ms 9.746 ms
6 be-33622-cs02.56marietta.ga.ibone.comcast.net (96.110.43.117) 23.797 ms
7 be-2112-pe12.56marietta.ga.ibone.comcast.net (96.110.33.178) 24.322 ms
8 * * *
So Comcast doesn't know how to reach Facebook. Well... BGP should tell them

5. Let's check with a BGP Looking Glass

show router bgp routes 129.134.0.0/16 ipv4 hunt
===============================================================================
BGP Router ID:4.69.178.225 AS:3356 Local AS:3356
===============================================================================
Legend -
Status codes : u - used, s - suppressed, h - history, d - decayed, * - valid
l - leaked, x - stale, > - best, b - backup, p - purge
Origin codes : i - IGP, e - EGP, ? - incomplete

===============================================================================
BGP IPv4 Routes
===============================================================================
No Matching Entries Found.
===============================================================================
So looks like the route is gone. Oh well. Enjoy while it lasts.
Posted by Motorboat
At the camp
Member since Oct 2007
22677 posts
Posted on 10/4/21 at 3:14 pm to
I should have learned to code because what you posted may as well be Mandarin Chinese
Posted by siliconvalleytiger
Bay Area, CA
Member since Apr 2004
31157 posts
Posted on 10/4/21 at 3:14 pm to
Seems weird for Facebook, Instagram and WhatsApp to all go down together. FB has different platforms for each with their own servers and data centers.

Very weird.
first pageprev pagePage 5 of 7Next pagelast page

Back to top
logoFollow TigerDroppings for LSU Football News
Follow us on Twitter, Facebook and Instagram to get the latest updates on LSU Football and Recruiting.

FacebookTwitterInstagram