Current Events > *Provider network at work goes down*

Topic List
Page List: 1
CableZL
08/20/19 9:10:33 PM
#1:


Me: Hey, provider, the service is down. Please check.
Provider: The service is up and running
Me: No it isn't. Check further, please.

This is something I'll probably never be able to escape as long as I'm dealing with networking...
---
... Copied to Clipboard!
RdVEHfJqAvUPIbk
08/20/19 9:13:21 PM
#2:


"sir, I'm afraid I cannot send out an engineer to verify as it working from our end. If you wish to have an engineer out, it must be from the name of the account owner l"
motherfucker Read the fucking list of names who are considered owners.
"sir I cannot verify you are the owner, please tell me your pets name from when you were a child" business level support my fucking ass
---
... Copied to Clipboard!
voldothegr8
08/20/19 9:20:06 PM
#3:


Glad I don't have to deal with ISP support anymore, those fuckers are the worst. Especially AT&T
---
Oda break tracker 2019- 5 (4) | THE Ohio State: 0-0 | Oakland Raiders: 0-0
Super Mario Maker Profile: 1237-0000-0073-02FE
... Copied to Clipboard!
CableZL
08/20/19 9:20:38 PM
#4:


voldothegr8 posted...
Glad I don't have to deal with ISP support anymore, those fuckers are the worst. Especially AT&T


AT&T is the fucking worst. It took them 6 months just to upgrade our bandwidth at our corporate office. Insanity.
---
... Copied to Clipboard!
CableZL
08/20/19 9:40:10 PM
#5:


*Call provider for update*

Provider: The service is up and running
Me: I told you guys the part that wasn't working an hour ago. Do you have any updates?
Provider: No

Damn it
---
... Copied to Clipboard!
#6
Post #6 was unavailable or deleted.
CableZL
08/20/19 9:59:50 PM
#7:


Godnorgosh posted...
I'm guessing they also told you to check the CPE? That's usually how it goes here when they don't find trouble on the circuit.


One thing that's annoying me about this is that the provider has a managed router at the location and they haven't looked at that at all yet... Trying to get through to the guy managing the case via phone because going back and forth via email is not working.
---
... Copied to Clipboard!
CableZL
08/20/19 10:27:42 PM
#8:


Finally got through to the guy handling the case

He was looking at the wrong fucking location and telling me everything was working fine

Now that he has the right location, they will investigate and give me a call back

holy shit, man... 2.5 hours into the outage and we're finally past square 1... gonna be a long night
---
... Copied to Clipboard!
CableZL
08/21/19 4:00:25 AM
#9:


Ooooh, so a major outage in Houston is going on...

BUT EVERYTHING IS UP AND RUNNING, YEAAAH

assholes

I need sleep
---
... Copied to Clipboard!
ArchiePeck
08/21/19 4:12:39 AM
#10:


You really need to make some contacts higher up the food chain at their end if this is your job, dude. Fuck dealing with call centre drones on a regular basis - ask to speak to a manager and explain you're a major corporate customer or whatever.
... Copied to Clipboard!
CableZL
08/21/19 6:14:16 AM
#11:


Aaaand of course, the problem appears to be with AT&T and they aren't providing much in the way of updates... sigh
---
... Copied to Clipboard!
Rika_Furude
08/21/19 6:19:14 AM
#12:


Is there a single good ISP in the world? They are all shit in Australia as well
---
... Copied to Clipboard!
CableZL
08/21/19 6:57:41 AM
#13:


Rika_Furude posted...
Is there a single good ISP in the world? They are all shit in Australia as well


I would say that certain providers have good service, as in their stuff rarely goes down...

Getting SUPPORT for that shit, though, when their stuff goes down

hell no
---
... Copied to Clipboard!
CableZL
08/21/19 9:56:12 AM
#14:


... Copied to Clipboard!
#15
Post #15 was unavailable or deleted.
CableZL
08/21/19 10:03:07 AM
#16:


Godnorgosh posted...
CableZL posted...
Still down...

ISP support teams are freaking dumb


"Welcome to ISP tech support, I'll transfer you to the specific team that specializes in this technology"

*on hold for 30 minutes*

"You have a technical problem? Sir, this is the billing department"


The bad thing is that it's not much better with enterprise level support

The managed services environment I "grew up" in was so much better than this crap, so maybe I just had my expectations set so much higher than they should be for the general level of support you should get for this kind of thing.
---
... Copied to Clipboard!
-Cipher-
08/21/19 10:09:32 AM
#17:


service providers should have to deduct downtimes from your bill tbh
... Copied to Clipboard!
#18
Post #18 was unavailable or deleted.
BlazinBlue88
08/21/19 10:14:53 AM
#19:


CableZL posted...
This is something I'll probably never be able to escape as long as I'm dealing with networking...

Can't you get away from this in the cloud networking space? You manage your internal network and everything else would be an Amazon or Microsoft datacenter issue for them to resolve.
---
... Copied to Clipboard!
CableZL
08/21/19 10:15:08 AM
#20:


-Cipher- posted...
service providers should have to deduct downtimes from your bill tbh


They do... And we'll definitely be getting a credit for this one
---
... Copied to Clipboard!
CableZL
08/21/19 10:15:23 AM
#21:


BlazinBlue88 posted...
CableZL posted...
This is something I'll probably never be able to escape as long as I'm dealing with networking...

Can't you get away from this in the cloud networking space? You manage your internal network and everything else would be an Amazon or Microsoft datacenter issue for them to resolve.


Still gotta have an ISP to get to the cloud

In our case, our corporate office has 6 different service providers for redundancy.

2 public internet
2 data mpls
2 voice mpls

And the data mpls can be a tertiary public internet option
---
... Copied to Clipboard!
_BIueMonk
08/21/19 10:15:46 AM
#22:


in the comcast app, you can check it to see if the network has any reported outages, but if there are none yet it just says "no internet? check and see if your cables are loose"

oh gee yeah that was it
---
... Copied to Clipboard!
BlazinBlue88
08/21/19 10:20:39 AM
#23:


CableZL posted...
BlazinBlue88 posted...
CableZL posted...
This is something I'll probably never be able to escape as long as I'm dealing with networking...

Can't you get away from this in the cloud networking space? You manage your internal network and everything else would be an Amazon or Microsoft datacenter issue for them to resolve.


Still gotta have an ISP to get to the cloud

In our case, our corporate office has 6 different service providers for redundancy.

2 public internet
2 data mpls
2 voice mpls

And the data mpls can be a tertiary public internet option

Not if your company doesn't have a physical office. Then you're just making sure your home internet is operational. Thought that situation would be a pipe dream for most.

I'm glad I do non networking infrastructure stuff. I got so tired of dealing with ISPs and their BS while my manager screams at me because the internet isn't back up yet.
---
... Copied to Clipboard!
CableZL
08/21/19 12:12:22 PM
#24:


BlazinBlue88 posted...
CableZL posted...
BlazinBlue88 posted...
CableZL posted...
This is something I'll probably never be able to escape as long as I'm dealing with networking...

Can't you get away from this in the cloud networking space? You manage your internal network and everything else would be an Amazon or Microsoft datacenter issue for them to resolve.


Still gotta have an ISP to get to the cloud

In our case, our corporate office has 6 different service providers for redundancy.

2 public internet
2 data mpls
2 voice mpls

And the data mpls can be a tertiary public internet option

Not if your company doesn't have a physical office. Then you're just making sure your home internet is operational. Thought that situation would be a pipe dream for most.

I'm glad I do non networking infrastructure stuff. I got so tired of dealing with ISPs and their BS while my manager screams at me because the internet isn't back up yet.


Yeah, I'm fortunate that I'm at a company that is willing to pay for infrastructure so that we have redundant internet almost everywhere except for buildings where a few non-public-facing employees work.

We've only had 1 day where the internet was down for the whole day at this office and that was because our primary provider was still working on construction to get to the building.
---
... Copied to Clipboard!
CableZL
08/21/19 12:13:24 PM
#25:


Primary MPLS is still down

I still have not slept

My Galaxy Note 10 arrived, though... Need to set it up...
---
... Copied to Clipboard!
CableZL
08/21/19 2:57:24 PM
#26:


"AT&T has now confirmed that there is a fiber cut 1500 feet from their central office"

AT&T employees driving to work this morning:

ZE5vdiB
---
... Copied to Clipboard!
CableZL
08/21/19 9:48:23 PM
#27:


Still down... they're working on fixing the fiber cut now, at least...
---
... Copied to Clipboard!
Simon_Petrikov
08/21/19 9:51:05 PM
#28:


On a less worrisome note, att phone/internet are down here at the house. Have to wait until saturday for someone to look at.

Tagging topic
---
Will happen, happening, happened
https://imgur.com/V0NMmmo
... Copied to Clipboard!
CableZL
08/21/19 9:54:06 PM
#29:


Still have not slept since yesterday... so much stuff to do on top of worrying about this outage...
---
... Copied to Clipboard!
kingdrake2
08/21/19 9:59:50 PM
#30:


centurylink sucked (no offense) they charged 90$ a month for 20GB internet
spectrum isn't as bad. even if they go up it won't be up as high as centurylink but better internet speed.
---
The act of treachery is an art, but the traitor himself is a piece of **** - Mike Tyson
... Copied to Clipboard!
Rexdragon125
08/21/19 10:00:50 PM
#31:


Me: I'm seeing a lot of packet loss on my second hop, at IP [x]. It seems to be on your network. It's making it really hard to play online games.

Tech support: Sir what do you mean by packet loss?

Every god damn time
... Copied to Clipboard!
CableZL
08/21/19 10:02:20 PM
#32:


Rexdragon125 posted...
Me: I'm seeing a lot of packet loss on my second hop, at IP [x]. It seems to be on your network. It's making it really hard to play online games.

Tech support: Sir what do you mean by packet loss?

Every god damn time


Literal quote from Google Fiber business support: "Advanced troubleshooting tools like ping are outside of our scope of support."
---
... Copied to Clipboard!
#33
Post #33 was unavailable or deleted.
Tyranthraxus
08/21/19 10:11:22 PM
#34:


CableZL posted...
Finally got through to the guy handling the case

He was looking at the wrong fucking location and telling me everything was working fine

Now that he has the right location, they will investigate and give me a call back

holy shit, man... 2.5 hours into the outage and we're finally past square 1... gonna be a long night


Reminds me of a conversation I once had.

Me: Did you guys block port 25?

Provider: No we don't block any ports

Me: that's weird because my email was working fine yesterday and today it's not, but it suddenly works again if I adjust the port to 2525

Provider: No we don't block any ports

Me: look I already know you're blocking the port, I just want some confirmation

Provider: no we're not blocking any ports.

Me: (hangs up)

---
It says right here in Matthew 16:4 "Jesus doth not need a giant Mecha."
https://imgur.com/dQgC4kv
... Copied to Clipboard!
fan357
08/21/19 10:13:16 PM
#35:


Go to sleep.

---
Never forget where you came from.
... Copied to Clipboard!
BlazinBlue88
08/21/19 10:20:48 PM
#36:


Tyranthraxus posted...
CableZL posted...
Finally got through to the guy handling the case

He was looking at the wrong fucking location and telling me everything was working fine

Now that he has the right location, they will investigate and give me a call back

holy shit, man... 2.5 hours into the outage and we're finally past square 1... gonna be a long night


Reminds me of a conversation I once had.

Me: Did you guys block port 25?

Provider: No we don't block any ports

Me: that's weird because my email was working fine yesterday and today it's not, but it suddenly works again if I adjust the port to 2525

Provider: No we don't block any ports

Me: look I already know you're blocking the port, I just want some confirmation

Provider: no we're not blocking any ports.

Me: (hangs up)

Why the fuck would you block port 25?
---
... Copied to Clipboard!
Tyranthraxus
08/21/19 10:35:03 PM
#37:


BlazinBlue88 posted...
Why the fuck would you block port 25?
More accurately it was blocked for any IP address that was not the provider's SMTP servers. This was / is a common practice to help fighting outgoing spam.

---
It says right here in Matthew 16:4 "Jesus doth not need a giant Mecha."
https://imgur.com/dQgC4kv
... Copied to Clipboard!
CableZL
08/21/19 10:42:01 PM
#38:


BlazinBlue88 posted...
Tyranthraxus posted...
CableZL posted...
Finally got through to the guy handling the case

He was looking at the wrong fucking location and telling me everything was working fine

Now that he has the right location, they will investigate and give me a call back

holy shit, man... 2.5 hours into the outage and we're finally past square 1... gonna be a long night


Reminds me of a conversation I once had.

Me: Did you guys block port 25?

Provider: No we don't block any ports

Me: that's weird because my email was working fine yesterday and today it's not, but it suddenly works again if I adjust the port to 2525

Provider: No we don't block any ports

Me: look I already know you're blocking the port, I just want some confirmation

Provider: no we're not blocking any ports.

Me: (hangs up)

Why the fuck would you block port 25?

Some ISPs restrict port 25 so that you can only use their SMTP server on their network... They do that to help monitor and control spam emails sent from their network, but... their tech support should be aware of that
---
... Copied to Clipboard!
CableZL
08/21/19 11:17:53 PM
#39:


Still... down...

AT&T was repairing the fibers in a manhole somewhere, but now they're claiming they lost access to the site

what

the

fuck

It's a manhole
---
... Copied to Clipboard!
Polycosm
08/21/19 11:30:09 PM
#40:


Anything on your side of the demarc is your problem. And anything on the ISP's side of the demarc is also your problem until you Phoenix Wright the provider into admitting their guilt.
---
I bow before my emperor, Advokaiser-- winner of the 2019 guru contest. (thengamer.com/guru)
... Copied to Clipboard!
CableZL
08/21/19 11:30:40 PM
#41:


Polycosm posted...
Anything on your side of the demarc is your problem. And anything on the ISP's side of the demarc is also your problem until you Phoenix Wright the provider into admitting their guilt.


This is the best way to express this that I've ever seen. I shall steal this for future use if you don't mind.
---
... Copied to Clipboard!
Rika_Furude
08/22/19 3:23:41 AM
#42:


Cable, do you ever wake up in the morning and wish you were a sysadmin instead?
---
Posted with GameRaven 3.5.1
... Copied to Clipboard!
CableZL
08/22/19 7:47:27 AM
#43:


Rika_Furude posted...
Cable, do you ever wake up in the morning and wish you were a sysadmin instead?


Nah, networking is my jam. There's just stressful days like that sometimes.
---
... Copied to Clipboard!
BlazinBlue88
08/22/19 7:53:33 AM
#44:


Tyranthraxus posted...
BlazinBlue88 posted...
Why the fuck would you block port 25?
More accurately it was blocked for any IP address that was not the provider's SMTP servers. This was / is a common practice to help fighting outgoing spam.

Nevermind. That's makes more sense.
---
... Copied to Clipboard!
Topic List
Page List: 1