Forum outage 2020-01-14(ish)
-
- Knower of Things
- Posts: 12720
- Joined: Fri Feb 07, 2003 4:11 am
- Real Name: Jarrod Frates
- Gender: Male
- Location: Dallas, TX
Forum outage 2020-01-14(ish)
Not quite sure what happened, but the Apache2 service on the forums stopped. I got logged in and restarted it, and now, of course, it's up (at least while I'm writing this).
If I show up at your door, chances are you did something to bring me there.
-
- Redshirt
- Posts: 823
- Joined: Fri Feb 14, 2003 8:13 am
Re: Forum outage 2020-01-14(ish)
I was wondering what had happened. Glad you got it taken care of.
Disciple of Gnarr
“Let there be truth, happiness, and waffles”
-Nomad, Dark Lord & Avatar of Gnarr
“Let there be truth, happiness, and waffles”
-Nomad, Dark Lord & Avatar of Gnarr
-
- Redshirt
- Posts: 94
- Joined: Thu Jan 24, 2019 2:27 am
Re: Forum outage 2020-01-14(ish)
Thanks for fixing this.
-
- Shining Adonis
- Posts: 44250
- Joined: Wed Jul 30, 2003 3:00 pm
- Gender: Male
- Location: Lakehills, TX
Re: Forum outage 2020-01-14(ish)
Thank you!
The follies which a man regrets the most in his life are those which he didn't commit when he had the opportunity. - Helen Rowland, A Guide to Men, 1922
-
- Agent 0.07
- Posts: 4736
- Joined: Fri Feb 14, 2003 11:05 pm
- Gender: Male
- Location: BC, Canada
-
- Redshirt
- Posts: 4806
- Joined: Tue Feb 18, 2003 2:28 pm
- Location: England
-
- The Immoral Immortal
- Posts: 17768
- Joined: Tue Feb 18, 2003 7:35 am
- Gender: Male
- Location: Glasgow, Scotland
-
- Mad Hatteras
- Posts: 1985
- Joined: Tue Feb 13, 2007 3:00 pm
- Real Name: Jennifer
- Gender: Female
- Location: Hatteras,NC
Re: Forum outage 2020-01-14(ish)
I am as always both pleased and regretful to be here hanging out with my fellow nerdlings.
~Insert clever bon mot here~
-
- Knower of Things
- Posts: 12720
- Joined: Fri Feb 07, 2003 4:11 am
- Real Name: Jarrod Frates
- Gender: Male
- Location: Dallas, TX
Re: Forum outage 2020-01-14(ish)
I think I may have figured out what is causing it, but not why it's happening.
I use Let's Encrypt for all HTTPS certificates. The certbot process that it currently uses requires that it stop the HTTP service, does its thing, then restarts the service. What seems to be happening is that the service is getting stopped, but not necessarily restarted. The major reasons for this are the graceful stop of the HTTP service, and also that at least this morning's outage was roughly coincident with a failed cert update attempt.
There are a couple of possibilities for this, one of them being that the legacy "service apache2 stop" and "service apache2 start" commands are for some reason not properly executing (the modern commands are "systemctl stop apache2" and "systemctl start apache2").
Another is that certbot may have changed somehow in the last few weeks in a breaking way. This wouldn't be the first time certbot made a breaking change, especially regarding HTTP renewals. It does give me the impetus to make a move to the more stable DNS update method. I kind of know how that is supposed to work, but not entirely.
In the meantime, I have disabled the certbot service until I can get whatever it is figured out. Hopefully, that will at least get the server stable.
I use Let's Encrypt for all HTTPS certificates. The certbot process that it currently uses requires that it stop the HTTP service, does its thing, then restarts the service. What seems to be happening is that the service is getting stopped, but not necessarily restarted. The major reasons for this are the graceful stop of the HTTP service, and also that at least this morning's outage was roughly coincident with a failed cert update attempt.
There are a couple of possibilities for this, one of them being that the legacy "service apache2 stop" and "service apache2 start" commands are for some reason not properly executing (the modern commands are "systemctl stop apache2" and "systemctl start apache2").
Another is that certbot may have changed somehow in the last few weeks in a breaking way. This wouldn't be the first time certbot made a breaking change, especially regarding HTTP renewals. It does give me the impetus to make a move to the more stable DNS update method. I kind of know how that is supposed to work, but not entirely.
In the meantime, I have disabled the certbot service until I can get whatever it is figured out. Hopefully, that will at least get the server stable.
If I show up at your door, chances are you did something to bring me there.
-
- Knower of Things
- Posts: 12720
- Joined: Fri Feb 07, 2003 4:11 am
- Real Name: Jarrod Frates
- Gender: Male
- Location: Dallas, TX
Re: Forum outage 2020-01-14(ish)
Well, that didn't go as planned. Trying to make some things work, I broke some networking things, and then the server was completely unavailable. The provider's link to the VMWare remote console was broken, and it took them two days to fix. Frustrating as hell. Things are mostly working but not entirely. Trying to fix all the issues.
If I show up at your door, chances are you did something to bring me there.
-
- Shining Adonis
- Posts: 44250
- Joined: Wed Jul 30, 2003 3:00 pm
- Gender: Male
- Location: Lakehills, TX
Re: Forum outage 2020-01-14(ish)
As frustrating as it is, it’s working now! Thank youMartin Blank wrote: ↑Sun Jan 24, 2021 6:05 pmThings are mostly working but not entirely. Trying to fix all the issues.

The follies which a man regrets the most in his life are those which he didn't commit when he had the opportunity. - Helen Rowland, A Guide to Men, 1922
Who is online
Users browsing this forum: Common Crawl (Research) and 0 guests