Downtime

Dynalist is currently down, and also was down for over an hour on January 3rd. It would be good if an announcement could be posted about what’s going on with these long outages. @Shida

Recent outages seems to have been a new issue, I don’t have the details yet but it seems like the web server had trouble reaching the database server and got stuck. A reboot seemed to fix things but since this is the second time it happened I’ll need to investigate deeper once I am back in town.

Also, we have another problem. If the main Dynalist website is down, it cannot be used to authenticate in this forum. Which means only people who still have an active session (i.e. people who logged into the forum recently) will be able to post.

It may be worth adding a separate way to login into Discourse.

1 Like

I realized that the service we use to call my phone when Dynalist goes down silently stopped working because the call service requires an additional subscription payment that we didn’t sign up for. It does seem like the uptime dashboard service we are currently paying for has a call feature so I’ve enabled that. If this happens next time I will be able to look into it right away and try to investigate the root cause.

2 Likes

We also have a Discord, if that helps.

1 Like

So another round hit and I’ve looked into it. It seems like we were being DDoS’d from a botnet in an attempt to test passwords leaked from other sites. Unfortunately this is a large botnet where lots of IPs are used, so our regular countermeasures (captchas after a few attempts from the same IP) weren’t working as well.

We’ve experienced a similar attack on Obsidian’s infrastructure too and eventually these attacks stops after a few days, so hopefully they’ll leave us alone soon.