Bot and Website unresponsive
Gelöst
Jan 15 um 08:41pm CET
Everything is back online again.
- the backup service has been implemented
pm2is now being used instead of docker
Betroffene Dienste
Aktualisiert
Jan 15 um 04:56pm CET
Dashboard is recovering as well. Everything seems to stabilize again.
Thanks you for your patience.
Betroffene Dienste
Aktualisiert
Jan 15 um 04:15pm CET
Bot is recovering again, website will be next.
Betroffene Dienste
Aktualisiert
Jan 15 um 02:35pm CET
🚨 Important Update: Service Restart & Data Reset
Current Status: Bot and website are staying offline.
What Happened
I used to run all parts of the bot and website in docker containers - think of it like containers, ready to be shipped anywhere you want it and being able to run it anywhere you want without the need for special environments. This made everything very easy, but also somewhat complicated on the other hand.
I recently secured the MongoDB by binding it to localhost only (no external access) on the server. Today it became unresponsive. I noticed that as I was in school and was preparing for two tests...
During urgent recovery attempts to get it working again, the database catalog corrupted, leading to total data loss, including all configurations.
Impact
- All forms, categories, messages, and server setups need reconfiguration
- All premium subscriptions are not in my database anymore, which is why I need to come up with a solution to sync it again with Paddle.
Major Upgrades Underway
- Switching to native MongoDB install (bye Docker hassles)
- Automated backups
- Production-grade hardening (infrastructural changes)
Apologies for the downtime - your server deserves bulletproof and reliable service which I'm trying to provide.
Please also keep in mind that Ticketon is still in an active beta phase, which means features are under heavy development and issues may occur - this is one of the worst things that could've possibly happened.
I'm so sorry for the disruption - lesson learned the hard way. Your patience means a lot as I improve my infrastructure.
ETA: some hours ~ 1 day, until improvements are finished
Thanks,
Luke 🫡
Betroffene Dienste
Aktualisiert
Jan 15 um 01:33pm CET
Database issues, I'm working on a fix.
Docker issues all the way, it seems the DB has been nuked by docker.
Betroffene Dienste
Aktualisiert
Jan 15 um 10:56am CET
its down again
Betroffene Dienste
Aktualisiert
Jan 15 um 10:44am CET
Site is recovering. Monitoring.
Betroffene Dienste
Erstellt
Jan 15 um 10:26am CET
Investigating
Betroffene Dienste