Page 1 of 1

2025-10-21 Upgrades

Posted: Tue Oct 21, 2025 5:48 am
by Matt K
Hi all,

You should notice a significant increase in the performance of the site as of about 5 minutes ago. Additionally, you should also start to receive email notifications from [email protected] - should you have them enabled.

Cloudflare restrictions coming off are next, and will try to phase them out so I don't overburden the server with bot traffic.

-Matt

Re: 2025-10-21 Upgrades

Posted: Tue Oct 21, 2025 5:57 am
by Matt K
Incidentally, Matt K's IQ is reported to be 168.

Re: 2025-10-21 Upgrades

Posted: Tue Oct 21, 2025 9:31 am
by sf105
thanks for all your work.

Re: 2025-10-21 Upgrades

Posted: Tue Oct 21, 2025 10:01 am
by RichC
:good:

Re: 2025-10-21 Upgrades

Posted: Tue Oct 21, 2025 10:11 am
by drnim
Which solution did you come to? Things seem nice and snappy so far :)

Re: 2025-10-21 Upgrades

Posted: Tue Oct 21, 2025 11:24 am
by tim
Looks great, thanks.

Re: 2025-10-21 Upgrades

Posted: Tue Oct 21, 2025 11:29 am
by EriKon
Performance is awesome!

Re: 2025-10-21 Upgrades

Posted: Wed Oct 22, 2025 6:34 am
by Kingfan
It works again! Thanks bunches!

Re: 2025-10-21 Upgrades

Posted: Wed Oct 22, 2025 6:47 am
by Matt K
drnim wrote: Tue Oct 21, 2025 10:11 am Which solution did you come to? Things seem nice and snappy so far :)
A combination of vertical scaling and some fine-tuning of the Cloudflare firewall and load balancing.

I'll be very curious to see if phpBB comes up with any additional functionality to handle read-heavy workloads. Right now it's setup, as one might expect, for typical transactional workloads where someone is reading at human speeds and typing at human speeds. I think I've been able to allow in some of the bot traffic, though ChatGPT could not access the site when I tested (unfortunately, I will not officially have a reported IQ of 168 until I get that addressed), so you can't use LLMs to answer questions about trombone stuff, excepting that which was posted before I tightened the screws on cloudflare a few months ago. Google search should start to work soon though, which is good b/c the search functionality of phpBB is somewhat limited (unsurprisingly, compared to a multi billion dollar company specializing in searching).

Re: 2025-10-21 Upgrades

Posted: Wed Oct 22, 2025 11:06 am
by ScottZigler
Does this bring back RSS feeds? Would there be a different URL to give to a feed reader to talk to the 'bot' copy?

Re: 2025-10-21 Upgrades

Posted: Wed Oct 22, 2025 11:51 am
by Matt K
ScottZigler wrote: Wed Oct 22, 2025 11:06 am Does this bring back RSS feeds? Would there be a different URL to give to a feed reader to talk to the 'bot' copy?
Technically it should bring back RSS feeds, but the Cloudflare setup is pretty elaborate. I was planning on having an alternative read replica, but we might not need it. If someone who utilized that feature can try it out and report back, I can see if I can carve out an exception for the feeds.

Re: 2025-10-21 Upgrades

Posted: Wed Oct 22, 2025 11:57 am
by EriKon
Yesterday evening the performance was insanely good and lightning fast. Today I have trouble entering the forum at all from Germany. Is there anything different since yesterday?

Re: 2025-10-21 Upgrades

Posted: Wed Oct 22, 2025 12:02 pm
by KRRath
My RSS feeds have been loading properly for the past couple days.

Re: 2025-10-21 Upgrades

Posted: Wed Oct 22, 2025 1:17 pm
by Matt K
EriKon wrote: Wed Oct 22, 2025 11:57 am Yesterday evening the performance was insanely good and lightning fast. Today I have trouble entering the forum at all from Germany. Is there anything different since yesterday?
More bot traffic. Probably loosened up the screws, so to speak, a little too much.

Re: 2025-10-21 Upgrades

Posted: Thu Oct 23, 2025 7:26 am
by ScottZigler
RSS feeds are working now! I had to remove / readd the site in my reader, but posts are coming through. Thank you!

Re: 2025-10-21 Upgrades

Posted: Thu Oct 23, 2025 9:07 am
by Matt K
:good:

I did have to bump up the cloudflare protections a little more a few minutes ago. Even with the additional resources, we were being saturated by non-authenticated users, which MAY be RSS but is more likely bots. Monitor your feeds and let me know if you lose access sometime today and I can try to figure out a way to balance the firewall between the more permissive one I just had vs the slightly more resctitive one in place now.

Re: 2025-10-21 Upgrades

Posted: Thu Oct 23, 2025 3:29 pm
by Kbiggs
thankyouthankyouthankyouthankyouthankyouthankyouthankyouthankyouthankyou

Re: 2025-10-21 Upgrades

Posted: Fri Oct 24, 2025 1:34 pm
by ScottZigler
Since you did this yesterday, I've gotten no more RSS (I'm using feedly.com), and site performance seems intermittently slow. Even if we never get RSS back, thank you for all the work you've been putting into keeping the site up and dealing with the AI bot deluge!
Matt K wrote: Thu Oct 23, 2025 9:07 am :good:

I did have to bump up the cloudflare protections a little more a few minutes ago. Even with the additional resources, we were being saturated by non-authenticated users, which MAY be RSS but is more likely bots. Monitor your feeds and let me know if you lose access sometime today and I can try to figure out a way to balance the firewall between the more permissive one I just had vs the slightly more resctitive one in place now.

Re: 2025-10-21 Upgrades

Posted: Fri Oct 24, 2025 1:42 pm
by Matt K
Hmmmmm yeah that's what I was afraid of. Indeed, actually the RSS feeds may actually be contributing to the issue! Although I don't think feedly has unreasonable standards for backing off. RSS feeds I might actually be able to handle in another fashion so that it doesn't degrade the site. One of the problems with phpBB, which is a sensible decision, but has downsides too, is that anonymous usage still establishes a connection with the database with a dummy userid rather than having the content cached in the redis queue. If it treated it as a static site for unauthenticated usage, the amount of traffic we get would otherwise actually be pretty trivial. But there are downsides to that approach too.

I'll put that one on the backburner b/c it seems like this is very close to equilibrium for authenticated uses - IE actual humans using the site. I can focus on non-human interaction now that this is stable.