Mobile page slow load, sometimes not even then.

[Cable Guy]

This has been bugging me all week, the platform is taking a long time to load. Usual clear of temp and cookies had no effect. It works at the moment, but I have been getting these..

Yes, I have a lot of tabs open and need to find my charger, but I don't believe that is the issue. Not sure if an admin is aware so there it is.

 

[19wrc333]

Just guessing, but most likely all the AI scrapers that are causing havoc.
The AI data lords need to be fed continously and the data slurping tends to be very aggressive. Plenty of those scrapers don't follow best practices where you tell them to not scrape your website.

Nowadays 95% of all website traffic is AI scrapers, probably more than that.

 

[Crawdad]

Site is very slow on mobile and computer and like you said CG sometimes not at all.

 

[brandon7861]

I recently made a post about this in the help section. Someone should start checking logs.

 

[brandon7861]

Its almost like my browser has to wait in line before a connection is granted. Like a DDoS or a brute force on something tying up the server. IDK. When it does load, it loads fast like normal. Its like it suddenly snaps into gear.

edit: I think the whole dang country is under cyber attack. It seems like every site I know has had a round or two of this and captcha/verification have skyrocketed.

 

[Cable Guy]

I recently made a post about this in the help section. Someone should start checking logs.

I don't recall seeing it, but I think I'm not seeing everything. I refresh the "what's new" link and I sometimes don't see an original post as soon as it's posted, but subsequent followup posts show up.

 

[Cable Guy]

Its almost like my browser has to wait in line before a connection is granted. Like a DDoS or a brute force on something tying up the server. IDK. When it does load, it loads fast like normal. Its like it suddenly snaps into gear.

Exactly. To the logs!

 

[AudioShockwav]

Just as I am posting this there are several thousand guests viewing the forum.
@19wrc333 is correct the site is constantly being crawled by search engines, robots and guests.
It's not gone unnoticed.....

73
Jeff

 

[19wrc333]

Just as I am posting this there are several thousand guests viewing the forum.
@19wrc333 is correct the site is constantly being crawled by search engines, robots and guests.
It's not gone unnoticed.....

73
Jeff


View attachment 76734View attachment 76735

There's 7600 guests online now and the site is fast!
So that's pretty good really. One forum that I visit had switched to private mode for a while, while that works, obviously it's the last thing you want as it puts an enormous hurdle up for new users. Plus searchengines can then no longer visit your site, so it doesn't show up much anymore in search results.

For some sites that I host, I'm using modsecurity with a list of known bad user agents that are getting blocked. It's sad as you're punishing the better citizens under the scrapers, but you have to do something to lessen the load nowadays.

There's anubis, but it basically relies on putting a proxy server in front of your site, which increases complexity for most. Other alternatives are things like using a CDN to lessen the load.

Sadly it's about the last thing you want to be spending time on, but you probably have to do something.