huge server-side BE problem - started yesterdayish

[FliesLikeABrick]

nice.

[$able]

Could you check your log again?
It should be full of tons of 404 errors again, as I still see lots of servers that BE doesnt work on.

You should leave the files in place to reduce the spamming from newly hosted servers until 1.4.2 (I saw you removed them).

[FliesLikeABrick]

What I'm doing is removing them periodically so to prevent them from being re-downloaded over and over again by some servers.  I'll probably put them back for a few hours each day or something


edit: they're back in place now

[$able]

I am not sure if the 404s generate more traffic overall, because it seems they are quickly increasing due to new servers.

[FliesLikeABrick]

I am not sure if the 404s generate more traffic overall, because it seems they are quickly increasing due to new servers.

they don't.   Having servers download the binaries over and over again create about 300 KB/s more traffic than just handing back 404s

[$able]

Even though the same servers generate lots of 404s per second?

Well, you must know it.

[FliesLikeABrick]

Even though the same servers generate lots of 404s per second?

Well, you must know it.

I'm 100% sure.  The downside of the 404s is that they fill up my logs much quicker.

[$able]

But a single 404 generates little traffic as well.

Anyway, that makes sense of course. Though this could change if there are so many new servers requesting the files instead of just a few downloading it over and over again.
Thats why its good that you put up the files at certain times at least.

Date Posted: June 22, 2007, 03:35:50 PMSomething else: Could you set a download rate limit on that HTTP server for host string "soldat.battleye.com" (in GET request)?
This would be the ultimate solution.

[FliesLikeABrick]

But a single 404 generates little traffic as well.

Anyway, that makes sense of course. Though this could change if there are so many new servers requesting the files instead of just a few downloading it over and over again.
Thats why its good that you put up the files at certain times at least.

Date Posted: June 22, 2007, 03:35:50 PMSomething else: Could you set a download rate limit on that HTTP server for host string "soldat.battleye.com" (in GET request)?
This would be the ultimate solution.

what good would that do?  it'd ultimately use every bit as much bandwidth, just slower.

[$able]

It will generate much less traffic per time.
Traffic = rate * time.

Date Posted: June 22, 2007, 03:55:29 PMSo is there a way you could achieve this?

[FliesLikeABrick]

I'm trying to find an apache module that can do rate limiting.

[$able]

Just wondering, have you set up something like this?

[FliesLikeABrick]

Nope, I've been busy