XMPP Service Operators - 2024-10-01

ugh

how tf do you gather enough of that filth to train an ai to detect csam?

> fwiw I agree a server plugin would be better in that sense but worse in the sense that an admin can't just easily enable it where they want thx for the clarification

> ugh > > how tf do you gather enough of that filth to train an ai to detect csam? By having a preprocessing that is applied to the training files before saving them

> I guess that convers a slightly different use-case though Interesting, I'm actually looking for a tool to scan my HTTP upload folder and detect illegal content (mostly pedopornographic) I don't mind NSFW. ↺

edhelas: such tools are, unfortunately, mostly a closely guarded secret, only available to those with a lot of money to spend on the problem. Though the EU is trying to change that, I believe. The companies that provide the scanning solutions are the same ones lobbying governments to make it mandatory. Opening it up would be a good thing, in my opinion.

But even the expensive tech is far from foolproof, requiring human verification at some point in the pipeline

edhelas: the above tool should be able to do that.

It's a bit of a hack, but seems to work reasonably well.

nuegia.net: it isn't trained specifically on CSAM, it's just an general image classifier that filters out anything that it estimates to be nudity and children the same time.

Ofc that results in some false positives, but contrary to most other methods it also catches AI generated images like that.

> The companies that provide the scanning solutions are the same ones lobbying governments to make it mandatory. Sources?

> But even the expensive tech is far from foolproof, requiring human verification at some point in the pipeline +1

jonas-l: that "ngo" from ashton couter does that

https://en.m.wikipedia.org/wiki/Thorn_(organization)

See critizism

> The companies that provide the scanning solutions are the same ones lobbying governments to make it mandatory. The only source used at the Wikipedia article that I could read was refering to lobbying for the chat control. While this would create demand for this market, I do not consider this lobbying for making this mandantory.

Chat control is about making it mandatory though

Chat control exists only as drafts and there are concepts without mandantory scanning; we can complain about the final version when it arrives

Won't it be too late then?

nobody said its here now anyways

> Won't it be too late then? It would be too late then but you can not say how bad the world is based on some drafts

I don't think anyone is, I think they are saying: these drafts are bad