slashdot had that years (decades?) ago. For such a wild west porto-reddit type of site, it really did have some good tools to manage trolling. Moderation flags have a "type" (funny, troll, redundant, offtopic, etc). There's also a meta-moderation system where random users got picked to see some random posts and judge whether the first level of moderation is fair.

It's been around a long time, but I guess it's a bit fiddly? I'm not sure why other sites haven't adopted similar processes.

https://slashdot.org/faq#meta1