Support for board-level moderation

A rough first version would already be a big improvement. We would move our whole team over if this landed.