Hi Lars,
I have developed this plugin:
Multiple Extra Fields Groups
which allows to assign more than 1 field groups to a category.
I think If I added the ACL feature to this plugin, this can help you to implement your request.
I will try to add this feature asap.