Same to #24322 Not only `leave` action but also `remove` action should check whether user still belongs to the org.