Really, there should be a few changes
- Add an "ignore" or "silently decline" button
- Groups you haven't accepted shouldn't bubble up to the top of the app
- Invitations should perhaps "time out". If you don't do anything with it, the group should disappear out of the app