You definitely need grounds to exile them / strip their wealth.
Taking away their political powers / their status as royals is one thing, but exiling someone is punishment. You can't just hand out punishment for no good reason.
If they commited crimes that were illegal at the time they were commited they should stand trial for that, but I very much doubt any of those are serious enough to warrant exile.