One potential issue I see is that Cloudflare doesn’t allow changing to non-Cloudflare name servers.

Not an issue for me, but worth noting since this is fairly unusual, as far as I’ve seen.