For me I stopped using Signal when they started permanently storing sensitive user data in the cloud, they were extremely unclear about doing it confusing many of their users, they ignored the objections and security concerns of their users who realized what they were doing and they never updated their privacy policy to reflect that information (and still haven't). For an app that insists that you be able to trust it, they just did not come off as remotely trustworthy.
Signal then announced that because of all the hate they'll make the feature optional, but opting out would just set a pin for you and upload your data anyway. This also caused a bunch of confusion.
It's worth pointing out that they're collecting the type of data they still brag about not being able to turn over because they "don't keep user data".
Between that and not updating their privacy policy it's a pretty massive red flag, but so many people don't even know about the data collection. Look at the answers this guy gets:
It's insane, and I hope every user who has to learn what signal is really collecting from some random internet comment thinks long and hard about what that says about how transparent and trustworthy signal is.