Yes, there's a lot of low-hanging fruit that is so bad that it's best to just not do it at all. Soda was the big one for me. There's really no responsible way to drink full-sugar soda, it's just too many calories. Oh, and ice cream.
I actually saw a large observational study recently with the surprising result that people who began eating more ice cream actually lost weight. It's not that ice cream is good for you (obviously), but that people often use it to replace foods that are even worse.
