They also don't drive several thousand or tens of thousand kilometers in one go once or more a year either in addition to the normal driving, so I'd say that argument is not helpful here.
That's not how it'll work though. Do vegans get more flight allowances? Do people with kids have to forgo meat as well as vacations?
Obviously no consumer choice driven solution is going to work. The costs have to be included in the goods and services if we want any actual reduction.