> Why would this ever happen if your neighbour wasn't feeling things to begin with?

If you only believe you have feelings, as eliminativists allege, then the outcome is the same. That's the whole point of p-zombies.