I'm not expecting the average German to rise up against Hitler. Unfortunately.
But the average German Jew? Maybe they have more incentive to be prepared? If guns are readily available?
This isn't in the category of "to save their life, they started carrying weapons". This is in the category of collective defense - "To provide a deterrent, they started carrying weapons, just to make their abduction/murder costly". It doesn't make sense (for most) to sacrifice their lives just for their residency - getting deported is not the end of the world. But if the result is "You get thrown into a torture/slave/deathcamp and forgotten for the rest of your short life", that changes the calculus a great deal.
“And how we burned in the camps later, thinking: What would things have been like if every Security operative, when he went out at night to make an arrest, had been uncertain whether he would return alive and had to say good-bye to his family? Or if, during periods of mass arrests, as for example in Leningrad, when they arrested a quarter of the entire city, people had not simply sat there in their lairs, paling with terror at every bang of the downstairs door and at every step on the staircase, but had understood they had nothing left to lose and had boldly set up in the downstairs hall an ambush of half a dozen people with axes, hammers, pokers, or whatever else was at hand?... The Organs would very quickly have suffered a shortage of officers and transport and, notwithstanding all of Stalin's thirst, the cursed machine would have ground to a halt! If...if...We didn't love freedom enough. And even more – we had no awareness of the real situation.... We purely and simply deserved everything that happened afterward.”