Well that’s easy: everyone outside of the concentration camps more less supported them or did enough to not end up in one of the camps. Of course there were a bunch of rebellious groups of people who actively stood up against the government. Of some of them we know, others might have been forgotten. But I think with that we’re already covering at least 75% of the population. You might find the list of companies involved in the holocaust interesting. Not exactly people but you can extrapolate from there: https://en.m.wikipedia.org/wiki/List_of_companies_involved_in_the_Holocaust

I think you just answered your own question, by describing a smell I’ve never smelled before.