I can’t speak for all people so I’ll only go on to present my opinions based on personal experiences here. It’s really hard to define ‘smart’. There’s a fixed threshold in the IQ spectrum to be called a ‘genius’ but that alone does not guarantee you are ‘smart’. Smart is a convolution between a high IQ, a distinctive personality and other traits that put that person above the average crowd. Someone genetically predisposed with a high IQ would need suitable traits to make the most of their brain power.
It would be unfair to expect everyone to be smart, but victimizing smart people due to a difference of opinion is certainly unacceptable.