I wouldn't even necessarily say they pick on anyone who is poor; it's just that when they pick on the Weasleys, their poverty is the characteristic they choose. Which is unpleasant, true. But if there are poor Slytherins on the Slytherin house team (and there may well be) at least they're playing on decent brooms; unlike the poor Gryffindors.