Yes they would? I'm bilingual and I would have a problem with a business that doesn't care about the national language. Anyway, it just doesn't make sense at all business wise. Businessmen don't get stuck thinking "I speak ENGLISH and I don't care about the customers who don't understand ME!!!" This would be plain stupid.
Businesses adapt to their market. It's not the other way around.
You want to do business in Sweden? Learn Swedish! Do advertising in Swedish, hire staff that speaks Swedish. Even if 50% of the population can understand English to varying degrees. Would you go to Africa and target "white customers only"? No right! That would be dumb. And mostly, it would be quite insensitive to the locals.
I don't even know what there is to argue here. It's just common sense capitalism.