I really think it depends on where you live. In NYC it's super common, but not if you live in the middle of nowhere!
i feel like with burberry you could wear that combo bc there's no logo. if it were a gucci scarf or something, i think it would be a bit much~ go for it!