It does make a difference. Especially if you have 3 units and 1 weapon it's 400+ atk, that is a quite noticeable jump in damage.

Yes, 2s stuff is ok most of the time. But it's very cheap and easy...