Button me up!

When I was little I was very fond of playing with the button box. It may have been my grandmother's or my mother's, I am no longer sure. I would play for hours just sorting through and ordering the buttons which I've now inherited. To what sort of clothing would these have belonged?