Set a plan to do the dollar store shopping.Buy stuff that is comparable to what you would love to do a lot of, and stick with things that you can either use over and over and / or give to as gifts. Gimp, or puzzles, and even crosswords, but my favorite is probably the painted figurines.
Are you talking about organizing them? First off, don't buy anything unless you know you are going to use it right away. It will save you money and clutter. Check out Goodwill stores etc. and get organizers. Check out Freecycle and get organizer containers.