One of the all time favourites in any chemistry set was potassium permanganate. Those crystals look beautiful in their own right, and make a great purple coloured solution, but that's only the start.
My latest entry in the Royal Society of Chemistry compounds podcasts takes on this simple chemical that is equally comfortable as a disinfectant and as a source of spontaneous combustion. Embrace purple! Listen to the story of this chemistry set star.