What everybody's saying. The majority of wines I buy are unfined and unfiltered, and most of them have a good deal of both sediment and crystals in them after two or three years in the cellar.
I'm lazy and don't bother to decant, and the last couple of glasses always have some stuff in them. It affects the taste very slightly if you happen to slurp some up, but it doesn't affect things enough to affect my rather tolerant judgment of the bottle. Yes, the crystals are sweet/salty, and the sludge (actually bits of skin, pulp and stem <g>) makes the basic taste "stronger" and "more tannic" and usually more characteristic of the varietal.
It happens with both whites and reds, but I've not seen it in a rose, yet. OTOH, I don't drink much rose.