Yes, the legs do fold away, very neatly too.
All you need do in winter is cover the seat with a bit of thin padding, or even a towel. That way you've got the best of both worlds for winter and summer.
If it rains when you're walking to your swim then you'll also be glad of the quick dry aspect in winter or summer.