Moi used to swim 50 laps regularly and I still can't shed off weight due to incessant hunger after the swim. Swimmers have to eat lot to replenish the expended energy.
However I lost weight very quickly when I start climbing stairs on those 40 storey blocks around my area.