Right, when weight comes off we naturally shed some muscle too, mostly from the legs. Think of how buff and muscular someone's calves get when they're carrying all that extra load - they're basically wearing their own biological ballast. When it goes away, that goes away too.