Up to a point. I am an example of such a thing: back when I started practicing parkour, my friends complimented me on my strength, despite the fact that, up to that point, the only regular exercise I had been doing for the last 3 years was walking a few hour a day. However, as Dantac mentioned, my stamina is lacking when it comes to strength, which puts me at a disadvantage in relation to people who do strength exercises regularly (I hate strength exercises). I was also considerably more buff than the average guy, with a body very similar to a chimpanzee's (WARNING: this hairless chimpanzee is very creepy looking).
Of course, genes can only do so much. Since I quit my job seven months ago, I have become extremely sedentary, staying inside my home for weeks at a time. As a result, I have grown fat (height: 1,7 m; weight: 80 kg, when it used to be around 68 kg), halfway between a chimp and a gorilla in appearance. My strength does not seem to have decreased by much, but my stamina is even lower than before.
_________________
DISCLAIMER: It should be noted that, while I strongly suspect I have Asperger's syndrome, I am not diagnosed. Nevertheless, my score on RAADS-R is 186, which makes me a pretty RAAD guy.
Sorry for this terrible joke, by the way.