Some data is available on the effect alleles have on height. For example Common DNA Variants Accurately Rank an Individual of Extreme Height
However after browsing the literature I was not able to easily answer the following.
If we take a genome and allow only one gene to change there is going to be an allele maximizing the genetic potential for height. If we take two different genomes and allow one gene to vary are the optimal alleles going to be the same?
If this can happen then linear polygenic scores cannot fully capture the genotype–phenotype map.