This paper considers the estimation of the expected rate of return on a set of risky assets. The approach to estimation focuses on the covariance matrix for the returns. The structure in the covariance matrix determines shared information which is useful in estimating the mean return for each asset. An empirical Bayes estimator is developed using the covariance structure of the returns distribution. The estimator is an improvement on the maximum likelihood and Bayes–Stein estimators in terms of mean squared error. The effect of reduced estimation error on accumulated wealth is analyzed for the portfolio choice model with constant relative risk aversion utility.