Managerial decision makers are increasingly supported by advanced data analytics and other artificial intelligence (AI)-based technologies, but they are often found to be hesitant to follow the algorithmic advice. We examine how compensation contract design and framing of an AI algorithm influence decision makers’ reliance on algorithmic advice and performance in a price estimation task. Based on a large sample of almost 1,500 participants, we find that compared with a fixed compensation, both compensation contracts based on individual performance and tournament contracts lead to an increase in effort duration and to more reliance on algorithmic advice. We further find that using an AI algorithm that is framed as also incorporating human expertise has positive effects on advice utilization, especially for decision makers with fixed pay contracts. By showing how widely used control practices, such as incentives and task framing, influence the interaction of human decision makers with AI algorithms, our findings have direct implications for managerial practice. This paper was accepted by David Simchi-Levi, Special Issue on the Human-Algorithm Connection. Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2022.02777 .