Explainable AI (XAI) is a subset of standard AI technology that allows us to understand the decision-making process of AI models. Researchers are using XAI to scrutinize predictive AI models in the field of chemistry, particularly in drug discovery. By providing justification for AI decisions, XAI could potentially make scientists more comfortable with these methodologies.