While the use of AI technologies in healthcare is increasing, there is uncertainty whether and to which extent patients should be informed about clinicians’ use of these cutting-edge technologies. Transparency around AI use has been advocated in numerous policy documents and academic papers on ethical AI, but there is a disagreement on how much transparency – or information – there should be provided around AI use in healthcare to different stakeholders. Some commentators argue that patients need to know about AI use for informed consent and trust purposes, while others suggest that clinicians do not traditionally tell patients about all the tools they use in therapeutic process, and thus AI use in the process will need to be disclosed in exceptional cases only. This paper presents preliminary results of an empirical study which examined patients’ views on whether they need to know about AI use in healthcare practice, and if so, in which situations. It also explores what information is most relevant for patients, and what could be the most effective ways in providing it.