Conventional approaches for screening anticancer drugs rely on chemical reactions, which are time consuming, labor intensive, and costly. Here, we present a protocol for label-free and high-throughput assessment of drug efficacy using a vision transformer and a Conv2D. We describe the steps for cell culture, drug treatment, data collection, and preprocessing. We then detail the building of deep learning models and their use to predict drug potency. This protocol can be adapted for screening chemicals that affect the density or morphological features of cells. For complete details on the use and execution of this protocol, please refer to Wang et al.¹.