Abstract: This work constitutes first part of project (Endo.AI) funded by Cancer Research UK (CRUK) whereas the paper has been accepted by IEEE Machine learning and Applications (ICMLA2019). This study investigates the feasibility of applying state of the art deep learning techniques to detect precancerous stages of squamous cell carcinoma (SCC) cancer in real time to address the challenges while diagnosing SCC with subtle appearance changes as well as video processing speed. Two deep learning models are implemented, which are to determine artefact of video frames and to detect, segment and classify those no-artefact frames respectively.