I am actually working with this problem.
It happens only with certain types of images and videos.
RealScaler use 2 AIs optimized to be fast and memory friendly: RealESR_Gx4 and RealSRx4_Anime.
With these 2 models and 6gb of ram you can upscale 1200x1200 images without using tilling.