For super resolution of video, the best thing I've come across is TecoGAN which uses adjacent frames for extra information, creating a consistent flow between frames.

https://github.com/thunil/TecoGAN