ESRGAN: AI Neural Net Upscaling

All the inane chatter goes in here. If you're curious about whether we will support a game, post HERE not in General Discussion :)

Moderator: ScummVM Team

Robot_Maker20
Posts: 45
Joined: Tue Nov 07, 2006 1:23 pm

Re: ESRGAN: AI Neural Net Upscaling

Post by Robot_Maker20 » Thu Jan 31, 2019 4:45 am

Can this be applied to preprocess low-res FMV cutscenes? Maybe even ones with line-skipping like the Z-vision games?

Ze_PilOt
Posts: 2
Joined: Mon Jan 28, 2019 7:44 am

Re: ESRGAN: AI Neural Net Upscaling

Post by Ze_PilOt » Thu Jan 31, 2019 12:25 pm

Robot_Maker20 wrote:
Thu Jan 31, 2019 4:45 am
Can this be applied to preprocess low-res FMV cutscenes? Maybe even ones with line-skipping like the Z-vision games?
- The GAN need to be trained with frames where half of the line is missing (it's a question of preparing the training set properly)
- The GAN need to be temporally coherent - That's still an issue but feasible.

So, I would say yes... The main problem would be to handle compression artefacts. You will need to train your GAN with everykind of artefacted videos.
That depend of the compression factor & technique (ie. some FMV are compressing red very much, some a bit less), so no magic bullet for every game I'm afraid.

Post Reply