So that RE2 Classic Rebirth PC Mod got people interested in using Machine learning to up-res the backgrounds

[Remij 4,667]

So people are taking the backgrounds and running them through a deep learning algorithm to increase detail and resolution...  This shit is fucking incredible.  Leaves some interesting possibilities open for REmake on PC.  

 

 

 

 

 

A lot of games could possibly benefit from this.  And these deep learning inference super computers keep getting better and better at it as well.  

[Remij 4,667]

So it looks like modders are starting to take notice of this stuff and are going to town with it.  A new DOOM sprite/texture mod is in the works using Neural Network upsampling to create higher res sprites and textures from the old assets.  It essentially keeps the old art style intact (which is usually a problem with "hi res" texture pack mods) and requires very little (in comparison) manual work to fix alpha channels and slight oddities.  It's much faster than redrawing all the sprites manually.. and more accurate to the original. 

 

 

It's kind of ridiculous... but man is there a lot of potential for this stuff in the future. 

[Remij 4,667]

Morrowind is getting in on it as well..

 

 

[Teh_Diplomat 2,054]

Very cool stuff.

[Alphonse★ 453]

That's awesome. Can't wait for them to apply it to more older games.

[DynamiteCop 2,085]

Hopefully this can be applied to Switch games 

[-GD-X★ 7,728]

if only there was a way to mod the xbox one to play exclusives. 

[Alphonse★ 453]

2 hours ago, -GD- said:

if only there was a way to mod the xbox one to play exclusives. 

There is

 

 

[Mr. House 3,371]

That's awesome. One of the problem with PS1 games using CGI backgrounds is that their ports always looks like shit due to the lower resolution.

 

REmake HD was the best effort I ever seen at porting a game with CG backgrounds, but they had to rework entire assets to make it work and it still looked nowhere near as good as this.

[Remij 4,667]

15 minutes ago, Ramza said:

That's awesome. One of the problem with PS1 games using CGI backgrounds is that their ports always looks like shit due to the lower resolution.

 

REmake HD was the best effort I ever seen at porting a game with CG backgrounds, but they had to rework entire assets to make it work and it still looked nowhere near as good as this.

What I would love to see Capcom do is go back to REmake, and just take a look and see what can be done.  There's been a lot of advancement in this field in the last 3 years.. It's not just taking the low res image and upscaling it... the neural network can actually add new information and detail never before possible... based on the fact that it can actually discern what objects are.  The Nvidia presentation on this shit was fascinating.

 

If they were to go back and run the backgrounds through the neural network and potentially fix them up quite a bit, that would be amazing.  The shark area always stood out as fairly bad compared to other areas.. because it was fairly monochrome-ish and there wasn't enough high frequency information so things just kinda blurred together with the filtering they used.  

 

 

With machine learning though, they could add a lot of detail in that wasn't ever there because the network knows what the door is, it knows what the railing is.. it knows the lights and walls.  It would reconstruct the image to look exactly the same but fill in the missing data of how it SHOULD look, with it's millions upon millions of references it has in it's database.  They could then update the game with the high quality renders and then patch it to all of the versions of the game  

 

Take a look at these people...

 

 

NONE of those people exist... they were all created by an AI.  Watch this video:

 

 

 

Fucking crazy shit.  

[Mr. House 3,371]

Thats scary af

[Playstation Tablet 1,723]

This looks stupidly good, because somehow it's somehow close to the original art. 

[Remij 4,667]

So someone released an image of a REmake background enhanced using a type of AI upscaling.  Of course there are multiple algorithms and things aren't perfect.. but the increase in detail and sharpness is undeniable.  For fun I took a pic of the same background in-game and wanted to see how they compared.  There's slight color differences because I think the person who made the upscale would have taken the actual file and processed it, so that's what the background looks like before the color filtering and bloom and effects are added to it.

 

http://screenshotcomparison.com/comparison/126233

 

It's only going to get better as well.  

[kokujin 558]

On 2018-12-18 at 6:13 PM, -GD- said:

if only there was a way to mod the xbox one to play exclusives. 

LMFAO

[kaz 2,439]

34 minutes ago, kokujin said:

LMFAO

why are you laughing gaaiyjin? you the only japo with a xbox 

[kokujin 558]

1 hour ago, kaz said:

why are you laughing gaaiyjin? you the only japo with a xbox 

I got a PS4 now.  tu baka motto Tú Madré esu bitch desu onegai kher, kremlin-san.