Remij 4,670 Posted December 11, 2018 Share Posted December 11, 2018 So people are taking the backgrounds and running them through a deep learning algorithm to increase detail and resolution... This shit is fucking incredible. Leaves some interesting possibilities open for REmake on PC. A lot of games could possibly benefit from this. And these deep learning inference super computers keep getting better and better at it as well. Quote Link to post Share on other sites
Remij 4,670 Posted December 18, 2018 Author Share Posted December 18, 2018 So it looks like modders are starting to take notice of this stuff and are going to town with it. A new DOOM sprite/texture mod is in the works using Neural Network upsampling to create higher res sprites and textures from the old assets. It essentially keeps the old art style intact (which is usually a problem with "hi res" texture pack mods) and requires very little (in comparison) manual work to fix alpha channels and slight oddities. It's much faster than redrawing all the sprites manually.. and more accurate to the original. It's kind of ridiculous... but man is there a lot of potential for this stuff in the future. 1 Quote Link to post Share on other sites
Remij 4,670 Posted December 18, 2018 Author Share Posted December 18, 2018 Morrowind is getting in on it as well.. 1 Quote Link to post Share on other sites
Teh_Diplomat 2,054 Posted December 18, 2018 Share Posted December 18, 2018 Very cool stuff. 1 Quote Link to post Share on other sites
Alphonse★ 453 Posted December 18, 2018 Share Posted December 18, 2018 That's awesome. Can't wait for them to apply it to more older games. Quote Link to post Share on other sites
DynamiteCop 2,085 Posted December 19, 2018 Share Posted December 19, 2018 Hopefully this can be applied to Switch games Quote Link to post Share on other sites
-GD-X★ 7,729 Posted December 19, 2018 Share Posted December 19, 2018 if only there was a way to mod the xbox one to play exclusives. Quote Link to post Share on other sites
Alphonse★ 453 Posted December 19, 2018 Share Posted December 19, 2018 2 hours ago, -GD- said: if only there was a way to mod the xbox one to play exclusives. There is 3 Quote Link to post Share on other sites
Mr. House 3,371 Posted December 19, 2018 Share Posted December 19, 2018 That's awesome. One of the problem with PS1 games using CGI backgrounds is that their ports always looks like shit due to the lower resolution. REmake HD was the best effort I ever seen at porting a game with CG backgrounds, but they had to rework entire assets to make it work and it still looked nowhere near as good as this. Quote Link to post Share on other sites
Remij 4,670 Posted December 19, 2018 Author Share Posted December 19, 2018 15 minutes ago, Ramza said: That's awesome. One of the problem with PS1 games using CGI backgrounds is that their ports always looks like shit due to the lower resolution. REmake HD was the best effort I ever seen at porting a game with CG backgrounds, but they had to rework entire assets to make it work and it still looked nowhere near as good as this. What I would love to see Capcom do is go back to REmake, and just take a look and see what can be done. There's been a lot of advancement in this field in the last 3 years.. It's not just taking the low res image and upscaling it... the neural network can actually add new information and detail never before possible... based on the fact that it can actually discern what objects are. The Nvidia presentation on this shit was fascinating. If they were to go back and run the backgrounds through the neural network and potentially fix them up quite a bit, that would be amazing. The shark area always stood out as fairly bad compared to other areas.. because it was fairly monochrome-ish and there wasn't enough high frequency information so things just kinda blurred together with the filtering they used. With machine learning though, they could add a lot of detail in that wasn't ever there because the network knows what the door is, it knows what the railing is.. it knows the lights and walls. It would reconstruct the image to look exactly the same but fill in the missing data of how it SHOULD look, with it's millions upon millions of references it has in it's database. They could then update the game with the high quality renders and then patch it to all of the versions of the game Take a look at these people... NONE of those people exist... they were all created by an AI. Watch this video: Fucking crazy shit. Quote Link to post Share on other sites
Mr. House 3,371 Posted December 19, 2018 Share Posted December 19, 2018 Thats scary af Quote Link to post Share on other sites
Playstation Tablet 1,725 Posted December 19, 2018 Share Posted December 19, 2018 This looks stupidly good, because somehow it's somehow close to the original art. Quote Link to post Share on other sites
Remij 4,670 Posted December 20, 2018 Author Share Posted December 20, 2018 So someone released an image of a REmake background enhanced using a type of AI upscaling. Of course there are multiple algorithms and things aren't perfect.. but the increase in detail and sharpness is undeniable. For fun I took a pic of the same background in-game and wanted to see how they compared. There's slight color differences because I think the person who made the upscale would have taken the actual file and processed it, so that's what the background looks like before the color filtering and bloom and effects are added to it. http://screenshotcomparison.com/comparison/126233 It's only going to get better as well. Quote Link to post Share on other sites
kokujin 558 Posted December 20, 2018 Share Posted December 20, 2018 On 2018-12-18 at 6:13 PM, -GD- said: if only there was a way to mod the xbox one to play exclusives. LMFAO Quote Link to post Share on other sites
kaz 2,439 Posted December 20, 2018 Share Posted December 20, 2018 34 minutes ago, kokujin said: LMFAO why are you laughing gaaiyjin? you the only japo with a xbox Quote Link to post Share on other sites
kokujin 558 Posted December 20, 2018 Share Posted December 20, 2018 1 hour ago, kaz said: why are you laughing gaaiyjin? you the only japo with a xbox I got a PS4 now. tu baka motto Tú Madré esu bitch desu onegai kher, kremlin-san. Quote Link to post Share on other sites
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.