Photorealistic videos!

[pineapples]

I recently came across this video on YouTube. It is clearly a VAM scene. In fact, if I'm not mistaken it looks like a VamTimbo scene. To my eyes the character, her hair, her clothes, etc appear very photorealistic. Moreso than other VAM videos I've seen.

Any idea what sort of hardware and game settings I would need to achieve this level of realism?

 

[Clownmug]

Hardware wouldn't make a difference other than reducing rendering time. The creator most likely used a plugin like Eosin's Video Renderer to render the video without frame drops. With that plugin they could just max out all the game settings without any issue. Also, on top of that they would likely be using a post processing plugin like MacGruber's PostMagic to further enhance the image. There could be other plugins involved as well such as Hunting Succubus's Subsurface Scattering Skin.

Another thing to consider is the quality of the character model and the use of mocap animation. The clothing items seem to be very high quality. They have very little distortion or clipping while in motion and likely use high resolution textures along with good sim textures. The hair most likely consists of multiple pieces with the highest quality setting and certain pieces having style/physics settings tweaked to maintain shape. The skin textures are likely all 4k and skin settings were probably tweaked to look best with the lighting of the scene. The animation is very smooth and doesn't have an extreme range of motion. It makes it feel very natural while minimizing anomalies like the stiffness of certain hair pieces.

There are probably a bunch of other things to consider that I missed. This is all I can think of for now though.

 

[SlimerJSpud]

It's absolutely Vam, because there's a "Hide UI" button on the back wall. The hair does a few unnatural things like clip through her shoulder and hand on her right side. this scene has excellent sim on the clothes, and very good lighting. The problem I've had with Eosin's video renderer is when the clothes massively clip through the figure during dance moves. I tried to render a video of my Hot for Teacher scene, and it was a disaster. I never did find a solution for that. Perhaps another video capture method was used here.

 

[hazmhox]

Guyz. It's AI.
It's like the nose in the middle of your face

The stability of shadows, the creases going nuts around the armpits, the face shape shifting drastically in side views... c'mon, you are better than this

I'm not saying it's not VAM. I'm saying this does not look like this in VAM and there are hours of rendering to get to that result. This is not realtime.

 

[Clownmug]

It definitely started in VaM at least, they just used AI as part of their video editing workflow. You can see the built-in "OldSchoolVanityStool" in the background at the beginning. The scene itself could've started from one of these existing scenes.

[Environment] Photo Studio for Virt A Mate - Environments -

Environment Photo Studio for Virt A Mate

hub.virtamate.com

[MMD Stage] Photo Studio - Scenes -

DISCRIPTION: Only tested on VaM 1.22.0.3 Animations and models are not included. How to Use: #1 Use the canvas buttons on the upper left corner to toggle the assets as you like, press F5 to toggle the buttons themselves. #2 Load MMD plugin to...

hub.virtamate.com

 

[hazmhox]

they just used AI as part of their video editing workflow

As I was saying. I'm not saying it's not VAM. But we're far beyond "video editing". It's not advertised as VAM luckily, but we're light years away from VAM what can do. It's a huge work of offline rendering on top. That's not like a "slap bloom" and call it a day ^^

 

[NameUsername]

I actually posted first that it looked like AI to me (on top of VaM) originally but deleted my post because i thought i could be wrong. It can look really good and possibly even that good but something about the movements made me feel like it was AI making a VaM recording better.

 

[SlimerJSpud]

I see quite a bit of the hands clipping into the outer layers of clothing. Vam does that a lot. If AI's involved, it didn't fix that. One of my telltale signs of AI is whenever the hands pass in front of the face, the face goes blurry, especially the mouth. In this one, the hands get close to the chin, but they don't pass in front of the mouth. Although the movement of the clothing and body is very smooth, the movement of the hair isn't. The movement of the hair doesn't look that natural to me.

 

[pineapples]

As I was saying. I'm not saying it's not VAM. But we're far beyond "video editing". It's not advertised as VAM luckily, but we're light years away from VAM what can do. It's a huge work of offline rendering on top. That's not like a "slap bloom" and call it a day ^^

Oh I see, so it's a VAM recording that's been post-processed with AI.

This is the VAM scene used, it's from VamTimbo :https://hub.virtamate.com/resources/vam-photoshoot.41923/

I will say it's pretty incredible what AI post-processing can do to videos. Would you be able to point me in the direction of how I can use AI to post-process my own VAM recordings? I would like my own VAM recordings to look like this, too.

 

[hazmhox]

I will say it's pretty incredible what AI post-processing can do to videos. Would you be able to point me in the direction of how I can use AI to post-process my own VAM recordings? I would like my own VAM recordings to look like this, too.

I have absolutely no idea what is used as I enjoy doing virtual photography and appreciate the actual challenge of making something out of the engine look good.

Maybe someone else can help. But, know that this is not a software you'd click a button and go "make this nicer". To get to that fidelity and result with AI "beautifying" there is a LOT of work. Even tho the things I said above are kind of obvious if you look for clues, this is probably one of the cleanest thing I've seen... so, be ready for hours of work/computation.

 

[cmramlow]

@pineapples if you think that video looks photo real check these out

https://hub.virtamate.com/media/users/k52252467.33172/

https://www.youtube.com/@MMDWR

I've been trying for over a year to learn an easier way than how he does these with no luck. I know AI tools will soon be just a click or two to produce them instead of some cumbersome Comfy UI setup.

This is where VAM type games are headed with either an AI post processing that transforms the mundane into photorealism in real time or just creates the sandbox game itself from a prompt producing indistinguishable a photorealistic sandbox like vam.

Re: https://hub.virtamate.com/threads/how-to-vam-video-to-ai-sd-video.60018/

 

[hazmhox]

This is where VAM type games are headed with either an AI post processing that transforms the mundane into photorealism in real time or just creates the sandbox game itself from a prompt producing indistinguishable a photorealistic sandbox like vam.

lolnoes they're not. The industry hardware already struggles to render raytracing @ 720 over DLSS... games are not heading to "AI whatever" which barely can output a proper stable image at the moment at 1 frame every 15secs (and I'm kind with that 15secs).

 

[hazmhox]

Don't be sad @cmramlow
Someday we'll have realtime raytracing, and it's gonna kick ass far more than stupid AI