Photorealistic videos!

[pineapples]

I recently came across this video on YouTube. It is clearly a VAM scene. In fact, if I'm not mistaken it looks like a VamTimbo scene. To my eyes the character, her hair, her clothes, etc appear very photorealistic. Moreso than other VAM videos I've seen.

Any idea what sort of hardware and game settings I would need to achieve this level of realism?

 

[Clownmug]

Hardware wouldn't make a difference other than reducing rendering time. The creator most likely used a plugin like Eosin's Video Renderer to render the video without frame drops. With that plugin they could just max out all the game settings without any issue. Also, on top of that they would likely be using a post processing plugin like MacGruber's PostMagic to further enhance the image. There could be other plugins involved as well such as Hunting Succubus's Subsurface Scattering Skin.

Another thing to consider is the quality of the character model and the use of mocap animation. The clothing items seem to be very high quality. They have very little distortion or clipping while in motion and likely use high resolution textures along with good sim textures. The hair most likely consists of multiple pieces with the highest quality setting and certain pieces having style/physics settings tweaked to maintain shape. The skin textures are likely all 4k and skin settings were probably tweaked to look best with the lighting of the scene. The animation is very smooth and doesn't have an extreme range of motion. It makes it feel very natural while minimizing anomalies like the stiffness of certain hair pieces.

There are probably a bunch of other things to consider that I missed. This is all I can think of for now though.

 

[SlimerJSpud]

It's absolutely Vam, because there's a "Hide UI" button on the back wall. The hair does a few unnatural things like clip through her shoulder and hand on her right side. this scene has excellent sim on the clothes, and very good lighting. The problem I've had with Eosin's video renderer is when the clothes massively clip through the figure during dance moves. I tried to render a video of my Hot for Teacher scene, and it was a disaster. I never did find a solution for that. Perhaps another video capture method was used here.

 

[hazmhox]

Guyz. It's AI.
It's like the nose in the middle of your face

The stability of shadows, the creases going nuts around the armpits, the face shape shifting drastically in side views... c'mon, you are better than this

I'm not saying it's not VAM. I'm saying this does not look like this in VAM and there are hours of rendering to get to that result. This is not realtime.

 

[Clownmug]

It definitely started in VaM at least, they just used AI as part of their video editing workflow. You can see the built-in "OldSchoolVanityStool" in the background at the beginning. The scene itself could've started from one of these existing scenes.

[Environment] Photo Studio for Virt A Mate - Environments -

Environment Photo Studio for Virt A Mate

hub.virtamate.com

[MMD Stage] Photo Studio - Scenes -

DISCRIPTION: Only tested on VaM 1.22.0.3 Animations and models are not included. How to Use: #1 Use the canvas buttons on the upper left corner to toggle the assets as you like, press F5 to toggle the buttons themselves. #2 Load MMD plugin to...

hub.virtamate.com

 

[hazmhox]

they just used AI as part of their video editing workflow

As I was saying. I'm not saying it's not VAM. But we're far beyond "video editing". It's not advertised as VAM luckily, but we're light years away from VAM what can do. It's a huge work of offline rendering on top. That's not like a "slap bloom" and call it a day ^^

 

[NameUsername]

I actually posted first that it looked like AI to me (on top of VaM) originally but deleted my post because i thought i could be wrong. It can look really good and possibly even that good but something about the movements made me feel like it was AI making a VaM recording better.

 

[SlimerJSpud]

I see quite a bit of the hands clipping into the outer layers of clothing. Vam does that a lot. If AI's involved, it didn't fix that. One of my telltale signs of AI is whenever the hands pass in front of the face, the face goes blurry, especially the mouth. In this one, the hands get close to the chin, but they don't pass in front of the mouth. Although the movement of the clothing and body is very smooth, the movement of the hair isn't. The movement of the hair doesn't look that natural to me.

 

[pineapples]

As I was saying. I'm not saying it's not VAM. But we're far beyond "video editing". It's not advertised as VAM luckily, but we're light years away from VAM what can do. It's a huge work of offline rendering on top. That's not like a "slap bloom" and call it a day ^^

Oh I see, so it's a VAM recording that's been post-processed with AI.

This is the VAM scene used, it's from VamTimbo :https://hub.virtamate.com/resources/vam-photoshoot.41923/

I will say it's pretty incredible what AI post-processing can do to videos. Would you be able to point me in the direction of how I can use AI to post-process my own VAM recordings? I would like my own VAM recordings to look like this, too.

 

[hazmhox]

I will say it's pretty incredible what AI post-processing can do to videos. Would you be able to point me in the direction of how I can use AI to post-process my own VAM recordings? I would like my own VAM recordings to look like this, too.

I have absolutely no idea what is used as I enjoy doing virtual photography and appreciate the actual challenge of making something out of the engine look good.

Maybe someone else can help. But, know that this is not a software you'd click a button and go "make this nicer". To get to that fidelity and result with AI "beautifying" there is a LOT of work. Even tho the things I said above are kind of obvious if you look for clues, this is probably one of the cleanest thing I've seen... so, be ready for hours of work/computation.

 

[cmramlow]

@pineapples if you think that video looks photo real check these out

https://hub.virtamate.com/media/users/k52252467.33172/

https://www.youtube.com/@MMDWR

I've been trying for over a year to learn an easier way than how he does these with no luck. I know AI tools will soon be just a click or two to produce them instead of some cumbersome Comfy UI setup.

This is where VAM type games are headed with either an AI post processing that transforms the mundane into photorealism in real time or just creates the sandbox game itself from a prompt producing indistinguishable a photorealistic sandbox like vam.

Re: https://hub.virtamate.com/threads/how-to-vam-video-to-ai-sd-video.60018/

 

[hazmhox]

This is where VAM type games are headed with either an AI post processing that transforms the mundane into photorealism in real time or just creates the sandbox game itself from a prompt producing indistinguishable a photorealistic sandbox like vam.

lolnoes they're not. The industry hardware already struggles to render raytracing @ 720 over DLSS... games are not heading to "AI whatever" which barely can output a proper stable image at the moment at 1 frame every 15secs (and I'm kind with that 15secs).

 

[hazmhox]

Don't be sad @cmramlow
Someday we'll have realtime raytracing, and it's gonna kick ass far more than stupid AI

 

[murn]

Good gpu, reshade, lighting setup and a bit of AI? maybe as hazmhox pointed out. There are Koreans that spend a lot of money to have really good builds to be able to make scenes look great.

 

[cmramlow]

Hey @murn! I've got a very high end rig and and I can get very close to this already, but VAM faces are the hardest to make look real. I dont know if the cause of that is:

- face textures
- lighting
- expressions
- movement
- something else?

But after rewatching the video I think it's the face with the right "lighting" which looks more realistic than 95% of the vam girl faces we see plus I bet it's recorded with Render to Video which smooths movement/frames out.

I dont see AI used in any of his other videos and none of the ones I spot checked, even the most recent ones look nearly as good: https://www.youtube.com/@害羞的铅笔/videos

I think he just got lucky, like some of us do, where the lighting happens to be setup perfectly, and this look turned out realistic.

 

[Clownmug]

Hey @murn! I've got a very high end rig and and I can get very close to this already, but VAM faces are the hardest to make look real. I dont know if the cause of that is:

- face textures
- lighting
- expressions
- movement
- something else?

But after rewatching the video I think it's the face with the right "lighting" which looks more realistic than 95% of the vam girl faces we see plus I bet it's recorded with Render to Video which smooths movement/frames out.

I dont see AI used in any of his other videos and none of the ones I spot checked, even the most recent ones look nearly as good: https://www.youtube.com/@害羞的铅笔/videos

I think he just got lucky, like some of us do, where the lighting happens to be setup perfectly, and this look turned out realistic.

I checked out the bilibili account shown there awhile ago and it looked like there's a post showing their hardware specs and a link of tutorials for AI video conversion there. I'm just going by Google translate though.

Info Post:

验证码_哔哩哔哩

Tutorials link:

夸克网盘分享

夸克网盘是夸克推出的一款云服务产品，功能包括云存储、高清看剧、文件在线解压、PDF一键转换等。通过夸克网盘可随时随地管理和使用照片、文档、手机资料，目前支持Android、iOS、PC、iPad。

pan.quark.cn

 

[checkking]

It's a vid2vid technique. One of the easiest AI video generation that can be used. While preparing everything in comfyui and learn how to use it is not trivial, once it is setup, it is "almost" a one-click button (but a lot of GPU ressources). Where you may have to run parts of the video more than once and then it's a "run again until it works" workflow. The closer the original video is to what you want, the more you can make a high quality video, because it's stable.

 

[cmramlow]

Exactly @checkking, I tried the whole comfyui fiasco months ago using stability-matrix and other easy installer tools but it just wasn't baked enough needing much more work to make it function without show stopping error after error until I walked away to pick up once much more mature. Have you been able to get a stable working realistic vid2vid?

 

[HotlineVam]

@pineapples if you think that video looks photo real check these out

https://hub.virtamate.com/media/users/k52252467.33172/

https://www.youtube.com/@MMDWR

I've been trying for over a year to learn an easier way than how he does these with no luck. I know AI tools will soon be just a click or two to produce them instead of some cumbersome Comfy UI setup.

This is where VAM type games are headed with either an AI post processing that transforms the mundane into photorealism in real time or just creates the sandbox game itself from a prompt producing indistinguishable a photorealistic sandbox like vam.

Re: https://hub.virtamate.com/threads/how-to-vam-video-to-ai-sd-video.60018/

The quality of the recordings and editing of the videos is very good but the content is horrible. The breasts thrash around uncontrollably and are far from realistic. But maybe that's exactly what many people want.

 

[sdfg3456]

The quality of the recordings and editing of the videos is very good but the content is horrible. The breasts thrash around uncontrollably and are far from realistic. But maybe that's exactly what many people want.

I think that's just collision between the colliders in the breasts and other parts of the body. Easily solvable with collider editor mod and/or naturalis.

 

[HotlineVam]

I think that's just collision between the colliders in the breasts and other parts of the body. Easily solvable with collider editor mod and/or naturalis.

I know it's easy to improve. I'm just wondering why the video creator doesn't do that. but as already written maybe he's into it.