OpenPose Character Model

[rtzrtz]

Hi fam,

do you guys think it would be possible to create a Character Model that looks like an OpenPose stick-figure?

It would be amazing to use vam as a pose-editor for OpenPose.

 

[TBD]

VaM can give you detailed position data for each bone. Rendering that to an image to estimate the pose from later seems unnecessarily complicated and lossy. It's possible, though.

 

[rtzrtz]

VaM can give you detailed position data for each bone. Rendering that to an image to estimate the pose from later seems unnecessarily complicated and lossy. It's possible, though.

Thanks! The idea is to use that open pose stick figure to render something withs table diffusion.

 

[TBD]

Thanks! The idea is to use that open pose stick figure to render something withs table diffusion.

Sure, I get that. Rendering such an image and feeding it into controlnet will work. I'm just saying there's a better way if you can make use of pose data instead of an image.

 

[AWWalker]

you don't even have to do that lol, i just use vam screen shots as the base pose and put them in stable diffusion, and let it handle it. better results too. Except she's holding the sword by the blade... wtf.

Spoiler: Generation Text

Blonde haired,25 year old woman,in battle gear,swing a two handed sword,, high resolution, detailed, raw photo, sharp re, nikon d850, film, 4 kodak portra 400 camera, f1.6 lens, rich colors, hyper realistic, lifelike texture, dramatic lighting, unrealengine, cinestill 800, photorealistic, photo, realistic, realism, photorealism, high contrast, photorealistic, 8k, HD, high definition, detailed realistic, detailed, skin texture, hyper detailed, realistic skin texture

Negative prompt: plaid, canvas frame, (high contrast:1.2), (over saturated:1.2), (glossy:1.1), cartoon, 3d, ((disfigured)), ((bad art)), ((b&w)), blurry, ((bad anatomy)), (((bad proportions))), ((extra limbs)), cloned face, (((disfigured))), extra limbs, (bad anatomy), gross proportions, (malformed limbs), ((missing arms)), ((missing legs)), (((extra arms))), (((extra legs))), mutated hands, (fused fingers), (too many fingers), (((long neck))), Photoshop, video game, tiling, poorly drawn hands, 3d render, (worst quality:1.4), (low quality:1.4), (monochrome:1.1), easynegative, bad-artist-anime, bad-image-v2-39000, bad_prompt_version2, bad_quality, ng_deepnegative_v1_75t, verybadimagenegative_v1.1-6400, vile_prompt3, bad-hands-5,watermark, font, text, negative_hand-neg, zombie, watermark, username, patreon username, patreon logo, censored, bar censorm 3d, 3d render, painting, digital painting, watermark, sepia, black & white,EasyNegative,verybadimagenegative_v1.3,NG_DeepNegative_V1_75T,(worst quality:2), (low quality:2), (normal quality:2), lowres, normal quality, ((monochrome)), ((grayscale))

Steps: 29, Sampler: DPM++ 2M SDE Karras, CFG scale: 7, Seed: 2189913323, Size: 512x768, Model hash: 5594efef1c, Model: aZovyaPhotoreal_v2, ControlNet 0: "Module: openpose_full, Model: control_v11p_sd15_openpose [cab727d4], Weight: 1, Resize Mode: Crop and Resize, Low Vram: False, Processor Res: 512, Guidance Start: 0, Guidance End: 1, Pixel Perfect: False, Control Mode: ControlNet is more important", TI hashes: "easynegative: c74b4e810b03, ng_deepnegative_v1_75t: 54e7e4826d53, verybadimagenegative_v1.3: d70463f87042", Version: v1.7.0-1-g508f37ca

 

[AWWalker]

With the same image, you can see that the pose is maintained, and i didn't have to fuck around wtih the stupid dots and lines.