Plugins + Scripts Facial Motion Capture for Live Link Face (iOS) by Unreal Engine

[dollarsmocap]

dollarsmocap submitted a new resource:

Facial Motion Capture for Live Link Face (iOS) by Unreal Engine - use Live Link Face (iOS) by Unreal Engine

Credit,
LFE

Original resource,

Facial Motion Capture - Plugins + Scripts -

? Like this? Consider gifting the community a creation in my name or even a private gift to me. * I choose not to have a Patreon (love all you who do) Virt-A-Mate Facial Motion Capture Facial motion capture on newer iOS devices. Import and...

hub.virtamate.com

we added Live Link Face (iOS) by Unreal Engine support in it, this plugin may be deleted when the original developer accepts our pull request on GitHub.

Code,

GitHub - SunnyViewTech/FacialMotionCapture: Facial Motion Capture for Virt-A-Mate (NSFW)

Facial Motion Capture for Virt-A-Mate (NSFW). Contribute to SunnyViewTech/FacialMotionCapture development by creating an account on GitHub.

github.com

Read more about this resource...

 

[haremlife]

Thanks for this! I have had a terrible experience with the apple face tracking. It has a lot, I mean a lot, of flickering and overall issues. It doesn't track well the face at all. Maybe its even worse for be since I have a mustache and my mouth is partially occluded... But other things aren't great either... Ios face tracking system for example explicitly makes the two eyebrows tied! If you move one, both move on the character.

Overall, I feel like a good camera + machine learning should be way more effective than ios's face tracking system. There are systems like this for other platforms. Do you have some knowledge on this?

 

[Nameless Vagabond]

Is there any advantage to using the app you're recommending vs the one that was recommended by LFE?

Thanks in advance

 

[dollarsmocap]

Thanks for this! I have had a terrible experience with the apple face tracking. It has a lot, I mean a lot, of flickering and overall issues. It doesn't track well the face at all. Maybe its even worse for be since I have a mustache and my mouth is partially occluded... But other things aren't great either... Ios face tracking system for example explicitly makes the two eyebrows tied! If you move one, both move on the character.

Overall, I feel like a good camera + machine learning should be way more effective than ios's face tracking system. There are systems like this for other platforms. Do you have some knowledge on this?

Hi, I think considering the price, maybe we will not get something better than ARKit recently.

 

[dollarsmocap]

Is there any advantage to using the app you're recommending vs the one that was recommended by LFE?

Thanks in advance

Hi, they are basically the same, we just added one option.

 

[Nameless Vagabond]

What is the option?

 

[dollarsmocap]

We added Live Link Face as another option.

 

[huiyu914]

怎么设置那 手机app上找不到IP地址 不知道游戏里输入啥地址能连接上~

 

[huiyu914]

用live face 输入手机的ip地址 就能链接192.168.0.100 但Live Link Face不行 无论输入手机地址192.168.0.100 还是输入电脑ip地址192.168.0.109（手机上已经添加了目标） 都不行

 

[dollarsmocap]

用live face 输入手机的ip地址 就能链接192.168.0.100 但Live Link Face不行 无论输入手机地址192.168.0.100 还是输入电脑ip地址192.168.0.109（手机上已经添加了目标） 都不行

你好，抱歉没有仔细说明。插件端是不需要填入 ip 的，只需要填入监听的本机端口即可，默认是 11111。手机上已经添加了目标的话，确认下端口也是 11111，之后在插件端连接即可。

 

[huiyu914]

你好，抱歉没有仔细说明。插件端是不需要填入 ip 的，只需要填入监听的本机端口即可，默认是 11111。手机上已经添加了目标的话，确认下端口也是 11111，之后在插件端连接即可。

哈哈 学会了 效果还不错 不过有3个点感觉还有空间：
1、头部不能捕捉转动
2、嘴部说话感觉还不是很准确和实时，感觉还没办法直接去抖音直播~
3、整体反馈速度稍慢，比起live face，但是抖动问题比Live face好，感觉这块存在取舍问题~

整体很棒，期待更多面捕能力升级，有一天能直接直播以假乱真，那拐点就真来了，就太牛逼了！
附一个我之前用live face录的唱歌视频，感觉离活过来始终差点意思? ： 大爱杨丞琳如愿~_哔哩哔哩_bilibili

 

[dollarsmocap]

多谢，视频非常精美~

> 1、头部不能捕捉转动
是的，之后会加上

> 2、嘴部说话感觉还不是很准确和实时，感觉还没办法直接去抖音直播~
原作者为每个表情都开放了参数调整，针对人物仔细调一下的话应该会有提高，另一方面是插件中到的表情应该不全，得等几时哪位大佬补充一下。

> 3、整体反馈速度稍慢，比起live face，但是抖动问题比Live face好，感觉这块存在取舍问题~
是的，稳定和灵敏挺难两全的。

 

[gjonnyl]

你能帮我吗？我一直收到错误消息。当我打开LFE.FacialMotionCapture.Main.Plugin配置界面时，它是空白的。
!> 插件脚本初始化期间出现异常：System.ArgumentNullException：参数不能为空。
参数名称：hostNameOrAddress
在 System.Net.Dns.GetHostEntry (System.String hostNameOrAddress) [0x00000] 中 <filename unknown>:0
在 LFE.FacialMotionCapture.Controllers.DeviceController.get_IPEndPoints () [0x00000] 中 <filename unknown>:0
在 LFE.FacialMotionCapture.Controllers.UIController.InitializeStorables () [0x00000] 中 <filename unknown>:0
在 LFE.FacialMotionCapture.Controllers.UIController..ctor（LFE.FacialMotionCapture.Main.Plugin 插件）[0x00000] 中 <文件名未知>:0
在 LFE.FacialMotionCapture.Main.Plugin.Init () [0x00000] 中 <文件名未知>:0
在 MVRPluginManager.CreateScriptController (.MVRPlugin mvrp，DynamicCSharp.ScriptType 类型) [0x00000] 中 <filename unknown>:0