Real time lip sync in Godot.

:information_source: Attention Topic was automatically imported from the old Question2Answer platform.
:bust_in_silhouette: Asked By earlroxas

Hello guys, I’ve been making a lip sync algorithm for my game. In the current state my algorithm is very simple, it just read the dB value of Audio every frame and animating the mouth to open when dB value reach certain point.
Of course with this method the lip sync is ok, but not so good. So I want to make it as good as possible, the current target is like the lip sync in VRChat or maybe like this Unity Asset.
So can you point me to the right direction about it? Maybe a sample code (doesn’t matter the programming language) or Some paper/article about it? of course that can be implemented with the current Godot that I used (Godot 3.0.x or 3.1a).
Thank you!

Not sure if will help much but check this
Spectral Visualizer - Godot Asset Library

eons | 2018-09-25 00:19