All-in-one suite for mic-only lip-syncing characters! · By
I’m on linux, so i “ported” the “new character” script to bash, and in doing so found a bug. When a character.json file is completely empty, the program starts acting very weird:
On startup, it loads an empty character. Makes sense, no images are mapped in the file. However, the “change character” menu now contains a list of layers instead of character names. If i try to select a layer from the dropdown, the program tries to load whatever character would be there if the list didn’t contain layer names, but fails. It just hangs.
The hanging may be a linux/wine issue (wine reports that it hits a stub), but the weird dropdown feels like a bug.
For reference, here’s the bash script (without the bug):
#!/bin/bash
# Usage: ./new_character.sh "Character name"
# If omitted, character name defaults to "New Character"
char_name=${1-"New Character"}
count=$(( $(ls -d */ | wc -l) + 1 ))
dir_name="$count $char_name"
mkdir -p "$dir_name/images"
echo '{}' > "$dir_name/character.json"
Howdy! Been working on a prototype model so I can get used to the program and been enjoying it so far! Have one bump on the road that I've been stuck in and not sure if this is something that can be fixed within HONK, or something to do with my files on Photoshop
Description: I have one part of the lipsync that reacts correctly, but the rest are shifted away from the mouth/look like they are set in the wrong position and look off. I tried to redo the layering in HONK, repositioned and exported the png files from Photoshop, and I still encounter the issue.
Steps taken before encoutering the bug: I set up my layers after I export all layers from the Photoshop file from a 4500 x 4500 canvas. I don't move the mouth base in case that was the issue, but the problem still occurs with the mouth out of sync when speaking.
Screenshots:
Normal mouth sync that works. This one labeled as the constanant mouth (C, D, K, etc sounds.)
Lipsync shifted left from the face. This is an issue with the rest of the mouth lipsync images
I also have a video that showcases the issue before/after I add one more mouth sprite.
From what I've read, I understand that the lipsync feature is still in the works, but I'd like to know if there is any step that I may have overlooked to resolve this issue if possible. If there is anything else you need from me, let me know. Thank you again!
Thank you for the video! I'll try out some different mics and framerates.
It definitely gets more "shock"-y the faster your computer is. I've got an idea of how to fix it.
I can't reproduce on my end to be as extreme as it is in the clip. But, I was able to recreate it a bit and address what I saw on my end. Let me know if 3.0.2a (just released) looks better on your machine/character.
This is something that will continue to need tuning over time with the new audio system, but hopefully this patch addresses the worst of it.
hi, i wanted to give a quick update on this! i tried out the temporary workaround i mentioned (trimming down all my separate png parts to remove excess transparency) and re-rigged my model. it definitely helped with placing larger parts, but i found it was still really difficult to work with smaller parts that overlap each other - eyes/mouth/glasses/etc was a pretty rough time.
i also found while working on different emotes that the "unclick" selection (idk what else to call it, but the fact that it will select a nearby piece as soon as i RELEASE the mouse after dragging a different piece into place) will grab pieces that are invisible on the emote you're working on. i don't remember if this happened at all in the video i sent initially -- i don't think so, but i also think i just didn't work on emotes during that session. sorry that i don't have a video this time! i'll just try to explain as best as i can... let's say there's an arm piece that's enabled for emote 2, but not emote 1. while trying to move pieces on emote 1, sometimes the "unclick" would grab that emote 2 arm, even though it's not even visible on the emote 1 layer. (this would also become a mildly annoying issue when i was trying to click away/into blank space on the honk screen just to deselect stuff, and instead i'd end up selecting a hidden piece from a different emote that i didn't realize was there). i figured i'd mention it since it seems like it's potentially related to the overlap issue!
thank you again for all your work on this!
Hello!
Just a heads up of what I found and how I fixed it.
I downloaded the latest 3.0 patch, copied my character over, fired it up and was greeted with a blank screen. All of the menus on the top presented the Choose Layer dropdown options rather than whatever they were supposed to. Selecting one of the layer options on the character tab tried to load the character, but froze completely.
The culprit was extra non-image files in the images folder of the character I brought over. Stuff like PSD files that I just copied and pasted when I originally made it. In 2.0, the extra files weren't an issue, and the character worked fine. In 3.0, though, the extra files apparently break everything. Deleting the extra files and relaunching the program fixed everything.
Cheers!
Ah! That's a fun one. I'll add the ability to ignore non-supported file extensions.
HONK was trying its best! Nice catch.
I'm also having this issue. The character just randomly 'chitters' when the mic is muted. I haven't timed it. Relaunching sometimes fixes it, most the time, not. I don't have any sprite follows on my character. Just blinking and lip syncing.
Hello @DreamToaster,
I'm facing a bug with moving mouths.
My microphone is well recognized as you can see on the first picture, yet no mouth of any character move.
The eyes tracking works (you can see the eyes looking at the right top corner on the second picture), but not the mouth.
Do you have any solution ?
Waiting for your answer.
Toruk
Edit : Sometimes, when I change the mic selection and then go back on my main mic, it works for a few moments before it stops working again.
(Please excuse my english, it's not my first language ><)
I don't know if this solves your issue but it only responds to input when the window isn't focused. Click on your computer taskbar and then see if it responds. This tripped me up a bit so just wanted to chime in in case this was the issue but if not and it still isn't responding then I dunno what the issue is.
