Is there a list of all classes with it's class IDs and their corresponding bitmask values?
const classes_names = [
'FEMALE_FACE', 'MALE_FACE', 'FEMALE_GENITALIA_COVERED', 'FEMALE_GENITALIA_EXPOSED', 'BUTTOCKS_COVERED',
'BUTTOCKS_EXPOSED', 'FEMALE_BREAST_COVERED', 'FEMALE_BREAST_EXPOSED', 'MALE_BREAST_EXPOSED', 'ARMPITS_EXPOSED',
'BELLY_EXPOSED', 'MALE_GENITALIA_EXPOSED', 'ANUS_EXPOSED', 'FEET_COVERED', 'FEET_EXPOSED',
]
in the order of IDs starting with 0 for FEMALE_FACE.
In a mod, you can also call DetectionGD.classes_mask_from_names(['FEMALE_FACE', 'BUTTOCKS_COVERED'])
static func classes_mask_from_names(names : Array[String]) -> int:
var mask = 0
for name in names:
var index = DetectionGD.classes_names.find(name)
if index == -1:
prints("Classe", name, "not found")
continue
mask |= (1 << index)
return maskAlright, here is a little demo of how it could look like to give an AI character knowledge of what can be seen on screen and control over what is allowed and what is not: Hotscreen AI Demo
You can see at the bottom of the chat window the classes that are currently on screen and if they are allowed or forbidden on the right are actions that can be chosen by the AI. So with each character reply it can decide weather to allow a class that is currently forbidden or vice versa, that happens all autonomously via a hotscreen bridge within the platform and a custom mod in hotscreen talking to each other. The AI platform can use different services for TTS, SST and text-gen to bring everything to live.
It's called Voxta, a privacy focused, closed source project I'm contributing to: https://voxta.ai/. You can use local or cloud based models and it's highly customizable
Thanks! Yes you are right, we call it "Action inference". The LLM is guided to select (make a decision) from a fixed set of actions and parameters. The decision itself is influenced by the current context, the character鈥檚 personality, past interactions (and the LLM of course). It's an essential tool within Voxta to automate decisions and connect with the outside world, like spotify or light control (home automation basically) or toys (everything that has an API).