Hello,
I'm a dev, I've created a linux version of HS with your hugging face model. It's running smoothly at 32fps with perfect zone coverage on X11. I will build a wayland version soon.
I'd like to know if you'de be interrested in the code and maybe a collaboration.
My email address is bibiyotek@proton.me
I also have few thousands of annotated images and more data never hurts. How can I provide them to the project?
Nice !
I will work on the Linux version when the Hotscreen 1.0 will be ready, so I know all the features I have to adapt to Linux. I will maybe ask you some help because I have never used X11 and wayland.
What did you use to annotate images ? I manually annotated my dataset myself... xD
Unless your images are licensed under Creative Commons, I fear to have legal issues of using copyrighted images. Maybe it's stupid considering that many people are selling Loras (image generation models) trained on copyrighted images, but I will try to stay as clean as possible.
I created a small annotation tool : I run your model and can add/move/remove/resize/change bounding boxes. Since I also annotated videos (sampled at 4 fps), I found that many video frames are actually motion blurred and that the model had trouble detecting zones in those cases. I use an adaptative threshold to lower the entry for bb with the same class that were near the same location on the previous frame. That way when you correct an image for a frame, the model usually can keep track of it even when it wouldn't normally do so.
I found my videos/images on reddit, on public threads. I'm not sure if you would be ok with that, just tell me.
I've added some features for myself that can be tuned/remove later :
- elliptical censored zones,
- iddling mode (when no sensitive classes are detected for a while, the app goes dormant, only sampling the monitor at 0.5 fps and disabling expensive gpu paths. A detection of a sensitive content trigger the app within those 2 seconds so you can peak before censor comes up, which is a drawback.
- progressive censorship over time : censor starts light and gets heavier and heavier, not having any activity makes its slowly back to it's initial state.
Also I might not have implement the same solution as you : I perform desktop windows composition myself on gpu, run detection, pixelation and display a full screen overlay with the original window censored. With that approach there is always a perfect synchronisation between what is displayed and the censor mask but it might be challenging to reach higher fps. What it is your approach?
