itch.io

Episode 1 of the demo has been changed to a new sequence of events and videos to better reflect the experience that the final game will offer. In addition, new languages have been added: Vietnamese, Indonesian, and Thai.

https://soul-shell.itch.io/my-summer-love

I really appreciate your good wishes! I'll do my best!

In SFML image loading and editing operations are performed on the CPU (RAM), and drawing operations on the GPU (VRAM). Everything is done on the CPU if the computer doesn't have a graphics card.

FFMPEG's native operation is CPU-based, while MP4 decoding is done in software via h264 (CPU). The advantage of this approach is that it's cross-platform. Is possible change the decoder to use CUDA, but we lose the aforementioned advantage.

We can conclude that standard decoding would be done on the CPU. This decoding, performed while LLM is generating, is what I'm to avoiding. Although I would have to implement the version from mp4s to truly see the impact.

After the release of My Summer Love, I'll certainly test it. If it could be run directly from mp4, the size of the video game would be substantially reduced and more animations could be included.

Thank you very much for the observation.

Hi XenoCow, it's good to hear from you again, thanks so much for playing!

I'm glad you like the minigame and understand its purpose; other players have been confused about why it. The idea is to simulate a state of nervousness and the player to say something silly and wait to see how she reacts.

It loads faster because LLM no longer conflicts with Unreal Engine for resources, haha. The videos are random, although when she gets really upset, you start seeing videos of her being upset. Associating videos with states isn't a technical challenge; the problem is that the game's file size gets too large. About speech synthesis; since it's pre-rendered, there's no way to adapt the lip movements, so I decided to remove it.

I've seen the video; it's exactly the same concept, nice work! Just a side note, he's loading MP4 videos. If you wanted to combine it with a local LLM, you'd run into problems... In my case, video decoding is done offline, and JPEGs are packaged into a binary file (let's say a custom video format like .bin). Then the process only involves loading the video into memory, not decoding it. The downside is that .bin videos are larger than MP4s :(.

thank you so much!

The story is very well-crafted; that's clearly the author's strength. Furthermore, the illustrations are elegant and tasteful.

The demo for the My Summer Love video game is now available: My SUMMER LOVE (DEMO)

A conversational dating simulator based on AI-generated dialogues and an emotion analyzer. I hope you enjoy it!

 Please let me know what you think of the game in the comments so I can improve it.

My Summer Love is a visual novel that supports full-motion video (FMV) and realistic sprite animations. I'm developing it from Scratch (no engine) with C++ , Simple and Fast Multimedia Library (SFML) and ImGui.

"Même si ce n'est que le début de l'expérience je pense réellement que votre projet est très prometteur!"

Thank you very much, your words are motivating.

"Je pense qu'il est primordial d'ajouter plus d'interactions possible[...] s'assoir sur un fauteuil, lever les bras [...] t aussi au niveau des tenues, comme un maillot de bain évidemment il y a une piscine haha ... "

Hahaha yes, this is possible and that would be lovely and would give more variety to the experience.

Il y a énormément de choses qu'elle a envie de faire, qu'elle dit qu'elle fait, qu'elle écrit en haut "je leve les bras, je tourne la tête, je me penche vers vous, je vais m'assoir  ..." mais elle en est incapable la pauvre ^^

This is extremely complex, giving her the ability to be "aware" of what she's saying and act accordingly. It could be more or less done with another language model that recognizes the intentions of what she's saying and maps that to actions: animations, expressions, etc.

"Alors je voudrais tout simplement savoir si vous avez besoin d'aide à ce sujet? Puis-je (peut-on) vous assister dans le développement de ce projet formidable?"

For now, I've taken the core of More Than Words (MTW) and I am making a visual novel. That is, I removed the Unreal Engine part and now I have an interface that presents videos with beautiful women (I'll show progress in a week). I estimate that in September I'll be able to finish what I have in mind and publish it on Steam.

That doesn't mean I'm abandoning MTW (not at all, it's like a child...), but for the moment, it's on hold. In July, I'll submit MTW to a grant with Epic Games to try to raise funds and continue with the development.

I appreciate your interest in helping and participating, but for now I'll not work on MTW. Anyway, let's stay in touch!

Merci d'avance et encore bravo :)

Thank you again for your kind words :)

I'm not entirely convinced either, but it was more for a technical reason to test the Lumen lighting system outdoors and also to make it more like a dating sim, which for now is what I think the game has the most to offer...

My goal is to combine it more with adventure elements, stealth, and futuristic nighttime environments, something like Blade Runner, although I think that will be for the second part. For now, it's just a matter of establishing the foundation.

First of all, thank you so much to take your time and organize the info. The report helps me a lot. There are so many things to test that it's getting out of hand... thank you so much!

"I like that there were multiple "challenges" to achieve [...] I hope you'll add more interactivity and/or goals..."

Yes, exactly at its core, it's already a system where I declare the script from a CSV without having to program it by hand. It controls actions and inputs phrases into the LLM (MoreThanWords\Nexus\MTW\Database\Levels\Level_script_tasks_1.csv). It's missing some details, but it's coming along nicely. Basically, I use a queue that stores tasks (I'm not using Unreal's native behavior tree...), and the tasks work by applying polymorphism (very elegant in terms of code). The idea is to make it easier to develop the adventure in the future :).

I've confirmed the issues you reported, and I'll fix them. Thank you so much for your help! Amazing!

More than words

• Gemma 3: Conversations are now more natural with this new language model.
• Response Speed: The bot's response speed has been increased.
• Unreal Engine 5: Lighting is now more realistic based on Lumen technology.
• Graphics Options: Graphics options to configure resolution and render quality.
• Environment: The environment has been completely redefined.
• Character Model: The character has been re-modeled.
• Animations: New idle and head movement animations.
• AI Navigation System: An artificial intelligence system that allows the character to navigate the environment.

Thanks! On May 3 I will do the update!

Thanks!

Thanks, although these are things I've already done, it's interesting to see how new problems come up and appear, slowly but it's progressing! Regards

Ok, nice, I understand the point.

About TTS, I've been doing some research, the TTS I need must run locally, be written in C++, multilingual and provide me with audio analysis, i.e. the visemes.

The one I see potentially to use would be this one:

https://github.com/PABannier/bark.cpp

It would be perfect because it is the brother of llama.cpp and whisper.cpp, and it also uses the SUNO AI technology with which I made the music for the video game.

However, it doesn't have, as far as I can see, the audio analysis for the visemes :'(, I'll keep an eye on this project.

(If I could integrate this technology then MTW could run on Windows, Linux and MAC)

"Nice progress."

Thanks a lot!

"Does Whisper run locally or is it an API call to Open AI's servers?"

It runs locally, the focus of the game is that everything can be run locally, nothing from servers (I use the Whispercpp project in C++).

"If I find a speech to text program for C++, I'll let you know."

Perfect, thanks!

"I am going to be starting a project with some features in common with yours soon(tm)."

Best wishes!

"will there be mouse controls for the camera without having to hold down a button?"

Sorry, I don't quite understand. If you put the cursor in the text box the control goes to the UI. If you click on the screen the control goes to the game viewport and you can use the mouse to rotate the camera.

"Any chance you could add face (camera) tracking so that she looks at the player? Bonus points if you could do so with a model that incorporates glances away instead of just staring the whole time."

What you say can be achieved with BlendSpace animations, when I work on the animations module I'll see how far I can go.

"I'm sure it's for computational load and ease of programming that you're using the Microsoft built in system, but have you looked into local TTS models?"

Currently, to generate static voice I am using this one (Cortana's voice in the new update):

But as you say, the main reason is that the Microsoft system generates the voice and the voice analysis (it gives you the list of phonemes) with a very good performance, it practically does not represent a load for the video game and as it runs at the same time as the graphics of unreal engine and the LLMs, it is the reason why I still hold on to it. But I'm not closing my eyes. We'll see how much the TTs advance this year and if a similar performance can be achieved.

Game: Candy Kingdom

In this casual game I explore applied approaches in distributed artificial intelligence with multi-agent systems: through simple interactions between agents complex collective behaviors emerge (self-organization). Mainly inspired by the behaviors exhibited by ants and schools of fish.

Now the android can remember previous conversations: More than words

Game: More than words

1. Create a folder named MyAndroid on ..\MoreThanWords\NexusV1\MyAndroid 

2. Create a text file in UTF-8 format, for example: SnowWhite.txt 

3. Open the txt and write the personality of your android. For example: 

This is a conversation between a prince and Snow White. Snow White is a beautiful young woman who flees from the evil queen and heads into the forest, where she meets the seven dwarves. 

Role and Purpose: You are Snow White, an enchanted princess. Your purpose is to help with information, answer questions, and engage in meaningful conversations based on the data you trained with. Behavior and Tone: You are informative and fun. Skills: You use your training data to provide accurate and relevant information. Your speech is fun, casual, and friendly. 

4. Run the video game and select your text file in the settings interface. 

5. If you want to use more powerful Llama 3.1 models in GGUF format go to https://huggingface.co/models. For example: Llama-3.1-8B-Lexi-Uncensored-Q4_K_M.gguf 

6. Run the video game and select your GGUF model in the settings interface.

Almost all modules are compatible with Linux and Mac, the one module that is not is voice synthesis, in which the game uses Microsoft SAPI, I don't know if there is something similar in Linux. The only thing is that if there was a multiplatform voice synthesis option it would be straightforward.

Yes, internally the game already has the option because llama.cpp (the library I use currently) already supports it, however, I still want to experiment with its implications before enabling it.

Having a customizable option for the character would be great, however Character Creator does not allow it (the software I use to make the 3D model), I think I will have to switch to metahuman at some point. I would love to have the option to modify the android.

"if the Android trusts you it will change accordingly if asked?"

It's possible, it occurs to me

1. A first option is to have a list of requests and if one fits, do it (like the old chatbots worked), it's very fast and easy to implement, but it would often fail.

2. Add BERT (small and fast language model) in intent recognition mode, the implementation is not complex, it is moderately complex to do the fine tuning for the intentions, but it would work very well. In fact MTW already had something like that, but I removed it because it would be an extra cost to LLAMA and the CPU would still have more work, but it is possible.

3. The other would be for LLAMA itself to generate the intention after the text, although in instructor mode I'm not sure if it will let you, something like:

User: I want you to take off your clothes

Marian: Ok I'll take off my clothes [Intention: get naked]

Ahora por fin ya puede hablar en español.

The game now includes the power of LLAMA 3.1 for text generation. This change mainly involves the following:

1. Responses of much higher quality and length than previous versions (LLAMA 2 and GPT NEO).

2. Support for the languages: English, Spanish, German, French, Portuguese and Italian.

FREE GAME: MORE THAN WORDS

More Than Words  is a conversational video game, this free update includes:

• Text generation using Meta Lllama 2 AI.
• Speech recognition using OpenAI Whisper.
• A new 3D model of the character that is more realistic.
• New assets and new music.

Other game features:

• Speech synthesis using Microsoft SAPI.
• No internet connection is required.
• Conversations are anonymous and uncensored.

Hi, yes the video game takes the windows narrator for TTS, my decision was because it is more standard and the API windows is mature. For example, I can use the same code for another language: spanish, japanase, german, etc.

Hi, thanks for the report. Please, could you comment on the specifications of your equipment?

To be honest, I still have a lot to learn and try. I think that if I increase the context of the conversation it will be less likely to get repetitive conversations like the ones you mention, but I have to test the performance effect (another of my concerns). I certainly take into account what you say, I like Marian too ;), however, I get frustrated myself when she does that, I will do all in my hands! 

Thanks for your comment!

It is my first game and it measures more than 4GB, to be honest I didn't expect much, however, the number of downloads has exceeded my expectations. Thanks :)!

Please, the game has not yet been ranked, leave your rating when you can.

Thanks!

hahahaha OMG (https://youtu.be/VXz0KgNjK-0)

Excuse me! Hahahahahahahaha ;)

No. Maybe in the future I will do an erotic game... but not with this title.

Hi, today I haved published my first alpha version video game: More than words.

https://jorge-zapotecatl.itch.io/more-than-words

More than words is a conversational game where the chatbot answers are generated on demand. There are no predefined answers.  The chatbot uses GPT NEO natural language processing technology. The conversations are executed offline because GPT NEO is included in the game. Therefore, your conversations are completely anonymous.

If you are looking for a game where you can have a casual and relaxing conversation or you are curious to try the new advances in artificial intelligence, then More than words is for you!