Figured out, need to defeat slime firs
Yes, some girls will be more interested in Jack after he accomplished something meaningful in the main quests.