Indie game storeFree gamesFun gamesHorror games
Game developmentAssetsComics
SalesBundles
Jobs
Tags
A jam submission

all-trees-are-fishView project page

Explorations on GPT-3’s handling of the Nonsense Syllogisms task
Submitted by satojk — 2 hours, 3 minutes before the deadline
Add to collection

Play project

all-trees-are-fish's itch.io page

Leave a comment

Log in with itch.io to leave a comment.

Comments

HostSubmitted

Winner of the third prize! Congratulations!!

General: Really nice experiment that represents and experiments the concept well. Missing some sort of graph, though the results were there as a table (sort of a graph). The data goes deep as well and invites a lot of further investigation!

Alignment: Represents a basic language model error very in-depth.

AI Psychology: Replicates an interesting symbolic re-definition principle. Has an interesting method for evaluating 

Novelty: Not seen before in this format. Syllogisms have been seen before and the symbolic redefinition problem has been seen before. But describing these in a new combination, i.e. with nonsense vs. original syllogisms.

Generality: Many datasets tested with different question formats and prompts. Very nice. Can imagine the further generality from the results. The syllogisms were mostly in one form, though. Replicability: Code, data, and results laid out in very neat form.

Developer(+1)

Disclaimer: image not mine.

Here's the source.

HostSubmitted

Haha, I bet that's alright! Here's some I generated with MidJourney for your project.