Indie game storeFree gamesFun gamesHorror games
Game developmentAssetsComics
SalesBundles
Jobs
Tags
A jam submission

Investigating Neuron Behaviour via Dataset Example Pruning and Local SearchView project page

Submitted by alexfoote — 12 minutes, 51 seconds before the deadline
Add to collection

Play project

Investigating Neuron Behaviour via Dataset Example Pruning and Local Search's itch.io page

Results

CriteriaRankScore*Raw Score
Judge's choice#1n/an/a
Generality#13.4443.444
Interpretability#33.7783.778
ML Safety#43.1113.111
Novelty#93.2223.222
Reproducibility#173.2223.222

Ranked from 9 ratings. Score is adjusted from raw score by the median number of ratings per game in the jam.

Judge feedback

Judge feedback is anonymous.

  • This is a really awesome project! I hadn't thought of this idea, and it seems like an intuitive and valuable augmentation to max activating dataset examples. And I really love the use of BERT and the fact that it's automated. I'd love to chat about developing this into a more robust + usable tool, or eg integrating it into EasyTransformer. My main feedback is that this is an autoregressive, GPT-2 style model. This means that neuron activations on eg position 5 are ONLY a function of tokens 0 to 5, NOT of token 6. So pruning from the end of the word or augmenting by messing with words after the max act is totally meaningless. -Neel

Where are you participating from?
Online (UK)

What are the names of your team member?
Alex Foote

What are the email addresses of all your team members?
alexjfoote@icloud.com

Leave a comment

Log in with itch.io to leave a comment.

Comments

No one has posted a comment yet