Play project
Investigating Neuron Behaviour via Dataset Example Pruning and Local Search's itch.io pageResults
Criteria | Rank | Score* | Raw Score |
Judge's choice | #1 | n/a | n/a |
Generality | #1 | 3.444 | 3.444 |
Interpretability | #3 | 3.778 | 3.778 |
ML Safety | #4 | 3.111 | 3.111 |
Novelty | #9 | 3.222 | 3.222 |
Reproducibility | #17 | 3.222 | 3.222 |
Ranked from 9 ratings. Score is adjusted from raw score by the median number of ratings per game in the jam.
Judge feedback
Judge feedback is anonymous.
- This is a really awesome project! I hadn't thought of this idea, and it seems like an intuitive and valuable augmentation to max activating dataset examples. And I really love the use of BERT and the fact that it's automated. I'd love to chat about developing this into a more robust + usable tool, or eg integrating it into EasyTransformer. My main feedback is that this is an autoregressive, GPT-2 style model. This means that neuron activations on eg position 5 are ONLY a function of tokens 0 to 5, NOT of token 6. So pruning from the end of the word or augmenting by messing with words after the max act is totally meaningless. -Neel
Where are you participating from?
Online (UK)
What are the names of your team member?
Alex Foote
What are the email addresses of all your team members?
alexjfoote@icloud.com
Leave a comment
Log in with itch.io to leave a comment.
Comments
No one has posted a comment yet