Judge feedback

Judge feedback is anonymous and shown in a random order.

• Interesting project! Sadly I looked at this after the tool timed out. This would have been significantly improved by including the Colab! I'd encourage you to make a public version of it I broadly buy that this tool is a cool thing to exist, and that looking at all neurons in a layer is a useful view, though obviously this would be a cooler tool with clear and compelling use cases! One question I have is about the speed and usability of the tool - my experience is that Plotly is pretty slow with massive plots? On the other hand, being able to hover and see the top neuron indices is pretty useful. I agree with the take that neurons that strongly activate sparsely are more interesting than neurons that activate everywhere. Another thing worth tracking is that some neurons activate much more than others in general, and maybe this would be improved by normalising by that? My main suggestions for improvement would be a public version, and just exploring a bunch more and seeing if you find anything interesting! One idea would be to pick some phenomena that you want to investigate and staring at neurons for that. -Neel
• This is a great example of creating a live application that can be utilized for mechanistic interpretability work and it's nice to see its use case in the report as well.