I've just tested it myself on the current dev build and it's working as intended in that it only skips messages you've seen, but skips everything regardless when 'All Messages' is chosen in the options. Is anybody else having this issue?
