Please ignore, I found mbox_reset_atime() in the source code and disabled it, now mutt seems to work again in the way I'm used to.