I've always been in the same way as you with quotations. There is something that just screams speech with "" and other with ''. However, I never actually notice in fiction, and didn't even know that was how quotes were done.

Because I am slow.