Always watch where you place your punctuation when using quotes. According to the Australian Style Manual for Authors, Editors and Printers:
"…when two different punctuation marks appear together, one applying to the quotation and the other to the sentence, both should be printed."
Here is an example:
Did he hear the Speaker call ‘Order!’?
He said, ‘Do you think I am mad?’.