A fly in the ointment.

My history teacher never understood that.

I thought it was because flies are dirty and they taint the ointment, possibly making it ineffective