As I understand it, the idiom is used to describe someone who is (or at least believes themselves to be) clever, to the point of annoying others, usually due to outspokenness or arrogance.
I don’t have access to OED right now, so can’t look it up, but some googling suggests that the idiom “too [adjective] by half” has been in use for a good few centuries.