joker in the deck

(slang) a hidden cost, qualification, defeat, nasty result, etc. A joker is a playing card, usually imprinted with the figure of a jester. In some card games the joker is used as a wild card, which could create an unsuspected defeat if it were drawn and used by one's opponent.