Keep a history of received response hashes to detect late retransmissions