Dear author:
The momentum update strategy ensures the consistency of query encoder at each step, but it leads to the difference between the query encoder and the key encoder. Why the consistence of encoder_q at each step is more important than the consistence between encoder_q and encoder_k?