Then, go listen to a podcast or watch cat videos on your phone while you wait. The Blue Prince Time Lock Safe should open right in front of you eventually.