How critical is replica system time and timeserver dependance for consensus?

While indulging in all things IC, I keep asking myself this question. What happens if the timeservers are corrupted and stop syncing with the replica’s? Do P2P and consensus layer suffer criticaly if this happens?

My love to all, you world class nerds!