Breaking down why update calls take > 2 seconds

Developers
2

Most application subnets have a block time of 0.9s or 900ms, which is the time taken to produce a block. So we don’t have to dive too deep into the circulation of consensus messages. With this in mind, let’s look at where time is spent:

  1. Assume the latency from a user’s computer to one of the boundary node is 200ms
  2. Assume the latency from a boundary node to one of the subnet node is 200ms
  3. Assume no mempool congestion, i.e. an ingress message will always be packed into the next block. This means on average a message will spend (1/2 * block time = 450ms) sitting in the mempool.
  4. A block that contains this message is produced & finalized, taking 900ms.
  5. IC uses a pipeline model for message execution, so it can overlap with consensus block making. But it is reasonable to assume the overall execution time is less than block time under normal conditions (otherwise consensus will actually slow down to accommodate execution). Suppose the block execution plus the certification time (which involves consensus) takes no more than 1 block time, and the average is 1/2 * block time = 450ms.
  6. The user’s computer actually polls the read_state endpoint to see the execution result of an ingress message. Assume there is no delay on the polling part (i.e., ignore the time where the polling message goes from user computer to boundary node and then to subnet node), we only count the time it takes for the certified result to go from subnet node to boundary node and then to user computer. This is another 200 + 200 = 400ms.

So average round trip latency for an update call is 400 + 450 + 900 + 450 + 400 = 2600 ms = 2.6s

If the user is physically close to the boundary node, we can perhaps shave off 300ms from the sum, which is perhaps not very significant.

Fine prints:

  • In reality, consensus needs not to spend the full 900ms to produce a finalized block. We settled on the 900ms block time to balance between block execution & consensus block making & network message latencies.
  • Execution will immediately start once we have a finalized block. So the actual time it takes between a message enters a block and its execution result is certified may be actually less than 900ms + 450ms.
  • Depending on the read_state polling strategy used by the client, the latency there should be accounted for.
22 Likes