As of my understanding from here How would Internet Identity handle a denial of service attack? - #7 by faraz.shaikh I cannot have more than 500 queries / second and 50 updates / second subnet/boundary node and here I have 2 questions: 1)Are boundary nodes 1 per subnet? If not, how do they scale? …

[image] icme: I thought that each canister was spread across a single subnet? I’m not sure I’m following. Yes, each canister runs on a specific subnet and in order to shard across subnets your application needs a multi-canister architecture.

Hey @0xlup3x , [image] 0xlup3x: 1)Are boundary nodes 1 per subnet? If not, how do they scale? Boundary nodes serve the entire Internet Computer. According to https://dashboard.internetcomputer.org/ , there are currently 12, but there is ongoing work on decentralizing boundary nodes . [imag…

Another approach would be to split your application into multiple canisters. This ha the added benefit of splitting up the concerns of you application, while effectively doubling the throughput and data storage. [image] domwoe: Inter-canister calls aren’t limited by any boundary node limits obv…

@domwoe Got it, but don’t application developers currently have no control over which subnet their application gets deployed to? Also, there a certain benefits to deploying one’s multi-canister application to the same subnet? Why does it matter if the canister is shared across the same subnet vs.…

Thank you @domwoe , deploying on different subnets is actually a wonderful idea. @icme Tips for deploying to a specific subnet you can basically do a trial and error for deploying on different subnets.

[image] Can I run multiple inter-canister update calls in parallel? Developers Depends on your requirements. Splitting a dapp (whose canisters communicate with one another) across multiple subnets means additional latency for cross-subnet (XNet) calls. On the order of 2x …

To add to the above, inter-canister calls are only limited by execution throughput when both canisters are on the same subnet. So e.g. given very little computation per message (and very little subnet load), you could conceivably execute thousands of them per second per canister. Actual XNet (cross…

Very insightful information!! In a scenario where my app architecture is sharded over multiple subnets I suppose I would have to make my own load balancer deployed off chain so a client is redirected to an appropiate subnet as canisters calls are limited to their own subnet. Correct me if I am wron…

Not sure what you mean by “canisters calls are limited to their own subnet”. There are two kinds of messages: ingress (user to canister) and canister-to-canister. But in both cases you are calling a specific canister, so the message will be routed to the subnet hosting that canister, yes. As for lo…

Was indeed referring to canister-canister calls. I would have to shard data on user demand on different subnets but I need to have an external orchestrator that constantly pings subnet canisters for load checking so I can shard it on free nets. Doing a round robin or random sharding won’t work. ma…

You shouldn’t have to host anything off-chain. Your “worker” canisters can send usage stats to an “index” canister and your client code can constantly check the index and decide where to take a new user based on that.

How to workaround network throughput limits for high traffic canisters?

Developers

Zane May 30, 2022, 4:23pm 7

Topic		Replies	Views
Query call performance and boundary nodes Developers	6	434	March 6, 2024
How would Internet Identity handle a denial of service attack? Developers Discussing	17	3249	July 4, 2023
High User Traffic Incident Retrospective - Thursday September 2, 2021 Developers	50	8995	October 30, 2021
Path forward for subnet splitting and protocol scaling Developers	19	406	October 17, 2024
Consensus and inter-canister calls Developers	12	3210	October 29, 2020

How to workaround network throughput limits for high traffic canisters?

Related topics