Subnet Management - ejbmu (Application)

This topic is intended to capture Subnet Management activities over time for the ejbmu subnet, providing a place to ask questions and make observations about the management of this subnet.

At the time of creating this topic the current subnet configuration is as follows:

Expand
{
  "version": 44951,
  "records": [
    {
      "key": "subnet_record_ejbmu-grnam-gk6ol-6irwa-htwoj-7ihfl-goimw-hlnvh-abms4-47v2e-zqe",
      "version": 44951,
      "value": {
        "membership": [
          "cekdc-hmzri-3u3or-ei7ip-su7ck-3xt6e-zsse2-tgakq-rolmv-6crkh-hqe",
          "bhrbv-chf2l-tjjcj-mqryf-7z7ww-z6xi3-su7hl-idbfo-nnfpu-u6aju-nae",
          "xhha5-oe4lp-ij2xv-gqhfe-pjavc-lwazu-y2wcm-rsvqw-hpvso-ksn7c-fqe",
          "llwjk-sgobf-vxycz-muu34-oyozz-lkxak-pzc67-ek4pt-kqmfh-b2b6k-3qe",
          "7ucvx-t6mxf-viej7-ils7i-k3aco-tqzsg-6cy3o-cakgs-zifaj-kiduk-cae",
          "b3ml3-v62hu-gdyb5-2raax-b33g2-nav6y-i5d3n-carmz-tosee-rbhk3-lqe",
          "5w4eg-mb4ih-bwfmd-332ta-krtlf-y5igk-r3lzd-l3bze-34553-3opqh-mae",
          "aae7j-zvepi-ypdnp-4a6fg-durhx-37r2u-d4e5u-z67va-dsen2-rnusw-pqe",
          "oxa4d-pajkk-n7fto-dyfxr-z34x3-7zebw-zdqbq-qxzxp-qg7vk-nhcnx-fae",
          "in4qi-poj7g-j5gvw-34xys-4cf6k-uki3d-exjzf-th4cu-c5my6-sdht2-cae",
          "kmez2-lipof-3kjdn-nt35r-ai7oy-gvxxb-5hkv4-lk5ci-vtjya-hpd6w-wqe",
          "t3d5h-mcdqm-lt7jk-b7nk2-nkxfi-dl4ew-pn776-olxjd-eyott-3hpjb-iae",
          "bayvy-p36kq-krz3d-o5lay-rxx3w-h35pc-235tv-mmhfe-b674r-xwfnq-mae"
        ],
        "nodes": {},
        "max_ingress_bytes_per_message": 2097152,
        "max_ingress_messages_per_block": 1000,
        "max_block_payload_size": 4194304,
        "unit_delay_millis": 1000,
        "initial_notary_delay_millis": 600,
        "replica_version_id": "b0ade55f7e8999e2842fe3f49df163ba224b71a2",
        "dkg_interval_length": 499,
        "start_as_nns": false,
        "subnet_type": "verified_application",
        "features": {
          "canister_sandboxing": false,
          "http_requests": true,
          "sev_enabled": false
        },
        "max_number_of_canisters": 120000,
        "ssh_readonly_access": [],
        "ssh_backup_access": [],
        "ecdsa_config": null,
        "chain_key_config": null
      }
    }
  ]
}

Proposal 132217

This proposal sets the notarisation delay of the subnet to 300ms, down from 600ms. The change will increase the block rate of the subnet, aimed to reduce latency of update calls.

This is the same subnet config update that was applied to the canary subnet last week, which has held a steady and impressive block rate since. More context is available here → Reducing End to End latencies on the Internet Computer

Here are the current metrics for this subnet. A question I’ll be asking on the Subnet Management General thread (see reference below this post) is why this update is being rolled out to so many subnets at once, each with different finalisation rate and transaction profiles (e.g. peaks and troughs, whereas the canary subnet was always steady, even prior to the update). I’m wondering if this limits the representativeness of the results on that canary subnet.

DFINITY will submit a proposal today to reduce the notarization delay on the subnet, ejbmu , similar to what has happened on other subnets in recent weeks (you can find all details in this forum thread ).

Thanks @dsharifi. Was this post intended for another subnet? (the notarisation delay has already been recently updated on ejbmu)


Update: I’ve reviewed the subnet metrics, re-reviewed the prior proposal, and also confirmed the current config of the subnet using IC-Admin. Having confirmed that this subnet already has a notarization delay of 300ms I’ve rejected the proposal (not that it would matter if this executed). As you would expect, and as pointed out by @Sat in the WaterNeuron DAO, these operations are idempotent :slight_smile:

Thanks for spotting this @Lorimer. As you point out, this proposal is an error as it already has a 300ms notarisation deal. You can vote to reject it.

1 Like

A new proposal with id 134545 has been submitted, please take a look.

Click here to open proposal details

Replace nodes in subnet ejbmu

Motivation:
The following nodes in subnet ejbmu have been cordoned and need to be removed from the subnet:

Decentralization Nakamoto coefficient changes for subnet ejbmu-grnam-gk6ol-6irwa-htwoj-7ihfl-goimw-hlnvh-abms4-47v2e-zqe:

    node_provider: 5.00 -> 5.00    (+0%)
      data_center: 5.00 -> 5.00    (+0%)
data_center_owner: 5.00 -> 5.00    (+0%)
             area: 5.00 -> 5.00    (+0%)
          country: 5.00 -> 5.00    (+0%)

Mean Nakamoto comparison: 5.00 → 5.00 (+0%)

Overall replacement impact: equal decentralization across all features

Details

Nodes removed:

  • 5w4eg-mb4ih-bwfmd-332ta-krtlf-y5igk-r3lzd-l3bze-34553-3opqh-mae [health: healthy]
  • aae7j-zvepi-ypdnp-4a6fg-durhx-37r2u-d4e5u-z67va-dsen2-rnusw-pqe [health: healthy]

Nodes added:

  • kv4yb-otkiz-ilqle-wk3b3-upqjh-hvkhv-wmbqq-ca4qq-5va4r-matmt-oqe [health: healthy]
  • 6zj3x-tsbc3-jfzjr-lrnay-maejy-wwrrr-byxwk-kdzqu-nrkmz-mdcrx-aae [health: healthy]
    node_provider                                                              data_center            data_center_owner            area                        country        
    -------------                                                              -----------            -----------------            ----                        -------        
    3oqw6-vmpk2-mlwlx-52z5x-e3p7u-fjlcw-yxc34-lf2zq-6ub2f-v63hk-lae       1    an1          1 -> 0    Cyxtera                 1    British Columbia       1    AU            1
    4dibr-2alzr-h6kva-bvwn2-yqgsl-o577t-od46o-v275p-a2zov-tcw4f-eae       1    bc1               1    Datacenter United  1 -> 0    Bucuresti              1    BE       1 -> 0
    6nbcy-kprg6-ax3db-kh3cz-7jllk-oceyh-jznhs-riguq-fvk6z-6tsds-rqe       1    bu1               1    Digital Realty          1    Flanders          1 -> 0    CA            1
    7at4h-nhtvt-a4s55-jigss-wr2ha-ysxkn-e6w7x-7ggnm-qd3d5-ry66r-cae       1    ch2          1 -> 0    Dotsi                   1    Florida           0 -> 1    CH            1
    7ryes-jnj73-bsyu4-lo6h7-lbxk5-x4ien-lylws-5qwzl-hxd5f-xjh3w-mqe       1    fr2               1    Equinix                 1    Geneva                 1    DE            1
    7uioy-xitfw-yqcko-5gpya-3lpsw-dw7zt-dyyyf-wfqif-jvi76-fdbkg-cqe       1    ge1               1    HighDC                  1    Hesse                  1    HK       0 -> 1
    bvcsg-3od6r-jnydw-eysln-aql7w-td5zn-ay5m6-sibd2-jzojt-anwag-mqe       1    hk1          0 -> 1    M247                    1    HongKong          0 -> 1    IN            1
    i7dto-bgkj2-xo5dx-cyrb7-zkk5y-q46eh-gz6iq-qkgyc-w4qte-scgtb-6ae       1    jv1          0 -> 1    Marvelous Web3 DC       1    Illinois          1 -> 0    KR            1
    ihbuj-erwnc-tkjux-tqtnv-zkoar-uniy2-sk2go-xfpkc-znbb4-seukm-wqe       1    li1               1    Megazone Cloud          1    Lisbon                 1    PT            1
    r3yjn-kthmg-pfgmb-2fngg-5c7d7-t6kqg-wi37r-j7gy6-iee64-kjdja-jae  0 -> 1    mb1               1    NEXTDC                  1    Maribor                1    RO            1
    rbn2y-6vfsb-gv35j-4cyvy-pzbdu-e5aum-jzjg6-5b4n5-vuguf-ycubq-zae  1 -> 0    mn2               1    Posita.si               1    Melbourne              1    SE            1
    spp3m-vawt7-3gyh6-pjz5d-6zidf-up3qb-yte62-otexv-vfpqg-n6awf-lqe       1    nd1               1    Telin                   1    New Delhi              1    SG            1
    wdjjk-blh44-lxm74-ojj43-rvgf4-j5rie-nm6xs-xvnuv-j3ptn-25t4v-6ae       1    sg1               1    Tierpoint               1    Seoul                  1    SI            1
    wdnqm-clqti-im5yf-iapio-avjom-kyppl-xuiza-oaz6z-smmts-52wyg-5ae       1    sh1               1    Unicom             0 -> 1    Singapore              1    US            1
                                                                               sl1               1                                 Stockholm              1                   
1 Like

Proposal 134545

TLDR: I’ll adopt. The proposal links directly to what appears to be discussion with the NP about the proposal. Decentralisation stats look good.

Decentralisation Stats

Subnet node distance stats (distance between any 2 nodes in the subnet) →

Smallest Distance Average Distance Largest Distance
EXISTING 321.16 km 7320.824 km 18192.393 km
PROPOSED 321.16 km 7824 km (+6.9%) 18192.393 km

This proposal slightly increases decentralisation, considered purely in terms of geographic distance (and therefore there’s a slight theoretical increase in localised disaster resilience). :+1:

Subnet characteristic counts →

Continents Countries Data Centers Owners Node Providers Node Operator
EXISTING 4 13 13 13 13 13
PROPOSED 4 13 13 13 13 13

Largest number of nodes with the same characteristic (e.g. continent, country, data center, etc.) →

Continent Country Data Center Owner Node Provider Node Operator
EXISTING 7 1 1 1 1 1
PROPOSED 6 (-14.285714285714285%) 1 1 1 1 1

See here for acceptable limits → Motion 132136

The above subnet information is illustrated below, followed by a node reference table:

Map Description
  • Red marker represents a removed node (transparent center for overlap visibility)
  • Green marker represents an added node
  • Blue marker represents an unchanged node
  • Highlighted patches represent the country the above nodes sit within (red if the country is removed, green if added, otherwise grey)
  • Light grey markers with yellow borders are examples of unassigned nodes that would be viable candidates for joining the subnet according to formal decentralisation coefficients (so this proposal can be viewed in the context of alternative solutions that are not being used)

Node Changes
Action Node Status Continent Country Data Center Owner Node Provider Node Operator
Remove 5w4eg UP :bar_chart: Europe Belgium Antwerp (an1) Datacenter United Allusion pgunx
Remove aae7j UP :bar_chart: Americas United States of America (the) Chicago 2 (ch2) Tierpoint Rivonia Holdings LLC vkwql
Add 6zj3x UNASSIGNED :bar_chart: Asia China HongKong 1 (hk1) Unicom Pindar Technology Limited vzsx4
Add kv4yb UNASSIGNED :bar_chart: Americas United States of America (the) Jacksonville (jv1) Tierpoint Rivonia Holdings LLC wmrev
Other Nodes
Node Status Continent Country Data Center Owner Node Provider Node Operator
xhha5 UP :bar_chart: Oceania Australia Melbourne 2 (mn2) NEXTDC Icaria Systems Pty Ltd l5lhp
7ucvx UP :bar_chart: Americas Canada Vancouver (bc1) Cyxtera Blockchain Development Labs feb2q
bayvy UP :bar_chart: Europe Switzerland Geneva (ge1) HighDC Archery Blockchain SCSp yngfj
bhrbv UP :bar_chart: Europe Germany Frankfurt 2 (fr2) Equinix Virtual Hive Ltd 3nu7r
cekdc UP :bar_chart: Asia India New Delhi 1 (nd1) Marvelous Web3 DC Marvelous Web3 ri4lg
llwjk UP :bar_chart: Asia Korea (the Republic of) Seoul 1 (sl1) Megazone Cloud Neptune Partners ukji3
b3ml3 UP :bar_chart: Europe Portugal Lisbon 1 (li1) Dotsi Vladyslav Popov xbvdm
kmez2 UP :bar_chart: Europe Romania Bucharest (bu1) M247 Iancu Aurel c5ssg
t3d5h UP :bar_chart: Asia Singapore Singapore (sg1) Telin OneSixtyTwo Digital Capital d4bin
oxa4d UP :bar_chart: Europe Slovenia Maribor (mb1) Posita.si Fractal Labs AG 3xiew
in4qi UP :bar_chart: Europe Sweden Stockholm 1 (sh1) Digital Realty DFINITY Stiftung lgp6d

*This comment references the latest comment in the Subnet Management - General Discussion thread only to generate an automated cross-link from the general thread (to improve topic navigation).


You may wish to follow D-QUORUM if you found this analysis helpful.

Known Neurons to follow if you're too busy to keep on top of things like this

If you found this analysis helpful and would like to follow the vote of the LORIMER known neuron in the future, consider configuring LORIMER as a followee for the Subnet Management topic.

Additional good neurons to follow:

  • D-QUORUM (a highly decentralized neuron that follows neurons that have been elected by the NNS)
  • Synapse (currently follows the LORIMER and CodeGov known neurons for Subnet Management, and is a generally well informed known neuron to follow on numerous other topics)
  • CodeGov (actively reviews and votes on Subnet Management proposals, and is well informed on numerous other technical topics)
  • WaterNeuron (the WaterNeuron DAO frequently discuss proposals like this in order to vote responsibly based on DAO consensus)

Note that this analysis involved data provided by the IC-API, which is not open source. I’m in the process of switching over to more verifiable sources of this sort of information for future proposal reviews. See here for related discussion.

Voted to adopt proposal #134545.

The proposal replaces two cordoned healthy Active status node 5w4eg from the AN1 Data Center in Belgium, and cordoned healthy Active status node aae7j from the CH2 Data Center in Illinois, with unassigned healthy Awaiting status node kv4yb from Florida and with unassigned healthy Awaiting status node 6zj3x from Hong Kong, without any change to the decentralization of the subnet.
The motivation makes sense and the provided Forum link included in the summary provides further info, also it can be checked here.

Voted to adopt proposal 134545.

This proposal replaces 2 nodes, due to offboarding AN1 and CH2 data centres. Decentralisation parameters are unchanged and remain within the requirements of the target topology. Data centre details are consistent with the links provided in the proposal.

Proposal 134545

Vote: ADOPT

Replaces cordoned nodes 5w4eg and aae7j with nodes kv4yb and 6zj3x on subnet ejbmu.
The reason for this proposal is to offboard CH2 and AN1 DCs consistent with forum posts made on the forum thread used for posts regarding the renovation/sell of Gen-1 node machines by NPs.
Both the NP and DC stated in the forum post match the ones from the node being removed in the proposal.

:point_up: There’s an open proposal to make ejbmu a public subnet.