Subnet Management - uzr34 (II)

We have just added NNS root as controller of the two canisters and removed the BN principal as controller. Now, the two empty canisters are fully NNS controlled.

$ dfx canister info uz2z3-qyaaa-aaaaq-qaacq-cai --ic
Controllers: r7inp-6aaaa-aaaaa-aaabq-cai
Module hash: None

$ dfx canister info u637p-5aaaa-aaaaq-qaaca-cai --ic
Controllers: r7inp-6aaaa-aaaaa-aaabq-cai
Module hash: None

@Lorimer Thanks a lot for your thorough work and pointing out this oversight. I also learned something new :slight_smile:
I disagree with the statement that the proposal summary was incorrect: a principal can be authorized for a subnet. The proposal removed that authorization.
I agree that the principal still had possibilities to setup canisters through the other canisters. That was an oversight on my part and is a “feature” of controlling the canister instead of being authorized on a specific subnet.

4 Likes

Thanks @rbirkner, no problem. This is information that I gleaned from reviewing a prior proposal, where it was highlighted by @Severin.

I’ve only said that the proposal summary should not be taken literally :slightly_smiling_face: Taking it literally would mean that deploying new canisters to the subnet would be unauthorized, which would be a misleading / unhelpful classification (some system subnets depend on this feature).

1 Like

Voted to adopt proposal 134400.

This proposal replaces node z5a4h which appears in the dashboard as “Status: Active”, for the purpose of examining the stability of another node operator’s nodes. As shown in the proposal, decentralisation parameters are unchanged and remain within the requirements of the target topology.

1 Like

Rejected the proposal, explained here.

1 Like

Thanks @ZackDS for pointing out this distinction, which I had in fact missed. The two nodes are in different data centres, hence having different node operator IDs even though they are owned by the same node provider. Does this help to clear it up or was your point more that the proposal should have explained this detail for the benefit of newcomers?

1 Like

Well it’s clear for me/us, I meant it could be confusing to new users who look at the dashboard only. I doubt anyone new will search for operator id’s (specially as they are not an active link) and seeing the same NP (in case they go as far as at least opening the node on the dashboard, can get confusing). Just a thought that crossed my mind, if it’s not worth addressing will ask @LaCosta to vote yes and we will have majority consensus.

While on this Rabbit whole, ofc one NP can have nodes in different Data Centers that obv can behave very differently the “insights into the stability of the nodes of this node operator” seems a bit confusing.

4 Likes

That’s a fair point and I see what you mean now. I think there’s a fair argument either way in this case, so I’d just wait and see what he decides.

4 Likes

Proposal 134400

Vote: ADOPT

The proposal replaces one node from subnet uzr34:
Removed Node: z5a4h: Dashboard Status Active
Added Node: vqucp: Dashboard Status Awaiting
The proposal was verified using the DRE tool to verify the metrics stated which are not affected by this replacement.

Both nodes are from the same NP and the replacement was done to gain insights into the the added node which is operated by a different Node Operator which means it’s in a different DC and currently no nodes from this Node Operator are active as can be seen here.
I my opinion proposals should be easy to understand as in providing all the information necessary for reviewing the proposals but still requiring some kind of knowledge. I don’t want to see people not aware of what the IC is voting for the sake of it. I would like this to come with some degree of curisosity from the users who want to participate, which requires gaining basic insights on what the proposal is doing so they can vote consciously. We can measure this by the difficulty in which users can gain this basic knowledge, and making a 5 second search on google on what is a Node Operator, I found this, which very clearly states the differences. This makes the difficulty of obtaining the necessary knowledge to vote consciously very easy. I also don’t want to see proposals with large summarys with 50 lines of references on what every keyword means

3 Likes

I’ve vote to adopt proposal 134400. The decentralisation coefficients were unchanged by the proposal. As can be observed using the IC-API, the bmlhw node operator has 14 nodes (as stated in the proposal summary). Now that this proposal has executed, one of those nodes is assigned (vqucp).

Note that the IC-API is not open source, since learning this, I’m in the process of switching over verifiable sources of this sort of information (rejecting because I’ve not had time to do this yet would be too harsh - even for me :wink:).

1 Like

Yes, this is a fair point. One could consider making the extrapolation more granular by applying it at the level of (node provider, data center). However, this approach will lead to further fragmentation of the nodes of the node provider, increasing the volatility of the extrapolation, as some node providers have very few, or even a single, node in a data center.

2 Likes

The mapping between the NP, operator, DC, node is the following:

In result,

  • A NP can have [0
many] node operators
  • A node operator can have [0
1] DCs
  • A DC can have [0
many] node operators
  • A node operator can have [0
many] nodes

So yes, the node operator gives us appropriate granularity because the same NP would often (albeit not necessarily always) buy a set of machines with the same specs and from the same supplier, and put these machines into the same rack, in a DC. These machines would also share the power supply and the ISP, so they would be in the same failure domain.
In another DC, we could expect that the NP would use another supplier and another ISP, so it would be a different failure domain.

What is likely wrong in the whole thing is the terminology we use. But someone thought the above naming is “good enough” and now it’s pretty hard to change. Naming is hard.

That said, we can surely start with the NP-based extrapolation (rather than node operator based), and check if that NP-based extrapolation approach would catch the current performance offenders. And if that (NP-based) doesn’t work - switch over to the node operator based extrapolation.

4 Likes

Thank you @bjoernek and @sat for the valuable feedback and in detail breakdown. It all makes sense and confirms what we already know and think so far as in it is not intentionally over complicated but rather logical that follows sets of rules put together in order to simplify the understanding of how the IC works. My point wasn’t about good enough which everything so far falls under, but rather a sort of “making all of this understandable for regular folks, specially new users” coming from other ecosystems. The whole IC is lightyears away from other chains right now, and this was just a thought regarding only one proposal from many, where the same existing Node Provider with different node operator ID’s was put in a sort of let’s test it situation, without a bit of more info. Again and I can’t stress this enough that IMHO not many users would go and check in detail but at a first glance checking Node Providers on the dashboard that is the main source of info for regular users doesn’t have any info on Node Operator. Hope this makes sense ?

5 Likes

A new proposal with id 134491 has been submitted for this subnet.

Click here to open proposal details

Replace a node in subnet uzr34

Motivation:
The following nodes in subnet uzr34 have been cordoned and need to be removed from the subnet:

Decentralization Nakamoto coefficient changes for subnet uzr34-akd3s-xrdag-3ql62-ocgoh-ld2ao-tamcv-54e7j-krwgb-2gm4z-oqe:

  node_provider: 11.00 -> 11.00    (+0%)
    data_center: 11.00 -> 11.00    (+0%)
data_center_owner: 11.00 -> 11.00    (+0%)
           area: 11.00 -> 11.00    (+0%)
          country: 7.00 -> 8.00   (+14%)

Mean Nakamoto comparison: 10.20 → 10.40 (+2%)

Overall replacement impact: (gets better) the average log2 of Nakamoto Coefficients across all features increases from 3.3290 to 3.3675

Details

Nodes removed:

  • gtfa3-saq3t-ymlel-lsf6d-ans7b-cr45x-xg5np-xbxyt-nxfrt-iynyy-5qe [health: healthy]

Nodes added:

  • 6hqi5-ctyoo-qijwz-dtvwo-g5puo-yaftz-dmaid-rambc-li5dx-q46y2-sae [health: healthy]
    node_provider                                                              data_center            data_center_owner                                    area                             country        
    -------------                                                              -----------            -----------------                                    ----                             -------        
    4jjya-hlyyc-s766p-fd6gr-d6tvv-vo3ah-j5ptx-i73gw-mwgyd-rw6w2-rae       1    an1               1    Anonstake                                       1    Bogota                      1    AR            1
    4r6qy-tljxg-slziw-zoteo-pboxh-vlctz-hkv2d-7zior-u3pxm-mmuxb-cae       1    ar1               1    Celeste                                         1    Bucuresti                   1    AU            1
    64xe5-tx2s3-4gjmj-pnozr-fejw2-77y5y-rhcjk-glnmx-62brf-qin5q-pqe       1    at2               1    Cloud9                                          1    CABA                        1    BE            1
    6nbcy-kprg6-ax3db-kh3cz-7jllk-oceyh-jznhs-riguq-fvk6z-6tsds-rqe       1    bg1               1    CyrusOne                                   1 -> 0    Cape Town                   1    CA            1
    6sq7t-knkul-fko6h-xzvnf-ktbvr-jhx7r-hapzr-kjlek-whugy-zt6ip-xqe       1    bn1               1    Cyxtera                                         1    Colombo                     1    CH            1
    7at4h-nhtvt-a4s55-jigss-wr2ha-ysxkn-e6w7x-7ggnm-qd3d5-ry66r-cae       1    bu1               1    DEAC                                            1    Flanders                    1    CO            1
    7uioy-xitfw-yqcko-5gpya-3lpsw-dw7zt-dyyyf-wfqif-jvi76-fdbkg-cqe       1    ch3          1 -> 0    Datacenter United                               1    Gauteng                     1    CZ            1
    bvcsg-3od6r-jnydw-eysln-aql7w-td5zn-ay5m6-sibd2-jzojt-anwag-mqe       1    cm1               1    Datasite                                        1    Georgia                     1    EE            1
    diyay-s4rfq-xnx23-zczwi-nptra-5254n-e4zn6-p7tqe-vqhzr-sd4gd-bqe       1    ct2               1    Digital Realty                                  1    HongKong                    1    ES            1
    eatbv-nlydd-n655c-g7j7p-gnmpz-pszdg-6e6et-veobv-ftz2y-4m752-vqe       1    hk1               1    EdgeUno                                         1    Illinois               1 -> 0    FR            1
    eybf4-6t6bb-unfb2-h2hhn-rrfi2-cd2vs-phksn-jdmbn-i463m-4lzds-vqe       1    jb3               1    Edgoo Networks                             0 -> 1    Lisbon                 0 -> 1    GE            1
    fwnmn-zn7yt-5jaia-fkxlr-dzwyu-keguq-npfxq-mc72w-exeae-n5thj-oae       1    kr2               1    Equinix                                         1    Ljubljana                   1    HK            1
    i3cfo-s2tgu-qe5ym-wk7e6-y7ura-pptgu-kevuf-2feh7-z4enq-5hz4s-mqe       1    ld1               1    Gasan                                           1    London                      1    HR            1
    i7dto-bgkj2-xo5dx-cyrb7-zkk5y-q46eh-gz6iq-qkgyc-w4qte-scgtb-6ae       1    li2          0 -> 1    Ginernet                                        1    Madrid                      1    IL            1
    ivf2y-crxj4-y6ewo-un35q-a7pum-wqmbw-pkepy-d6uew-bfmff-g5yxe-eae       1    lj1               1    Interhost                                       1    Navi Mumbai                 1    IN            3
    izmhk-lpjum-uo4oy-lviba-yctpc-arg4b-2ywim-vgoiu-gqaj2-gskmw-2qe  1 -> 0    ma1               1    Latitude.sh                                     1    New Delhi                   1    JP            1
    kos24-5xact-6aror-uofg2-tnvt6-dq3bk-c2c5z-jtptt-jbqvc-lmegy-qae       1    nd1               1    M247                                            1    Ontario                     1    KR            1
    mjnyf-lzqq6-s7fzb-62rqm-xzvge-5oa26-humwp-dvwxp-jxxkf-hoel7-fqe  0 -> 1    nm1               1    Marvelous Web3 DC                               1    Panama City                 1    LK            1
    mme7u-zxs3z-jq3un-fbaly-nllcz-toct2-l2kp3-larrb-gti4r-u2bmo-dae       1    pc1               1    Master Internet                                 1    Panvel                      1    LV            1
    otzuu-dldzs-avvu2-qwowd-hdj73-aocy7-lacgi-carzj-m6f2r-ffluy-fae       1    pl2               1    NEXTDC                                          1    Paris                       1    PA            1
    py2kr-ipr2p-ryh66-x3a3v-5ts6u-7rfhf-alkna-ueffh-hz5ox-lt6du-qqe       1    pr1               1    Navegalo                                        1    Queensland                  1    PT       0 -> 1
    qsdw4-ao5ye-6rtq4-y3zhm-icjbj-lutd2-sbejz-4ajqz-pcflr-xrhsg-jae       1    rg1               1    Nine.Ch                                         1    Riga                        1    RO            1
    r3yjn-kthmg-pfgmb-2fngg-5c7d7-t6kqg-wi37r-j7gy6-iee64-kjdja-jae       1    sc1               1    OrionStellar                                    1    Seoul                       1    SE            1
    rbn2y-6vfsb-gv35j-4cyvy-pzbdu-e5aum-jzjg6-5b4n5-vuguf-ycubq-zae       1    sg2               1    Posita.si                                       1    Singapore                   1    SG            1
    s5nvr-ipdxf-xg6wd-ofacm-7tl4i-nwjzx-uulum-cugwb-kbpsa-wrsgs-cae       1    sh1               1    Rivram                                          1    South Moravian Region       1    SI            1
    sixix-2nyqd-t2k2v-vlsyz-dssko-ls4hl-hyij4-y7mdp-ja6cj-nsmpf-yae       1    ta2               1    SyT - Servicios y Telecomunicaciones S.A.       1    Stockholm                   1    UK            1
    ucjqj-jmbj3-rs4aq-ekzpw-ltjs3-zrcma-t6r3t-m5wxc-j5yrj-unwoj-mae       1    tb1               1    Telia DC                                        1    Tallinn                     1    US       2 -> 1
    ulyfm-vkxtj-o42dg-e4nam-l4tzf-37wci-ggntw-4ma7y-d267g-ywxi6-iae       1    to1               1    Telin                                           1    Tbilisi                     1    ZA            2
    vegae-c4chr-aetfj-7gzuh-c23sx-u2paz-vmvbn-bcage-pu7lu-mptnn-eqe       1    tv1               1    Teraco                                          1    Tel Aviv                    1                   
    wdjjk-blh44-lxm74-ojj43-rvgf4-j5rie-nm6xs-xvnuv-j3ptn-25t4v-6ae       1    ty1               1    Unicom                                          1    Tokyo                       1                   
    wwdbq-xuqhf-eydzu-oyl7p-ga565-zm7s7-yrive-ozgsy-zzgh3-qwb3j-cae       1    zg1               1    Xneelo                                          1    Zagreb                      1                   
    zy4m7-z5mhs-zfkpl-zlsjl-blrbx-mvvmq-5z4zu-mf7eq-hhv7o-ezfro-3ae       1    zh3               1    Yotta                                           1    Zurich                      1                   

Voted to reject proposal #134491.

The proposal replaces healthy Active status but cordoned node gtfa3 from CH3 DC in Illinois, with currently Offline status node 6hqi5 from Portugal, while this would be a slight improvement for the decentralization of the subnet and the motivation makes sense and the provided Forum link included in the summary provides further info, also it can be checked here.

At the time of the review it appears as offline.



2 Likes

Voted to adopt proposal 134491.

This proposal replaces cordoned node gtfa3 which appears in the dashboard as “Status: Active” for the stated reason “offboarding CH3 DC after 48 months”. This is consistent with the information in this post, and the CH3 data centre record and node provider record for MI Servers on the IC dashboard. As shown in the proposal, decentralisation parameters are improved with respect to country and remain within the requirements of the target topology.

However, as @ZackDS noted the replacement node, 6hqi5, currently appears on the dashboard as “Status: Offline”. It also appears as “DOWN” using the decentralization tool. If the node is indeed consistently offline then this would be a basis on which to reject this proposal.

3 Likes

@bitmoon any comment on the reason the node went down since the proposal was submitted? Will you be able to bring it back up?

2 Likes

Proposal 134491

TLDR: The node that’s proposed to be added to this subnet is DOWN, while the node that is proposed to be removed is UP (well spotted @ZackDS). This would reduce the number of functional nodes in the subnet, so I have rejected this proposal.

Decentralisation Stats

Subnet node distance stats (distance between any 2 nodes in the subnet) →

Smallest Distance Average Distance Largest Distance
EXISTING 0 km 7497.062 km 19448.574 km
PROPOSED 0 km 7317.281 km (-2.4%) 19448.574 km

This proposal slightly reduces decentralisation, considered purely in terms of geographic distance (and therefore there’s a slight theoretical reduction in localised disaster resilience). :-1:

Subnet characteristic counts →

Continents Countries Data Centers Owners Node Providers Node Operator
EXISTING 5 26 31 31 31 31
PROPOSED 5 27 (+3.7%) 31 31 31 31

This proposal slightly improves decentralisation in terms of jurisdiction diversity (if the new node were actually up, but it’s not).

Largest number of nodes with the same characteristic (e.g. continent, country, data center, etc.) →

Continent Country Data Center Owner Node Provider Node Operator
EXISTING 12 3 1 1 1 1
PROPOSED 13 (+8.33%) 3 1 1 1 1

See here for acceptable limits → Motion 132136

The above subnet information is illustrated below, followed by a node reference table:

Map Description
  • Red marker represents a removed node (transparent center for overlap visibility)
  • Green marker represents an added node
  • Blue marker represents an unchanged node
  • Highlighted patches represent the country the above nodes sit within (red if the country is removed, green if added, otherwise grey)
  • Light grey markers with yellow borders are examples of unassigned nodes that would be viable candidates for joining the subnet according to formal decentralisation coefficients (so this proposal can be viewed in the context of alternative solutions that are not being used)

Node Changes
Action Node Status Continent Country Data Center Owner Node Provider Node Operator
Remove gtfa3 UP :bar_chart: Americas United States of America (the) Chicago 3 (ch3) CyrusOne MI Servers t37p3
Add 6hqi5 DOWN :bar_chart: Europe Portugal Lisbon 2 (li2) Edgoo Networks Bitmoon nvocp
Other Nodes
Node Status Continent Country Data Center Owner Node Provider Node Operator
v27at UP :bar_chart: Americas Argentina CABA 1 (ar1) SyT - Servicios y Telecomunicaciones S.A. Mariano Stoll 5p6xp
zjiki UP :bar_chart: Oceania Australia Queensland 1 (sc1) NEXTDC ANYPOINT PTY LTD srrm2
xu2zg UP :bar_chart: Europe Belgium Antwerp (an1) Datacenter United Allusion pgunx
x3cey UP :bar_chart: Americas Canada Toronto (to1) Cyxtera Blockchain Development Labs 6oxlv
v2pkj UP :bar_chart: Europe Switzerland Zurich 3 (zh3) Nine.Ch Tomahawk.vc anodw
w4ri3 UP :bar_chart: Asia China HongKong 1 (hk1) Unicom Pindar Technology Limited vzsx4
aajth UP :bar_chart: Americas Costa Rica Bogota 1 (bg1) EdgeUno Geeta Kalwani 74vhn
zgtrt UP :bar_chart: Europe Czechia South Moravian Region 1 (bn1) Master Internet Maksym Ishchenko c3oqp
yi6r6 UP :bar_chart: Europe Spain Madrid 1 (ma1) Ginernet Ivanov Oleksandr qyawb
zgeaf UP :bar_chart: Europe Estonia Tallinn 2 (ta2) Telia DC Artem Horodyskyi rhtt6
atjbz UP :bar_chart: Europe France Paris 1 (pr1) Celeste Carbon Twelve g3nqx
3jol6 UP :bar_chart: Europe United Kingdom of Great Britain and Northern Ireland (the) London 1 (ld1) Latitude.sh Conic Ventures raiov
uouxk UP :bar_chart: Asia Georgia Tbilisi 1 (tb1) Cloud9 George Bassadone yhfy4
q3vac UP :bar_chart: Europe Croatia Zagreb 1 (zg1) Anonstake Anonstake 3sm7v
ecxbl UP :bar_chart: Asia India Navi Mumbai 1 (nm1) Rivram Rivram Inc mpmyf
67t6p UP :bar_chart: Asia India New Delhi 1 (nd1) Marvelous Web3 DC Marvelous Web3 ri4lg
dyycg UP :bar_chart: Asia India Panvel 2 (pl2) Yotta Krishna Enterprises 7rw6b
rfkza UP :bar_chart: Asia Israel Tel Aviv 1 (tv1) Interhost GeoNodes LLC lis4o
go5zz UP :bar_chart: Asia Japan Tokyo (ty1) Equinix Starbase cqjev
wjwzb UP :bar_chart: Asia Korea (the Republic of) Seoul 2 (kr2) Gasan Web3game 5dwhe
fhg3q UP :bar_chart: Asia Sri Lanka Colombo 1 (cm1) OrionStellar Geodd Pvt Ltd ywjtr
qlk52 UP :bar_chart: Europe Latvia Riga 1 (rg1) DEAC MB Patrankos ĆĄĆ«vis jptla
g4avo UP :bar_chart: Europe Romania Bucharest (bu1) M247 Iancu Aurel c5ssg
qp3lh UP :bar_chart: Asia Singapore Singapore 2 (sg2) Telin OneSixtyTwo Digital Capital qffmn
6adxp UP :bar_chart: Europe Slovenia Ljubljana (lj1) Posita.si Fractal Labs AG gl27f
vgfnl UP :bar_chart: Europe Sweden Stockholm 1 (sh1) Digital Realty DFINITY Operations SA lgp6d
vqucp UP :bar_chart: Americas United States of America (the) Atlanta 2 (at2) Datasite Giant Leaf, LLC bmlhw
y7bml UP :bar_chart: Americas United States of America (the) Panama City 1 (pc1) Navegalo Bianca-Martina Rohner qaes5
kgo2t UP :bar_chart: Africa South Africa Cape Town 2 (ct2) Teraco Kontrapunt (Pty) Ltd x7fjr
kwryq UP :bar_chart: Africa South Africa Gauteng 3 (jb3) Xneelo Wolkboer (Pty) Ltd ymenq

You may wish to follow D-QUORUM if you found this analysis helpful.

Known Neurons to follow if you're too busy to keep on top of things like this

If you found this analysis helpful and would like to follow the vote of the LORIMER known neuron in the future, consider configuring LORIMER as a followee for the Subnet Management topic.

Additional good neurons to follow:

  • D-QUORUM (a highly decentralized neuron that follows neurons that have been elected by the NNS)
  • Synapse (currently follows the LORIMER and CodeGov known neurons for Subnet Management, and is a generally well informed known neuron to follow on numerous other topics)
  • CodeGov (actively reviews and votes on Subnet Management proposals, and is well informed on numerous other technical topics)
  • WaterNeuron (the WaterNeuron DAO frequently discuss proposals like this in order to vote responsibly based on DAO consensus)

Note that this analysis involved data provided by the IC-API, which is not open source. I’m in the process of switching over to more verifiable sources of this sort of information for future proposal reviews. See here for related discussion.

2 Likes

Proposal 134491

Vote: REJECT

Replaces cordoned node gtfa3, status Active with node 6hqi5, status Offline on subnet uzr34.
The reason for this proposal is to offboard CH3 DC consistent with forum posts made on the forum thread used for posts regarding the renovation/sell of Gen-1 node machines by NPs specifically here.
Both the NP and DC stated in the forum post match the ones from the node being removed in the proposal.
Unfortunately, since the proposal the node proposed has become Offline and NP hasn’t provided any clear indication on why this happened at the moment. I’ll be awaiting for a response by @bitmoon for another 12 hours otherwise I’ll be rejecting the proposal.

1 Like

I’m investigating the case no worry.

2 Likes

Thank you for the update @bitmoon looks like the node is back online. Could you share what was the issue, now that Dfinity decided to stall and not vote for only this one proposal makes me wonder.

1 Like