# Technical Working Group: Scalability & Performance

**URL:** <https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265>\
**Category:** Developers\
**Tags:** Discussing, community-consideration\
**Created:** [July 11, 2022, 9:51am UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265 "2022-07-11T09:51:10Z")\
**Posts on this page:** 20\
**Page:** 3

<div class="post-metadata">

**Author:** ![dsarlis](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/dsarlis/32/689_2.png) [@dsarlis](https://forum.dfinity.org/u/dsarlis)\
**Post date:** [January 24, 2023, 12:52pm UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/43 "2023-01-24T12:52:21Z")

</div>

To clarify: the limit you point to is the current throughput of tECDSA signatures per second that a subnet can produce (you need those in order to submit BTC transactions so of course the limit on those sort of implies a limit on the BTC transactions themselves).

AFAIK, the current implementation of tECDSA is not super optimized, so I would expect that this limit can be increased eventually. Likely there is going to be some limit on what a single subnet can do (the protocol is quite complex) but there is always the possibility to allow more subnets to sign using tECDSA which means we can “scale out” the throughput of these operations on the IC as whole.

---

<div class="post-metadata">

**Author:** ![domwoe](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/domwoe/32/5165_2.png) [@domwoe](https://forum.dfinity.org/u/domwoe)\
**Post date:** [February 15, 2023, 10:52am UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/44 "2023-02-15T10:52:57Z")

</div>

Hey everybody,

we’ll be moving this week’s session to next week same time:

**Thursday, February 23rd 5:30pm CET (GMT+1).**

I’ve already updated the calendar.

We’ll have another session on using storage on the IC. We’ll prepare a survey that we’ll share before the session and want to discuss the results in the session.

Sorry for the late notice and I hope many of you can join nevertheless.

---

<div class="post-metadata">

**Author:** ![domwoe](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/domwoe/32/5165_2.png) [@domwoe](https://forum.dfinity.org/u/domwoe)\
**Post date:** [February 20, 2023, 2:34pm UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/45 "2023-02-20T14:34:47Z")

</div>

Hey everybody 👋,

In preparation for the WG session this week, we’d like to invite you to take a quick survey on how you use memory on the IC:

https://dfn.typeform.com/to/VkfeqLPu?typeform-embed=embed-widget

Please participate and join the WG on Thursday where we’d like to discuss the results. 🙏

---

<div class="post-metadata">

**Author:** ![domwoe](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/domwoe/32/5165_2.png) [@domwoe](https://forum.dfinity.org/u/domwoe)\
**Post date:** [February 23, 2023, 3:52pm UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/46 "2023-02-23T15:52:02Z")

</div>

Hey everybody 👋,

The Working Group is happening in about 40 mins (5:30pm GMT+1).

We’ll discuss the results of the survey and @senior.joinu will give an update on on the [ic-stable-memory rust library](https://forum.dfinity.org/t/ic-stable-memory-rust-library/14158/56).

See you soon!

---

<div class="post-metadata">

**Author:** ![domwoe](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/domwoe/32/5165_2.png) [@domwoe](https://forum.dfinity.org/u/domwoe)\
**Post date:** [March 3, 2023, 1:51pm UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/47 "2023-03-03T13:51:26Z")

</div>

Belated update:

[slides](https://docs.google.com/presentation/d/1s1E54d_uD2FRSQMXZaoig7jWjn4fn1o554il9TA3veA/edit?usp=sharing) with the responses from the survey and the [recording](https://dfinity.zoom.us/rec/share/xGNIjUvxEFr1adbxSzTHgXF0m9sO7cMwN0GLll9RDKbhSpyUKDti4tUUIh7JCG3E.GHUtUpqaHopsrLPA).

Some topics from the discussion:

- Discussion on alternative encodings for serializing to stable memory (bincode and [MessagePack](https://msgpack.org/index.html) instead of Candid)
- Sqlite on the IC. See also [ICSQLite:Sqlite backed by stable memory - #17 by FroghubMan](https://forum.dfinity.org/t/icsqlite-sqlite-backed-by-stable-memory/16140/17)
- Discussion on data structures vs. databases on the IC
- Discussion on cycle limits
- Update on [ic-stable-memory](https://forum.dfinity.org/t/ic-stable-memory-rust-library/14158/56) which allows dynamic key/value lengths and a certified map compatible with certified assets protocol.

If you watch the recording and have thoughts please feel free to add them here.

**Important**

We have also a request to move the working group from Thursdays at 5:30 pm CET (GMT+1) to Wednesdays at 6:30 pm CET (GMT+1). Are there any objections to that? Note that we’d still use the cadance of every 3rd Wednesday of a month.

@lastmjs @dymayday @skilesare @senior.joinu @icme @dsarlis @claudio @abk @stefan-kaestle @saikatdas0790

---

<div class="post-metadata">

**Author:** ![dymayday](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/dymayday/32/4935_2.png) [@dymayday](https://forum.dfinity.org/u/dymayday)\
**Post date:** [March 9, 2023, 4:45pm UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/48 "2023-03-09T16:45:07Z")

</div>

Hey @domwoe, will the move to 18:30 permanent ?  
Sorry for being late on the mater but I feel it is kinda late as it is the time dedicated to the kids for me.

I really enjoy this working group and I don’t want to sounds selfish though. This is why I’m asking if this is the permanent schedule from the on.

---

<div class="post-metadata">

**Author:** ![domwoe](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/domwoe/32/5165_2.png) [@domwoe](https://forum.dfinity.org/u/domwoe)\
**Post date:** [March 13, 2023, 3:27pm UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/49 "2023-03-13T15:27:18Z")

</div>

Hey @dymayday,

we wanted to change the date because @abk will take over the DFINITY lead of the working group, and the time didn’t really fit for him. However, he read your response and made it work 💪 .

So **Update**

We won’t change the date/time of the Working Group. This means we will have the next session, this Thursday at 5:30pm CET!

---

<div class="post-metadata">

**Author:** ![abk](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/abk/32/5122_2.png) [@abk](https://forum.dfinity.org/u/abk)\
**Post date:** [March 15, 2023, 4:34pm UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/50 "2023-03-15T16:34:10Z")

</div>

Hey everyone,  
For the WG tomorrow I’ll be presenting some benchmark results comparing the `ic-stable-structures` and `ic-stable-memory` libraries, as well as sharing some tips on efficiently using stable memory. This should be useful for those of you planning to store significant data in stable memory.

---

<div class="post-metadata">

**Author:** ![domwoe](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/domwoe/32/5165_2.png) [@domwoe](https://forum.dfinity.org/u/domwoe)\
**Post date:** [March 17, 2023, 7:38am UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/51 "2023-03-17T07:38:14Z")

</div>

Updated [meeting notes](https://docs.google.com/document/d/11L9_MvoW12JTWH71T6i3ULskjj9b3Gec0oBPVR83ZsE/edit?usp=sharing) and [recording](https://dfinity.zoom.us/rec/share/hosYjlXEx4Xp3xVrV3_VsN3xr5FbQoyRUwBFo5SjLDcg8o0YXd2036kCMuvOg0Xo.imCiwgOSKPq_cRXz).

**Edit:** Added link to slides to the meeting notes.

---

<div class="post-metadata">

**Author:** ![josephgranata](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/josephgranata/32/21930_2.png) [@josephgranata](https://forum.dfinity.org/u/josephgranata)\
**Post date:** [April 5, 2023, 8:33pm UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/52 "2023-04-05T20:33:03Z")

</div>

@domwoe and @abk we recently joined the forum, and find this Technical Working Group to be really important to everyone who is building, or would like to build an ambitious DAPP.

I will do my best to join the next meeting on Thursday, April 20th.  
Have a wonderful Easter everyone, and a good Passover too.

P.S. Thanks so much for sharing the slides and videos!

---

<div class="post-metadata">

**Author:** ![domwoe](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/domwoe/32/5165_2.png) [@domwoe](https://forum.dfinity.org/u/domwoe)\
**Post date:** [April 6, 2023, 6:37am UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/53 "2023-04-06T06:37:17Z")

</div>

Welcome @josephgranata,

I remember that we already had interactions on Twitter. Good to have you here!

---

<div class="post-metadata">

**Author:** ![josephgranata](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/josephgranata/32/21930_2.png) [@josephgranata](https://forum.dfinity.org/u/josephgranata)\
**Post date:** [April 6, 2023, 6:18pm UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/54 "2023-04-06T18:18:24Z")

</div>

Thanks, the feeling is mutual.

Have a great Holy Week, and Happy Passover too 😉

---

<div class="post-metadata">

**Author:** ![domwoe](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/domwoe/32/5165_2.png) [@domwoe](https://forum.dfinity.org/u/domwoe)\
**Post date:** [April 19, 2023, 9:12am UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/55 "2023-04-19T09:12:42Z")

</div>

Join us tomorrow, Thursday, April 20th at 5:30 pm CEST (GMT+2) for the next session of the Scalability & Performance WG.

We’ll have presentations from OpenChat, DSCVR, and Dragginz about their ideas and approaches toward sharding data across canisters.

Pretty exciting, right? Hope to see many of you there for a lively discussion.

[Zoom link](https://dfinity.zoom.us/j/98492107298?pwd=QlJQNnU5SmhKY01vbTRkYlEyZ2Rzdz09)

Update: [Meeting notes](https://docs.google.com/document/d/11L9_MvoW12JTWH71T6i3ULskjj9b3Gec0oBPVR83ZsE/edit?usp=sharing) and [recording](https://dfinity.zoom.us/rec/share/OVwPTYpfAT6GX2_JuDhPGd8SnB4ou8dBRV6kvYf8ACaJqLrTT2wEKu9KP9thRLf4.lj_v6CsDeZxBzdi2)

---

<div class="post-metadata">

**Author:** ![cyberowl](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/cyberowl/32/3635_2.png) [@cyberowl](https://forum.dfinity.org/u/cyberowl)\
**Post date:** [April 19, 2023, 10:01am UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/56 "2023-04-19T10:01:40Z")

</div>

Are any of these sessions recorded?

---

<div class="post-metadata">

**Author:** ![domwoe](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/domwoe/32/5165_2.png) [@domwoe](https://forum.dfinity.org/u/domwoe)\
**Post date:** [April 19, 2023, 10:07am UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/57 "2023-04-19T10:07:19Z")

</div>

yep, the check the links in the [meeting notes](https://docs.google.com/document/d/11L9_MvoW12JTWH71T6i3ULskjj9b3Gec0oBPVR83ZsE/edit?usp=sharing)

---

<div class="post-metadata">

**Author:** ![domwoe](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/domwoe/32/5165_2.png) [@domwoe](https://forum.dfinity.org/u/domwoe)\
**Post date:** [May 15, 2023, 6:01am UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/58 "2023-05-15T06:01:12Z")

</div>

Hey,

we’ll move this month’s working group session by one week to **May 25th** because there’s a holiday in Switzerland this Thursday.

See you next week!

---

<div class="post-metadata">

**Author:** ![abk](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/abk/32/5122_2.png) [@abk](https://forum.dfinity.org/u/abk)\
**Post date:** [May 23, 2023, 2:06pm UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/59 "2023-05-23T14:06:54Z")

</div>

Hey everyone!  
For the session this Thursday @senior.joinu will discuss the design of a new multi-canister storage library and we’ll give an overview of the Storage+Scaling ICP.Lab. Hope to see you there!

Adam

Details: Thursday May 25th at 5:30 pm CEST (GMT+2) [Zoom link](https://dfinity.zoom.us/j/98492107298?pwd=QlJQNnU5SmhKY01vbTRkYlEyZ2Rzdz09)

---

<div class="post-metadata">

**Author:** ![senior.joinu](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/senior.joinu/32/9240_2.png) [@senior.joinu](https://forum.dfinity.org/u/senior.joinu)\
**Post date:** [May 25, 2023, 6:33pm UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/61 "2023-05-25T18:33:36Z")

</div>

In case somebody needs my presentation on union-db:

> **[union-db WG](https://docs.google.com/presentation/d/1YH7BPt2BvwYKOpU_xEGOlbk4relTAxbVYlElAa_Zl6U/edit?usp=sharing)**
>
> union-db infinite database on the IC

---

<div class="post-metadata">

**Author:** ![skilesare](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/skilesare/32/5609_2.png) [@skilesare](https://forum.dfinity.org/u/skilesare)\
**Post date:** [May 25, 2023, 9:08pm UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/62 "2023-05-25T21:08:24Z")

</div>

Hey @senior.joinu, your presentation is sweet. I’m sorry I missed the meeting. I’m pretty sure that canDB gets you 65% of the way to what you want. Transactions are hard and item-level locking is complicated, but it isn’t impossible. CanDB is open source and I’d encourage you to fork, seed pull requests, etc. I’d love to get @icme 's thoughts on what you put together and how it differed from what you are presenting.

---

<div class="post-metadata">

**Author:** ![domwoe](https://sea1.discourse-cdn.com/flex023/user_avatar/forum.dfinity.org/domwoe/32/5165_2.png) [@domwoe](https://forum.dfinity.org/u/domwoe)\
**Post date:** [May 25, 2023, 9:11pm UTC](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265/63 "2023-05-25T21:11:31Z")

</div>

I couldn’t participate as well, but happy to be able to share the [recording](https://dfinity.zoom.us/rec/share/xZcGQ0d4xMJUGQIgcizbmLufjeOV90xTqFcxekOWa8eTQQn6tH6kKpkDadHyVj9D.7oKrFj5YMYNlQRWo).

[Previous page](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265.md?page=2)

[Next page](https://forum.dfinity.org/t/technical-working-group-scalability-performance/14265.md?page=4)
