With Motoko, is it possible to serialize any type of object into a Blob so that it can be sent to another canister in chunks and then deserialized on the other end? Thank you.

[image] Motokoder: Here are some examples of what I would call complex types: public type Address = { id: Nat32; street1: Text; street2: Text; city: Text; province: Text; postalCode: Text; country: Text; }; public type Person = { id: Nat32; firstName: Text; lastNa…

Hey @KennyBoyNYC . I’m honored that your first post was in my thread, even if it’s a bit off topic. I won’t speculate on price, but let’s just say that $ICP is my primary long-term investment. :wink: If you’re not a web developer yet, now is a good time to learn. Full-stack = React + Motoko.

Ah. I’m honored. I’m not a developer but I heard amazing things bout Motoko :+1:t2::+1:t2::+1:t2:

Let’s take a step back. If you store a lot of data in your canister then for save upgrades (to guarantee that the upgrade will never fail due to exceeding the cycle limit per execution) you will likely need to store data directly in stable memory with the low-level interface. Links: [image…

Since you mentioned Text. If you have Text you can convert it to Blob with Text.encodeUtf8 first and then write it to stable memory with storeBlob.

To back up the data in the stable memory I would just take the entire memory pages and ship them off as Blob to another canister. To clarify, do you mean to use the loadBlob function ? You should be able to send at least 2 MB in a single inter-canister message. With the stable memory being organ…

Thank you @timo for your comprehensive explanation. This gives me a lot to think about. Due to the experimental warning, I have intentionally left out ExperimentalStableMemory from the solution. However, I am very hopeful about leveraging this library in the future. I have a few questions on that t…

[image] Motokoder: It sounds like the only way to get a blob from an instance of a complex type is to custom serialize it to a string format like JSON and then call Text.encodeUtf8. Certainly not the only way. What complex type are you thinking about? You can probably serialize it directly to…

Thanks again. I like your idea to copy the stable data with multiple operations after the upgrade is finished. I’ll do some testing for the message size limit since the IC code is a bit over my head. [image] timo: Certainly not the only way. What complex type are you thinking about? You can pro…

@timo @jzxchiang It looks like the inter-canister message size limit is 2 MB.

[image] jzxchiang: do you mean to use the loadBlob function Yes, I meant that one.

Motoko Serialization

Developers

mbeekman July 5, 2022, 8:03am 33

Also found this helpful as a reference …

thanks @Gabriel

Topic		Replies	Views
Binary Representation for from_candid - motoko Language Support Motoko	10	1405	December 16, 2022
Two questions about canister storage Developers	30	3777	March 9, 2022
Motoko stable memory in 2022 Developers Discussing	25	3160	March 23, 2023
Motoko : encode an object into Candid to pass arguments into install_code Developers candid	7	1506	May 5, 2022
Heap out of bounds ， use motoko Developers Functional-Programming	45	3494	June 22, 2023

Motoko Serialization

Related topics