Big blob and icrc7 nft

Gwojda · February 11, 2025, 3:17pm

Hey guys,
We are implementing a icrc7 nft, with “infinite” storage scalability. But here, lets say we want to upload a big file (as a Blob) to the canister, what is the good pratice here now on dfinity ?
Do we have any lib to handle the chunks ? How would you design this?`

Edit : Is assets storage canister code opensource?
Thanks!

Gwojda · February 11, 2025, 3:42pm

I think @Vivienne you are working on it, right ?

skilesare · February 11, 2025, 4:10pm

Icrc-7 is not designed to handle large/infinite data. For that you need ICRC-56. ICRC/ICRCs/ICRC-56/readme.md at icrc56 · skilesare/ICRC · GitHub

This is just a draft and pair the existing asset canister api patter with Origyn-nft storage schematics which are generally available and published here:

github.com/ORIGYN-SA/origyn_nft

src/origyn_nft_reference/storage_http.mo

def2cc893


      
          //handles non-streaming large content
          /**
          * Handles non-streaming large content
          * @param {Types.State} state - The current state
          * @param {string} key - The key of the content to handle
          * @param {string} contentType - The content type of the content
          * @param {CandyTypes.Workspace} data - The workspace containing the content
          * @param {httpparser.ParsedHttpRequest} req - The parsed HTTP request
          * @returns {HTTPResponse} - The response containing the content
          */
          public func handleLargeContent(
              state : Types.StorageState,
              key         : Text,
              contentType : Text,
              data        : CandyTypes.DataZone,
              req         : httpparser.ParsedHttpRequest
          ) : HTTPResponse {
              let result = _stream_content(key, 0, data);
          
                                  debug if(debug_channel.large_content)D.print("handling large content " # debug_show(result.callback));

Bluntly icrc-56 needs community review and updating to incorporate verification v2.

You can’t really put unlimited blobs in metadata and an icrc exists to provide a hash and to point to the file elsewhere(obvious tie in to 56 would make sense with a standard https schema that matches with 56 structure as demonstrated by Origyn-nft but without needing the protocol proxy.). 95% is already in the nft, just needs standardization and then refactoring.

See Reserved For Large Metadata Handling in Transaction Logs · Issue #61 · dfinity/ICRC · GitHub and Proposal for initial best practices for ICRC7 metadata · Issue #76 · dfinity/ICRC · GitHub and ICRC-97: Non-Fungible Token (NFT) Metadata Standard · Issue #97 · dfinity/ICRC · GitHub

Vivienne · February 11, 2025, 5:46pm

Here is the asset canister code, and here is a description of the interface. The thing that does the upload that we have is icx-asset or the ic-asset crate if done via dfx.

sea-snake · February 11, 2025, 6:00pm

ICRC-7 by itself does not specify metadata and assets, there’s ongoing discussion around ICRC-97 regarding metadata, where assets are referred to by URI within the metadata.

If the file upload itself doesn’t need to be standardized, then any custom batch of chunks flow will suffice.

Most straightforward approach would be copying what the asset canister does, as suggested by @Vivienne, but you might want to implement additional permissions, rules etc for your use case.

Gwojda · February 12, 2025, 9:26am

Thanks !
Can you update candid dependencies in this crate ? crates.io: Rust Package Registry Please ?

edit : Looks like the right way to do it now is to use ic-asset-certification ?

sea-snake · February 12, 2025, 9:44am

Yes as seen here: sdk/src/canisters/frontend/ic-frontend-canister at master · dfinity/sdk · GitHub

Gwojda · February 12, 2025, 9:50am

Not sure to understand,
ic_certified_assets has not been updated since 2 years now, and on this topics : Announcing the HTTP certification library for Rust - #14 by unixway Severin said it’s not up to date anymore and we should use ic-asset-certification, which is not yet released AFAIK.

looks like this part is currently been reworked, right ?
Basicly what i’m looking for is the crate to handle the upload/get of the (potential big) file to a specific canister, ideally compatible with icx-asset (and a js lib) so we dont have to re-invent the wheel.

Thanks !

sea-snake · February 12, 2025, 9:52am

It looks like this might not use stable memory yet

So you’ll likely be limited to the heap memory, for a website of only a few gb that might be fine. But for larger file storage purposes you might want to opt for something else.

Maybe the following project might be an alternative: Improving the Stable-FS: Enhancements and Optimizations for Better Performance

Keep in mind this does not implement chunk uploading and http_request so you’ll need to combine both projects manually.

sea-snake · February 12, 2025, 9:54am

See @dfinity/assets for a js lib and the crate is available already at crates.io: Rust Package Registry

Gwojda · February 12, 2025, 9:57am

Ah thanks !
For some reason i didnt found it earlier, maybe typo error on my side.
I’ll try to add this to my project. Thanks again ! I’ll come back here to put this as solution if i’m able to do it

unixway · February 12, 2025, 10:36am

ic-asset-certification is already released and working

Gwojda · February 12, 2025, 10:49am

do you have a public repository where you are using ic-asset-certification ?
Looks like it’s only define some type, but the method requiered here : sdk/docs/design/asset-canister-interface.md at master · dfinity/sdk · GitHub are not defined ?

unixway · February 12, 2025, 12:33pm

We have not released it yet.

However, based on your original topic, it seems to me that it would not solve your problem. The purpose of this library (ic-asset-certification) is to certify assets without the hassle and boilerplate code of the original ic-http-certification. It does not provide a way to upload or store assets.

Topic		Replies	Views
File Storage On IC Developers Discussing , community-consideration	12	4001	January 22, 2024
Chunk Upload Asset Canister Developers Frontend	5	709	February 27, 2023
Announcing ICRC7/ICRC37: A Complete NFT Implementation for the Internet Computer Developers	24	869	October 23, 2025
IC management create canister type "asset" Developers	15	3090	June 21, 2022
Uploading documents(assets) to a canister Rust	2	58	July 23, 2024

Big blob and icrc7 nft

Related topics