Asset canister upload script

chenyan · December 4, 2021, 6:52pm

There is a CLI: agent-rs/icx-asset at main · dfinity/agent-rs · GitHub

lastmjs · December 4, 2021, 6:54pm

Excellent! Thank you

kpeacock · December 4, 2021, 6:58pm

I want to add a npm package making this simple in JS, too

lastmjs · December 4, 2021, 7:10pm

That would also be excellent

lastmjs · December 4, 2021, 7:10pm

That’s what I was going to do but I probably won’t now

lastmjs · December 4, 2021, 7:19pm

Can it be used locally? Do you know how that would be done? I passed it a local canister id and I get this error:

thread 'main' panicked at 'Could not create HTTP client.: reqwest::Error { kind: Builder, source: "Unknown TLS backend passed to `use_preconfigured_tls`" }', /home/lastmjs/.cargo/registry/src/github.com-1ecc6299db9ec823/ic-agent-0.10.0/src/agent/http_transport.rs:62:18

kpeacock · December 4, 2021, 7:20pm

If you’ve got the time and motivation to write it up, I’m happy to see if we could get you set up with a grant for it!

lastmjs · December 4, 2021, 7:32pm

I think I’m running into this issue: chore: update cargo dependencies by ericswanson-dfinity · Pull Request #285 · dfinity/agent-rs · GitHub

lastmjs · December 4, 2021, 7:33pm

Ah thanks for the offer, I should really get back to the TypeScript, Python CDKs and Sudograph. I’m taking a slight detour for this: https://twitter.com/dominic_w/status/1467144071449915395

Checks a lot of boxes for me, Demergence has issues with streaming, easy to pick up too

lastmjs · December 4, 2021, 7:54pm

I got it to work by installing the main branch

jorgenbuilder · December 4, 2021, 9:02pm

I’ve been doing that with a little zsh script, but it sounds like you’re up and running!

coin_master · December 5, 2021, 4:26am

Offer is still there? I would be interested to give it a go if I have some help

lastmjs · December 6, 2021, 3:15pm

I’m happy to off guidance if you need it too, @lastmjs on Telegram is best

coin_master · December 7, 2021, 2:44am

Thanks I could definitely use some help.
I have a rough idea on where to start by calling the asset canister actor methods, but I have few questions:

1-What is the order of calling these methods or the order of the process? create_batch, commit_batch etc…

2- how do you authorize the actor from within the script? ‘dfx deploy’ do that automatically but I am not sure how to do that manually

coin_master · December 7, 2021, 4:01am

I found how to authorize with your private key in here

github.com

deckgo/deckdeckgo/blob/6d5942dc70baf0f8a98c5e22380f947ad94994a8/canisters/scripts/ic.installcode.mjs#L39

    
      
          
          
  return Secp256k1KeyIdentity.fromSecretKey(Buffer.from(privateKey, 'base64'));
          };
          
          
(async () => {
            try {
              const canisterId = managerPrincipal();
          
          
    const identity = initIdentity();
          
          
    const agent = new HttpAgent({identity, fetch, host: 'https://ic0.app'});
          
          
    const actor = Actor.createActor(idlFactory, {
                agent,
                canisterId
              });
          
          
    const buffer = readFileSync(`${process.cwd()}/.dfx/local/canisters/data/data.wasm`);
              await actor.installCode([...new Uint8Array(buffer)], 'data');
            } catch (e) {
              console.error(e);

That was really helpful

cryptoschindler · December 8, 2021, 10:59am

mind sharing that @jorgenbuilder ?

jorgenbuilder · December 8, 2021, 5:44pm

gist.github.com

https://gist.github.com/jorgenbuilder/6d32ef665b84457a9be2063224b754fb

main.mo

// This part of the example is a bit long-winded. The upload logic bits are at the very bottom.

shared ({ caller = creator }) actor class MyCanister() = canister {


    // State


    // The upload buffer, for adding additional assets.
    private let buffer : Buffer.Buffer<Blob> = Buffer.Buffer(0);

This file has been truncated. show original

upload.zsh

#!/bin/zsh

file=${1}
filename=$(echo $file | sed -E "s/.+\///")
fileextension=$(echo $file | sed -E "s/.+\.//")
name=${2}
tags=("${(@s/ /)3}")
description=${4}
mime=${5:-image/$fileextension}
network=${6:-local}

This file has been truncated. show original

jzxchiang · December 13, 2021, 4:03am

For those running into the same issue (I got it from using ic-repl), just make sure to update the Cargo.toml of the binary you’re trying to build like this:

-ic-agent = "0.9.0"
+ic-agent = { git = "https://github.com/dfinity/agent-rs" }

github.com

chenyan2002/ic-repl/blob/b671cd569c0cca83fc5f5a089c5658f1992faa84/Cargo.toml#L21

    
      
          candid = { version = "0.7.8", features = ["random"] }
          rustyline = "8.2"
          rustyline-derive = "0.4"
          ansi_term = "0.12"
          pretty_assertions = "0.7"
          terminal_size = "0.1"
          codespan-reporting = "0.11"
          pretty = "0.10.0"
          pem = "0.8"
          shellexpand = "2.1"
          ic-agent = "0.9.0"
          tokio = { version = "1.6.0", features = ["full"] }
          garcon = "0.2.3"
          anyhow = "1.0"
          rand = "0.8"
          logos = "0.12"
          lalrpop-util = "0.19"
          clap = "2.33"
          structopt = "0.3.16"
          ring = "0.16"
          serde = "1.0"

cryptoschindler · December 20, 2021, 2:25pm

I tested it and it works great for local development. Can this be used to upload assets to a canister deployed on mainnet too?

cryptoschindler · January 3, 2022, 12:15pm

Yes it can:

icx-asset --pem identity.pem --replica https://ic0.app upload n6au6-3aaaa-aaaae-qaaxa-cai index.html