Error while trying to run IDL.encode on values around 1.8×10^308 or larger

bdemann · July 8, 2024, 9:51pm

What type of topic is this?
Bug Report

I am having some problems encoding large bigints

This works

IDL.encode(
    [IDL.Nat],
    [
        170_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000n
    ]
);

But this breaks

IDL.encode(
    [IDL.Nat],
    [
        180_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000_000n
    ]
);

with the following error:

RangeError: Invalid array buffer length
        at new ArrayBuffer (<anonymous>)

      at lebEncode (../../../node_modules/@dfinity/candid/src/utils/leb128.ts:54:25)
      at NatClass.encodeValue (../../../node_modules/@dfinity/candid/src/idl.ts:552:21)
      at ../../../node_modules/@dfinity/candid/src/idl.ts:1575:16
      at ../../../node_modules/@dfinity/candid/src/idl.ts:50:27
          at Array.map (<anonymous>)
      at zipWith (../../../node_modules/@dfinity/candid/src/idl.ts:50:13)
      at Object.encode (../../../node_modules/@dfinity/candid/src/idl.ts:1567:8)

Gekctek · July 8, 2024, 11:07pm

Looks like a potential issue with max size(?) of an ArrayBuffer

github.com

dfinity/agent-js/blob/9758583a52e3eeccb73425165ecd8188ab46e112/packages/candid/src/utils/leb128.ts#L54


      
          export function lebEncode(value: bigint | number): ArrayBuffer {
            if (typeof value === 'number') {
              value = BigInt(value);
            }
          
            if (value < BigInt(0)) {
              throw new Error('Cannot leb encode negative values.');
            }
          
            const byteLength = (value === BigInt(0) ? 0 : Math.ceil(Math.log2(Number(value)))) + 1;
            const pipe = new Pipe(new ArrayBuffer(byteLength), 0);
            while (true) {
              const i = Number(value & BigInt(0x7f));
              value /= BigInt(0x80);
              if (value === BigInt(0)) {
                pipe.write(new Uint8Array([i]));
                break;
              } else {
                pipe.write(new Uint8Array([i | 0x80]));
              }
            }

Topic		Replies	Views
Bigint function error Language Support	9	1462	May 6, 2020
leb128_1.lebEncode issue in react-native Developers	7	465	July 21, 2021
Could not serialize message in js actor Developers	0	579	January 1, 2022
CanCan error: Failed to store video. [TypeError: Conversion from 'BigInt' to 'number' is not allowed.] Developers	10	1273	August 3, 2021
Failed to deserialize idl blob: Invalid data Rust	3	25	November 25, 2024

Error while trying to run IDL.encode on values around 1.8×10^308 or larger

Related topics