Come hear about the state of the ART on ZKML. *ICP is the global orchestration layer for DeAI

Showcase
1

Come Hear About The Future of Decentralized AI: Zero-Knowledge Machine Learning On ICP.

Hey!

Come Join the DeAI Working Group next meeting: May 8th Topic:

@kinic_app

I’ve been deep in the zkML rabbit hole and wanted to share some exciting developments that showcase why the Internet Computer is uniquely positioned to lead the DeAI revolution. This isn’t just theoretical - the technology is advancing rapidly, and ICP’s architecture gives us distinct advantages that no other blockchain can match.

Zero-Knowledge Machine Learning:

Zero-knowledge machine learning represents a paradigm shift in how we think about AI verification. It allows you to:

  1. Run AI models locally on your own hardware
  2. Generate mathematical proofs that you ran the model correctly
  3. Let anyone verify these proofs with absolute certainty - no trust required

This solves multiple critical problems simultaneously: privacy concerns, computational sovereignty, and trustless verification.

Why ICP Has the Edge

Several technical factors position ICP at the forefront of this revolution:

:magnifying_glass_tilted_left: Direct ZKP Verification

Unlike other chains, ICP can host ZKP verification directly on-chain without complicated workarounds. This is a massive architectural advantage that simplifies the entire verification flow.

:counterclockwise_arrows_button: No Proof Composition Required

Most blockchains force developers to use “proof composition” - a complex process of wrapping ZKPs to make them compatible with on-chain verification. These often rely on Groth16 with trusted setups (introducing security assumptions we’d rather avoid). ICP sidesteps this entirely.

:bridge_at_night: Chain Fusion Capabilities

ICP’s threshold cryptography enables fluid interactions with other chains, creating powerful workflows:

  • Run your model locally (keeping data private)
  • Verify execution on ICP
  • Trigger actions across BTC, ETH, and other networks

This cross-chain capability will be essential for AI agents operating across the blockchain ecosystem. AI is not going to use fiat.. but crypto to transact among themselves.

:brain: Vector Databases On-Chain

ICP smart contracts can natively host vector databases - the specialized data structures that power modern AI. Better yet, they can maintain privacy for sensitive data. This is perfect for:

  • Personal data (email, documents, health records)
  • Proprietary datasets you want to monetize
  • Collaborative AI training with privacy guarantees

Technical Advancements Driving This Forward

The zkML field is evolving at breakneck speed, with proving speeds improving approximately 100x annually. Our team at Kinic is pushing state-of-the-art approaches.

The most exciting development is JOLT (“Just One Lookup Table”), a ZKP scheme that leverages lookup arguments for dramatically faster proving. What makes this particularly powerful for AI is how well lookup arguments handle non-linear functions like ReLU - the backbone of modern neural networks.

We’re currently modifying JOLT to extend to AI-specific opcodes with specialized lookups and precompiles, which will dramatically outperform previous zkML approaches in raw proving speed.

Join the Revolution

If you’re as excited about this potential as we are, here’s how to get involved:

  1. Check out the JOLT paper: Jolt: SNARKs for Virtual Machines via Lookups
  2. Join our upcoming developer session: Technical Working Group DeAI - #289 by patnorris
  3. Share your use cases in the comments - we’re particularly interested in hearing what AI applications you’d imagine when there are no technical boundaries.

I made a modified Sutton’s principle: “An AI system can only truly create and maintain knowledge to the extent that it can verify that knowledge, on its own, succinctly and reliably.” With ICP and zkML, we’re building exactly that future.

:victory_hand:

10 Likes
2

I’m very interested in this topic and actively working on something at the moment. What time is the meeting?

3

Depends on your timezone, here is the event link

2 Likes
4

Thanks! That’s 2am in my timezone so I don’t think I’ll make it unfortunately. Will there be a recording of the session?

5

By the way, the project I’m working on is intended to train a publicly visible AI model on a private dataset, and to use a zk-STARK to show that the training was authentic. This is verifiable training as distinct from verifiable inference, and I’ve been using the Winterfell Rust crate. Here are some links in case anyone would like to take a look:

1 Like
6

You and me both! AEST timezone for me.
Little known fact: the ”De" in DeAI stands for “dedication” and “delerium”, not just"decentralisation’ :grin:

The working group is open to shifting the time of the meeting once a month to make it easier for some of us in the Asia Pacific timezones, if there are a few of us not just me it is maybe it is worth doing.

1 Like
7

This looks like really interesting work, would you be open to sharing in a future DeAI group meeting?

I am leading the May 22 meeting which has an ai hardware focus but if we shifted the start time a few hours, would you be interested in a short presentation of your work?
@patnorris ping!

1 Like
8

Hey! That is super cool.

We can discuss more in the Discord or here.
STARKs are battle tested for ‘scaling blockchains’, but easily explode in memory usage for large problem sets. Some DeFi companies are using it for small problems and models (Giza.xyz).

TLDR; it will not scale to larger training sets unless you have many BIG machines working on it.

In my talk I will discuss this a bit and all previous attempts at zkML.
*It might be recorded? @patnorris

Sum check based approaches, such as GKR are very promising.

This is current claimed SoTa :one:

Before that there was Modulus labs - acquired by WorldCoin. Also used GKR.

Prior .. Halo2 based work and other non-specialized zkML that was often super slow.

We are experts in the space and will 10x :one:.

This is done with lookup arguments for non-linearities, folding scheme, and of course lots of sum check protocol. Don’t want to give toooo much away as we will likely release a research paper on it. :sweat_smile:

REF:

1 Like
9

I’m not clear how this is possible in a way that cannot be spoofed. I claim I’ve ran a model (y) offline and that the output is x. How do you prove/disprove that? (both x and y)

10

Please take a look at a few of the papers listed. ZKP for verifiable computation is a very well researched field. This can get a bit mathy :slight_smile: If you are interested in learning ZK, I can post some material! zkhack discord and the Thaler book are great starting points.

Gist: Program is turned into polynomials and queried using the power of randomness by the verifier.

Longer Gist:

Zero-Knowledge Proofs (ZKPs) allow one party (the prover) to convince another party (the verifier) that a statement is true without revealing any additional information beyond the validity of the statement itself.

To address your concern about spoofing: with proper ZKP systems, it’s not just about claiming ‘I ran model y and got output x’ - the mathematics of ZKPs creates cryptographic commitments and verification processes that are provably secure.

Here’s a clearer explanation of the sum-check protocol:

  1. The computation (running model y to get output x) is represented as a polynomial function.

  2. The prover converts this program into a multilinear extension (MLE) polynomial representation and commits to it using a cryptographic polynomial commitment scheme.

  3. The verifier generates random challenges without needing access to the full polynomial.

  4. Through an interactive protocol, the prover provides evaluations of the polynomial at points determined by the verifier’s random challenges, along with cryptographic proofs that these evaluations are consistent with the original commitment.

  5. The verifier runs multiple rounds of verification using the sum-check protocol, where:

  • The prover gradually reduces a high-dimensional claim to a one-dimensional claim
  • Each round, the complexity decreases as the verifier picks random challenges
  • The mathematical properties of polynomials ensure that incorrect computations will be detected with high probability
  1. The entire process is built on hardness assumptions and mathematical properties that make it computationally infeasible to forge proofs for incorrect computations.

This approach handles both concerns: it proves the prover knows output x AND that it was indeed produced by running model y, without revealing the internal details of the computation.

1 Like
11

I’m also AEST/AEDT so if some of the meetings were a few hours earlier I’d certainly try to make it along. I’d be interested to present something but I’d probably like to push it back a bit further. At this stage I’m still doing a lot of figuring out and not sure if the project I’m building will end up working or if I’ll need to try a different approach altogether.

1 Like
12

Thanks! Happy to discuss here, and hopefully it might help other people working on similar things.

I had a quick look at those links and I’ll to go through them much more thoroughly over the next few days or so. I gather scaling might be a problem for trying to do this with STARKs so I’ve started just trying to use a very small model and dataset. I’ve gone into a fair bit of detail in the GitHub issue I’ve posted (the “some hurdles” link in my previous post). From what I understand so far, my hunch is that it should be possible to make this work with Winterfell but perhaps my logic is a bit messed up.

For using GKR, I’ve come across the Expander Rust library (briefly outlined here) but I haven’t explored it in much detail yet. So far I’ve been focusing mainly on the high level details and gradually chipping away at all the maths, so I’ve been looking for a good Rust example of using this for neural networks or other machine learning models but haven’t yet found anything. Ultimately I’m hoping to build a basic verifiable training tool by one or another means and then use it as the basis for a federated learning system or something similar as a larger project.

13

Some of the best writing I’ve seen on this topic is from Vitalik Buterin. This one of his on zk-STARKs is particularly good. See also this selection.

2 Likes
14

Sounds good!

Good to know: ZKP people are touchy about the naming STARKs vs SNARK. Technically STARKs are a transparent setup form of SNARK and many modern SNARK are STARKs :sweat_smile:

In general, when someone says STARK they mean something that uses hashes (FRI) at its core rather than elliptic curves or lattice based techniques.

Its interesting as most STARK are actually not privacy preserving; i.e. they have no ZK.

History note: STARK paper came from a founder of STARKWare - they are often still used in the context of memory hungry proving to scale blockchain.

1 Like
15

I usually publish a written summary afterwards but if you like we can video record today’s call and publish that then too. Would that work for you?

1 Like
16

That would be great!

1 Like
17

please find the summary of @apotheosis 's presentation here: Technical Working Group DeAI - #293 by patnorris