Technical Working Group DeAI

Small update from Kinic team:

Open beta is staring next week (we have closed beta now for anyone who asks to try it out). The plugin will be dropped into our OC with directions on usage. Based on the results and feedback we will post to Chome store shortly after.


A little bit of rifting on succinct verification for AI.

Kinic team is pretty close to finishing SOTA for zero-knowledge machine learning (2~ months or so). This means succinct proofs for many types of models run off-chain - with decent prover time. Not sure how well this will work for large LLM, but we plan to release benchmarks in any case. sub minute off-chain inference is a near term target. Other models like gradient boosting and prediction (DeFi) should be much faster.

The IC right now uses TEE in a special subnet for LLM inference. We plan on introducing zkML as another method that also supports private weights / models. We will market this to grab the attention of people in the larger AI space.


VetKey integration progress is good.

We would love to chat about SOTA on zkML and what it means in the context of the IC.

  • Verifiers on chain that can trigger other chains via Chain Fusion.
  • Persistent, Auditable Memory for AI.
  • Potential for: private inference, private data, private, weights.
  • Super powerful AI agents.
6 Likes

that sounds great, do we wanna have a session on this as one of the upcoming calls?

And we’re having a demo by @swift on ANIMA this Thursday but could reserve a few minutes for you to share some info around the open beta if you like

1 Like

Cool! Yeah - I can go over the tech and make a few slides on how it works and what it empowers people to do. Will chat on the Discord on timing.

Kinic launched Open beta today → So would love to talk on that.
Thursday is my meeting day :slight_smile:

2 Likes

Hi everyone, during this week’s session @swift will present his work and give us a demo of ANIMA (https://4qf4i-5qaaa-aaaal-qsjta-cai.icp0.io/) :muscle: looking forward to the call!

4 Likes

This is the event in the ICP Discord for today’s call: ICP

The call will take place in the voice channel as usual (see link in the bottom left corner on the event).

See you later :+1:

Hi everyone, thank you for yesterday’s call (2025.05.01). Special thanks to @swift for sharing his work on ANIMA! This is the generated summary (short version, please find the long version here ): In this session of the DeAI Working Group, Michael presented ANIMA, a project focused on building emotionally aware, persistent AI personalities (ANIMAs) on the Internet Computer. The group explored its architecture—combining LLMs, memory, emotional modeling, and on-chain identity—as well as its broader implications for AI cognition, personality simulation, and autonomy. Discussions ranged from technical challenges like HTTP outcalls and multimodal tool ecosystems to deeper philosophical questions about anthropomorphizing AI and simulating time, with participants recognizing ANIMA’s potential as both a user agent platform and research testbed.

Links shared during the call:

4 Likes

:spiral_calendar: Upcoming Calls & Topics

Date Topic Presenter
May 8 Kinic: Open Beta, SOTA for zero-knowledge machine learning @apotheosis
May 15 MCP & Agent2Agent Protocol
May 22 AI4AI @icarus
May (tbd) Session on Efficient LLMs and DeepSeek
May (tbd) Session on instruction limit
Future Expert session on Active Inference implementations Invite TBD
9 Likes

I will have to start attending these meetings making them a regular occurrence.
:infinity: :robot::selfie: :writing_hand: :wireless: :cloud:

2 Likes

Hi everyone, this Thursday @apotheosis will present the latest work at Kinic, including the just released Open Beta and state-of-the-art Zero-Knowledge Machine Learning (zkML) :robot: :locked_with_key: :rocket:
Please find details what to look forward to in this post: Come hear about the state of the ART on ZKML. *ICP is the global orchestration layer for DeAI

I’m excited for the session and seeing you all then :muscle:

Hi everyone, thank you for today’s call (2025.05.08). Special thanks to @apotheosis for the great presentation on zkML and the update on Kinic! This is the generated summary (short version, please find the long version here ): @apotheosis gave an update on Kinic’s browser plugin which is now in open beta and then deep dived into Zero-Knowledge Machine Learning (ZKML). His presentation explored ZKML on the Internet Computer (ICP), highlighting how zk-proofs enable verifiable AI computation without exposing sensitive data. He compared ZK with Trusted Execution Environments (TEEs), outlined technical advancements like folding schemes, Jolt-based ZKVMs, and WebGPU acceleration, and showcased real-world use cases such as private LLM inference and AI agent coordination. The ICP’s architecture allows for native on-chain verification of modern proof systems, positioning it as a powerful platform for decentralized, privacy-preserving AI.

Please find the video recording of the call here

High quality
Lower quality

Links shared during the call:

4 Likes

:spiral_calendar: Upcoming Calls & Topics

Date Topic Presenter
May 15 MCP & Agent2Agent Protocol @baolongt
May 22 AI4AI @icarus
May (tbd) Session on Efficient LLMs and DeepSeek
May (tbd) Session on instruction limit
Future Expert session on Active Inference implementations Invite TBD
3 Likes

Hi everyone, join us this Thursday to discuss and learn more about two of the hottest topics in AI these days: the Model Context Protocol (MCP) and the Agent2Agent Protocol. @baolongt will talk about his latest work on building MCP on ICP :muscle: See you all then (the usual 6pm CET in the ICP Discord) :+1:

2 Likes

Hi everyone, thank you for today’s call (2025.05.15). Special thanks to @baolongt for sharing his latest work on MCP on ICP! This is the generated summary (short version, please find the long version here ): The session covered developments in integrating Model Context Protocol (MCP) with ICP, demonstrating a working prototype on ICP canisters and plans for an MCP SDK, while highlighting challenges such as ICP’s 2MB HTTP call limit and MCP’s complex streaming protocol. An overview of Google’s Agent-to-Agent (A2A) Protocol was provided, noting its standardized inter-agent communication and potential complementarity or competition with MCP, as well as straightforward ICP integration possibilities. The meeting concluded with community suggestions for future sessions, including Vibe Coding and a hardware-focused presentation by Icarus next week on Accelerated Infrastructure for AI on ICP.

Links shared during the call:

1 Like

Thanks a lot Pat for sharing this video, and the links too!

Curious, how do you record the Discord? I think that would be a useful tool to have.

Also the Discord link is not working, can you check it please.

Joseph Hurtado
Founder Granata Consulting
CTO Satoshi Notes