Technical Working Group DeAI

Query Structure Modification

To enhance AI capabilities and reinforce security on the Internet Computer (IC), I propose a modification to the current query structure. By introducing properties like ic_cdk::query(cycles_fee=true) or ic_cdk::query(cycles_fee=true, composite_query=true) , we can responsibly increase instruction limits per query—currently capped at 5 billion for queries, 20 billion for updates, and 200 billion for initialization. This change not only maintains essential safeguards against DDOS attacks but also significantly broadens the potential for AI on the IC. The impact on AI inference would be substantial, enabling larger model sizes, cost-effective resource utilization, and notably faster response times. Providing AI developers these tools will also prove to be a crucial step towards the efficient training of ML models on the IC.