The objective of ArcMind AI is to bring applied AI to the Internet Computer and ignite new ideas from developers to make use of the foundation components we developed for their projects.
We start with a LLM-powered (GPT3/4) Autonomous AI Agent that uses Chain of Thoughts for reasoning, taking actions and completing goals. As part of the AI Agent, we also developed a Vector Database with Rust running on IC. It is initially used as long-term memory for Autonomous Agent for semantic search (multiple dimensions similarity search) and adding context to the chat prompt. However, its potential use cases can extend to AI-powered applications like recommendation engine and Retrieval Augmented Generation (RAG).
Our Main App Website: https://arcmindai.app
A typical AI agent acts on behalf of humans to achieve a goal. Unlike ChatGPT or AI chatbots, given a goal, ArcMind AI can break down the goal into multiple subtasks, plan, reasoning, self-criticism, suggest the next action, and act on it until the goal is reached. It can interact with the real world in real time to explore for new information (not in the LLM training data). The more tools we provide, the more variety of goals it can achieve. At the moment, ArcMind AI can perform “Start LLM Agent”, “Browse Website”, “Google Search” and “Smart Contract Call” via “BeamFi Plugin” for streaming payment.
This process is called “Chain of Thoughts”. It is a novel idea in AI research but has become increasingly popular as “Chain of Thoughts” can increase the faithfulness of LLM and its accuracy. By letting LLM to “speak things out loud”, it usually performs better than typical AI chatbots. Also, it creates a more serious use case in the future by incorporating Autonomous AI Agents in enterprise corporate systems as human’s AI workforce.
Chain of Thoughts Flow Diagram
Chain of thoughts Sample Screenshots
ArcMind AI and Vector DB are developed with Rust Language:
It is composed of 4 canisters.
- Vector DB
Controller acts as the Main Loop canister who has the sole ownership and access to Brain, Tools and Vector DB. When a new instance of ArcMind AI is deployed to IC, our system would deploy all 4 canisters and assign controller’s ownership to the NFID user through our web app. If you deploy it locally, your dfx identity would become the ultimate owner of the whole suite of canisters.
We designed the system in this way such that one user will have the sole control over the ArcMind instance, not sharing with other users. However, it means there is an upfront cost of deploying all 4 canisters. We believe that it is a better approach than sharing canisters among users as we would like to focus on a privacy-centric approach.
To fit for the purpose, ArcMind AI adopts two LLM models. Brain canister uses GPT-4 while Tools canister uses gpt-3.5-turbo-1106 for post browse-website summarization process as gpt-3.5-turbo-1106 allows a bigger context window. GPT-4 performs better at the Chain of Thoughts process.
ArcMind AI leverages IC Timer to drive the whole Chain of Thoughts process when a new goal is sent by the user from the frontend. To reach out to LLM models, it uses HTTP Outcall with consensus. To workaround IPV6 limitation, we developed a HTTP Proxy running in Google Cloud so that Tools canister can browse any type of websites.
ArcMind strives to provide privacy-centric and decentralized Autonomous AI Agents. We achieve that by enabling users to maintain full control over their agents and data through NFID (Internet Identity) integration. Our ArcMind Vector DB is a privacy-first data store for long-term memory storage when users interact with ArcMind AI Agent. It is further secured by IC’s blockchain consensus.
Internet Computer’s multi-chain interoperability empowers ArcMind AI to make Smart Contract Call to other smart contracts in IC or other chain e.g Ethereum in an autonomous way. We developed a simple BeamFi Plugin to demonstrate streaming payment via AI Agent.
ArcMind AI adopts an open source MIT license.
It is intended to encourage innovative thinking among developers.
By open-sourcing Vector DB components, other teams can integrate semantic similarity search or recommendation into their applications, strengthening the future of AI applications.
We have also open sourced the main ArcMind AI components comprising - Main Loop Controller Canister, Brain Canister, Tools Canister and BeamFi Plugin. We believe that it has a place in enterprise system integration with AI applications. It would most likely become a background autonomous agent as AI companion of your existing workspace tools like Slack, Discord etc. Its use cases are limitless.
ArcMind AI has reached beta status which means it can be used for general users with some limitations.
Occasionally, ArcMind AI agent could be looping by itself in the Chain of Thoughts process. In that case, we have built a safe-guard to allow users to pause and restart the agent. Internally, it has a maximum number of thoughts to process. Also, browsing websites may sometimes return invalid response, which the system would pass the failure status to ArcMind AI. With its Chain of Thoughts process, it can usually understand and seek workarounds.
ArcMind AI has a Long-Term memory store. If you ask it with reference to existing knowledge, it will understand and find the relevant information from memory or past experience. It will then determine if it should conduct a new Google Search to find new information or simply use past experience for response.
Our Web UI is designed to allow users to read the thoughts process clearly with easily collapse/expand button.
There is a limitation of processing one goal at a time. Please wait until the goal has finished before entering a new goal. This is more of frontend limitation as the backend canisters are capable to store and process multiple goals.
To keep the early beta version simple, when users submit a new goal, it clears the past goals. This can change in the future.
We have integrated a monthly payment subscription model to ArcMind AI with a Starter Plan USD $18.99. That is to cover the Canister provisioning fees and OpenAI fees.
General users who seek to improve their work productivity and creativity using AI but have concerns about privacy in other tools
There are multiple different paths we can take.
- Doubling down on ArcMind AI by introducing self-hosted LLM models with better performance reducing network round trips
- Integrating with Zapier / IFTTT to open up a whole new type of integration to other services, allowing users to define their own commands for the Chain of Thoughts process
- Improve UI to show goals history and add ability to resume conversation from it
- Add user feedback commands to allow ArcMind AI agent to proactively seek user feedback
- Create a supervisor AI agent to oversee main Autonomous Agent to further improve faithfulness and safety
Reach out to us at https://twitter.com/arcmindai or Email email@example.com
Thanks for reading this article to the end. As a big thank you, we would like to offer a free first month subscription of ArcMind AI to 5 lucky users.
How to claim:
- Visit https://arcmindai.app/
- Sign up with NFID (create a NFID account first if you haven’t)
- Proceed to Starter Plan subscription
- Enter promotion code ARCMINDFREE to claim first month free subscription
- It will then provision a new instance of ArcMind to your NFID principal account.
- You can cancel the subscription anytime using My Plan page at the top right menu if you don’t want to pay next month but we would be very grateful if you can continue to support us.
- We only have limited available instance for provisioning, if all available ArcMind AI instances have been subscribed, please join the waitlist.
Github ArcMind AI
Github ArcMind Vector DB