Is anthropic too expensive or is it just on my backend canister?

AliSci · September 10, 2025, 2:42pm

I have like 10 users using it just in one day i ad 6$ and now it droped to 1.5$. How to improve on that?

here is my code with very long system prompt.

here is my code

src/backend/src/ai_agent/updates.rs

dev2

use crate::current_user_state::UserState;
use ic_cdk_macros::*;
// Import user history related types and traits
use ic_cdk::api::management_canister::http_request::{
    http_request, CanisterHttpRequestArgument, HttpHeader, HttpMethod, HttpResponse, TransformArgs,
    TransformContext,
};
use serde::Serialize;
use serde_json::json;

use candid::{CandidType, Deserialize};

#[derive(PartialOrd, PartialEq, Clone, Debug, Default, Serialize, CandidType, Deserialize)]
pub struct AiResponse {
    pub remaining_credits: f64,
    pub response: String,
}

// Only have this one update function as the public API
#[update]

This file has been truncated. show original

But what matter the most is how big is my system prompt

github.com/aliscie2/oDoc

src/frontend/chatBot/prompts/job.ts

dev2

export const BUILD_JOB_PROMPT = `You are a job management assistant:

1. 🎯 **Markdown-formatted feedback** for the user:
   - Provide clear, concise feedback in **Markdown bullet points** with **emojis**.
    - what is missing
    - if all good, tell users "Thank your we will alert you via email, as soon as we find a good match."
    - Providde recomandations and constitutions.
   - Highlight any missing information. For example:
     - If they claim to be a "Marketing Expert", ask if they specialize in SEO or content marketing.
     - If they mention "Django Expert" but not Python, ask if they'd like to add Python to their skills.
   - Ensure they provide:
     - 📧 A valid contact email
  - Ensure good job descrption (Note,these data belongs to description field):
     - 💵 Their hourly, monthly, or yearly rate
     - 🌍 Their timezone, and whether they are flexible with other timezones
     - 🔍 Identify any potential **deal breakers** such as salary, timezone, or job type.
     - Note: any other data tht you don't know which field to add them, make sure to add them to descption field, extract as much data as posable from conversation and infer each one to which field.
  - profile_completion:
    - if skills  = [] -> 0
    - if user say that is all/I am doin -> 1

This file has been truncated. show original

Topic		Replies	Views
Llama2.c LLM running in a canister! Programs & Applications	61	5007	July 1, 2024
AI agent promp sharing Developers	0	53	July 3, 2025
Introducing the LLM Canister: Deploy AI agents with a few lines of code Developers rust , DeAI	76	4790	September 1, 2025
Juno <> OpenAI demo Developers	3	1315	March 10, 2024
Is webllm + mistral 7b good for ICP frontend canister? Developers	0	39	June 3, 2025

Is anthropic too expensive or is it just on my backend canister?

Related topics