I’m assuming that you ran into issues with model size. If you would be willing to speak to issues that you faced, I would be happy to listen.
My Rust Crate, although still in early development, is open-source. I post my updates on my taggr account. This post as a link to the open-source tract library that I have started maintaining.
I am currently investigating if placing queries in separate canisters increases the throughput of composite_queries. I’m starting by asking others if this is the case, but I will know for sure after I implement it myself – I would just implement it with more urgency if it were confirmed. I’m excited to share an example that can enable any AI developer to easily publish their methods to the IC.