Welcome @Dunsin-cyber
There are a few form topics here covering AI/ML related development on the Internet Computer. Try a search for AI or GPU and you will find them.
The most useful thread for you to start with would be the recently convened Decentralised AI Working Group (DeAI WG), all are welcome! Technical Working Group DeAI
The WG has an active IC Dev Discord channel for members of the WG and any other interested parties to chat here Discord
The WG holds a weekly voice meeting on Discord on Thursdays, the next one is in about 12 hours from now. Information about it is in the Discords channel.
The questions and limitations you raised are active topics of discussion right now so come join in!