I think other people have run into a similar problem.
Check out this post for more details: Simplest example of http streaming chunks in Motoko - #9 by peterparker
I do hope this gets faster though… My guess is that some of that latency is due to boundary nodes?