The 2MB limit is for individual files, not the whole directory. You can upload around 2GB of data (not the full 4GB because of GC) to the asset canister, as long as each file is smaller than 2MB.
The current workaround is to implement chunking in the frontend code. But I agree this should be done somewhere at the platform level.