I set wallpaper for one activity, but the rest remains default. I searched with google and only found ways to set them differently.

They are supposed to use different wallpapers, when one is changed. I don't know of a way for them to be changed together.
Normal virtual desktops would all share the same wallpaper.