should the sd card be formatted first?
No, you are dealing with partition images which include the filesystem. Formatting would just be extra writes.
Is that just a given, or is usbimager just magical?
A filesystem is just blocks of data. usbimager writes those blocks of data (sometimes decompressing on the fly).