It works! Almost.
rustc passes an additional library to the linker -lutils, which doesn't exist in the musl std package, and doesn't seem to be required. With that library removed, cross compiling to linux works out of the box with rustup (assuming you can obtain an elf linker...).