Yes, Virginia, you have to cross-compile

Embedded Linux mindshare of top six CPU types 
(2002 LinuxDevices.com developer poll):
x86	- 32%
Arm	- 27% (e.g. Linksys)
PowerPC	- 16% (e.g. TiVo 1)
MIPS	-  9% (e.g. Linksys, TiVo 2)
SH	-  5% (e.g. Dreamcast)
Coldfire-  4% (e.g. Snapgear)

To reach most of the market, you need to cross-compile!
Most open-source software supports being cross-compiled
(though you may have to nudge it a bit)