After weeks of troubleshooting and rebuilding, we can now install Fedora 11 MIPS/N32 version "base" group by yum, that means we can bootstrap a base Fedora system already.
Next is to make most of the commonly used applications available on yum and find a server to host the repository (~5Gb so far).