I recommend downloading one of the pre-built Debian or Ubuntu installers from http://racket-lang.org/download/, making sure to choose i386 or x86_64 depending on your system architecture.
I don't know if the Debian version or Ubuntu version would be better on Fedora, so I recommend installing either one into a self-contained folder in case it was the wrong choice.
When you're on http://racket-lang.org/download/ and you select a Linux version to download, this note appears at the bottom of the page:
Note about the Linux installers: if you don't see an option for your
particular platform, try other Linux installers, starting from similar
ones. Very often, a build on one Linux variant will work on others
too.
It's too bad this note doesn't appear before you choose one, huh? :) For what it's worth, I've installed Racket on other versions of Linux two or three times, and I haven't noticed any problems.
