I don't know where you're from or how big your Federal district is, but here where I'm at, my Federal district is much bigger than my city or county for that matter. So that would not be correct in all cases.
I've worked with USAO's all over the U.S., and it's still largely correct. In my case, I think our USAO covers all of the western panhandle of Florida. That would still be demographically similar to a jury drawn only from my town.
So, in the case of a hate crime that occurs in rural Alabama, for instance, the jury pool is STILL going to be drawn largely from rural Alabama.
I don't know much about Alabama. But I doubt that the federal jury pool would consist of mostly members from the immediate community where the crime may have occurred. I may be mistaken though.