Churches are present in every district in Abuja. Utilizing google search will enable you locate the church of your choosing or the closest church to you.
Mosques are scattered all across the city. Every district in has one. A quick google search should locate the one closest to you.