First Baptist Church of Niceville Church of Niceville, FL. The location of First Baptist Church of Niceville Church is 32578, 622 Bayshore Dr - marked with a pin on Google Map.