New Jerusalem Baptist Church Church of Capitol Heights, MD. The location of New Jerusalem Baptist Church Church is 20743, 6802 Walker Mill Rd - marked with a pin on Google Map.