The First Congregational Church Church of Newburgh, NY. The location of The First Congregational Church Church is 12550, 44 Liberty St - marked with a pin on Google Map.