The parish of Caston is located in the western part of central Norfolk about 3 miles southeast of the market town of Watton. Caston is a substantial village built around a square of lanes just west of the B1077 road which links Watton with Attleborough. Caston is built on the edge of Norfolk's Breckland, to the east lies the fertile Mid-Norfolk plains whilst to its west the soils become poorer and heathland & forestry production starts to appear. Caston is a substantial village, its population in 1831 was over a thousand souls and most would have been involved with farming or ancillary trades. The village is notable for the number of wheelwrights or perhaps they were merely more prolific.

Holy Cross church is located on the southern edge of Caston where a lane heads off to Stow Bedon. The church shows features which date it earlier than many of Norfolk's churches. The western tower, in particular, being in the Decorated style that places it perhaps 50 years earlier than most. The remainder shows the classic features of a Norfolk church e.g. Perpendicular windows. Holy Cross is unusual in that Pevsner for once doesn't mention a Victorian restoration so perhaps here we see a church in mediaeval splendour. The building sits behind tall ironwork fencing just south of Caston's rather splendid village green. It is rather hemmed in to the west making it difficult to get back far enough from the tower!