Harris went up to Oxford to study at Christ Church College. He was in the XI from 1871 to 1874, playing against Cambridge in all years except 1873 when nursing an injury.
In 1872 he joined a cricketing tour to North America alongside WG Grace, with whom he formed a close friendship.
Having succeeded his father to the Barony in 1872, during July 1874 he married the Hon. Lucy Ada Jervis at Godmersham.
All this social activity caused him to miss several terms at Oxford (due to getting married) and having failed to gain an honours degree in Classics, returned to study more, finally leaving in 1875 with a pass degree in Arts.
During his time at Oxford, Harris made several appearances for Kent and was appointed captain in 1875, a position he held until 1889.