Oxford City stayed in relegation trouble despite a battling display at the Skrill North leaders on Saturday.
The result sees Mike Ford’s side remain four points adrift of safety, though they do have games in hand on their fellow-strugglers.
Trailing to a Liam King goal, Darren Pond’s penalty brought City level, only for Nathan Jarman to net the winner.
The hosts started the stronger, with Mark Scott in the City goal making a superb double-save from Jarman, firstly parrying his free-kick before saving the follow-up.
At the other end, Adam Nicklin did well to keep out a dangerous cross from Tom Winters, before Callum McNish saw his header flash wide.
After the break, Anthony Wilson spurned a great chance to put the home side ahead, but fluffed his lines.
Winters saw his shot fizz over the bar, before City were rocked when the hosts went in front.
Nathan Peat whipped in a super cross and an unmarked King headed past Scott at the far post.
But City did not let their heads drop and four minutes later were level.
Symons burst into the area, where he was brought down by Danny Hone.
Pond fired the resulting penalty past Nicklin.
City almost went further ahead when Symons set up Declan Benjamin, but Nicklin saved his shot.
Substitute Steve Basham then saw Nicklin clutch his header.
But 11 minutes from time, Ferriby grabbed the winner.
Jarman got above the City defence to head in Wilson’s cross.
City turned up the pressure in the final minutes, but were unable to find an equaliser.
Oxford City: Scott, Ballard, Stonehouse, Pook, Learoyd, Willmott, Benjamin (Bell 81), McNish (Cook 78), Symons (Basham 660, Pond, Winters. Sub not used: Henderson, West.
Referee: A Greenwood.