Matt Milnes was the pick of the Yorkshire attack with five for 31 as Sussex added just 80 runs on the fourth day.