Change the influence bar to 25% increase per harvest while making the drop on other bars slightly less and remove hay/lime buffs. Then, have plenty increase as you go up in tiers. Leave Coal speed for people who want to grind their fields hard but remove other bonuses.
You'll have to rotate your crops more often to keep the influence but you'll save on gathering hay and porting lime (which shouldn't even be a thing in the first place).