Limit upsell item quantity

Is there a way to limit the quantity of an upsell item at checkout? As far as I can see, customers can adjust the quantity of an upsell and I would like to keep them only able to purchase 1 per order form.