Hard to swallow

Generated image of a man about to swallow a large pill
The idiom hard to swallow (or sometimes a hard pill to swallow, or a bitter pill to swallow) means something that is difficult or uncomfortable to accept.

The phrase comes from medicine. Swallowing a bitter pill can be unpleasant, so the image is used for something hard to accept.

Losing the contract was a hard pill to swallow for the team.