In Serbia, refusing rakija is not rudeness. It is an opportunity to explain yourself, which is almost worse.
The first rakija arrives before the menu. This is not optional. It is a greeting, a temperature check, an opening move. You may decline — but you will be asked why, and your answer had better be interesting.