You're right, it shouldn't be a racist word but it has become so as it has continuously been used by racists in racist context. The correct abbreviation for someone from Pakistan is Pakistani, not Paki.
Joyful are the days when we used to hear '****ing pakis, get em!'

