ghost at the feast

/G OW1 S T AE0 T DH AH0 F IY0 S T/
noun
  1. 1

    A presence that mars one's enjoyment by causing guilt or reviving unwelcome memories.

Source: https://en.wiktionary.org/wiki/ghost%20at%20the%20feast