In organisms that undergo conjugation with cellular fusion, the process resulting in desensitization following exposure to pheromone stimulus that act to down-regulate further stimulation or block initial conjugation responses. An example of this is the adaptation to pheromone during conjugation with cellular fusion in Saccharomyces cerevisiae. [ GOC:clt ]