A process that results in the breakdown of the extracellular matrix. [ GOC:jid ]