Mathematics seems to accept the concept of zero but not the concept of infinity

Read another response by Allen Stairs
Read another response about Mathematics, Physics
Mathematics seems to accept the concept of zero but not the concept of infinity (only towards infinity); whereas Physics seems to accept the concept of infinity but not of nothing (only towards zero). Yet there is a discipline of 'mathematical physics' . Is there an inherent fault in mathematical physics?