AMD has been lauded as the most formidable competitor to Nvidia's dominance, but the firm now faces tough competition from custom processors and the larger rival's industry stronghold.