If it is just an image or text, the mouse pointer will only remainas the 'Selection Tool' icon (black pointing arrow), or the 'Pan around the document' tool ( a little white hand icon). You can check that by hovering the mouse pointer over that link.
Assuming that this type of PDF is not restricted from editing, identify if the annoying link is actually just text or a hyperlink.