Indirectly by pushing down the stock price. CEO compensation is usually tied to the stock price through options, bonuses, etc.

Directly through activist investors and shareholder groups (which nowadays usually are institutional investors) who vote to change company policies, fire the CEO, or in some cases fire the whole board.