Fiduciary duty does not require you do what they want. If the majority of stock holders don't like your management, they can replace you. Fiduciary duty basically just means that you have to act in good faith.
But your assertion also isn't true. Most shareholders are long term shareholders who want stable growth, not the short term spikes followed by hard crashes that are the result of forcibly extracting profit without paying appropriate attention to long term sustainability.