In the category of just because we can do something doesn’t mean we have to.
The reality is that Fortune 100 companies will hire McKinsey instead of your pro-social firm, because McKinsey’s solutions will increase shareholder value more than your firm’s solutions will. It will always be possible to build A.I. that pursues shareholder value above all else, and most companies will prefer to use that A.I. instead of one constrained by your principles
Source: Ted Chiang, “Will A.I. Become the New McKinsey?” Via Schneier On Security