We're thinking about different "regulation", and that's another place where extreme opinions have nuked the ground into glass.
Absolutely yeah, techbros are playing up the risks because they hope regulators looking for a cheap win will suddenly increase the cost for competitors, lock out open alternatives and grandfather them in as the only valid stewards of this supposedly apocalyptic technology. We probably shouldn't allow that.
But "maybe don't make an app that makes porn out of social media pictures of your underage ex girlfriend at the touch of a button" is probably reasonable, AI or no AI.
Software uses need some regulation like everything else does. Doesn't mean we need to sell the regulation to disingenuous corporations.