Yes, you can make a building from pieces that were produced on an assembly line. But the vast majority of construction doesn't happen that way. And even those require labor to assemble.
My point was that the stationary robot arm you see putting cars together make sense in a factory setting, but that it wouldn't be so practical on a job site compared to something less specialized and more versatile.