the reason why you use base 12 is because it's easy to make fractions with. much easier than base 10.
1/2 of 12 is 6
1/4 of 12 is 3
1/3 of 12 is 4
1/2 of 10 is 5
1/4 of 10 is 2.5
1/3 of 10 is 3.33333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333333
you get the point with the threes. it's just a better system for using fractions. and the mind works with fractions, therefore it is much better for everyday use.
as for accuracy in construction, imperial is just fine for all those needs. It's super easy to have accuracy down to a thousandth of an inch when need be. But unless you're a machinist you really don't need that accuracy.
A piece of wood over the course of the year might shrink by 1/2 an inch, so there's no need to go more accurate than 1/32 when cutting it. Unless you're doing something intricate in which case you might want to go for 1/64th of 1/128th accuracy. But on wood that won't make a difference in any case.
But there's absolutely no reason to be accurate in construction to within a micron, or a milligram, where for scientific uses there is that need.
and here are a couple examples of buildings build with imperial. they look rather splendid.
the entirety of this country:
the entirety of this country and all it's entire empire
recognize this city? anything older than about 1880 was built using imperial