No way. The weakest point IMO is the plate you screw your bindings into and i's interface w the inserts- but those are pressed in, and that is WAY stronger than what you're currently screwing your bindings into without it, y'know?
Considering that the weakest point in the whole system is still considerably stronger than a regular mount, I'd totally dismiss your fears of fragility to be completely honest.
I'd say the biggest cons at this point are weight (which isn't much) since the alpine heel stays on, and the potential for ice- which if you spray with silicone lube (dynafit users already do this regularly anyways) it's also a non-issue. The former issue is being worked on with the heel sliders and the latter issue is one of natural laws that cannot be fixed aside from preventative measures and regular care by the user.