This feature has only caused confusion, it mainly existed to prevent general CI failures, but that has since been touched on through #661 We should disable default fallback and make it opt-in