Significant minority say No to union leaders