Seven in ten brokers agree that mainstream banks are pulling back from small business lending in a new survey.