Decision trees are at their heart a fairly simple type of classifier ... achieved with classifiers that rely on a single decision boundary (such as logistic regression or support vector machines).