Recursive partitioning

Recursive partitioning is a statistical method for the multivariable analysis of diagnostic tests.. Recursive partitioning creates a decision tree that strives to correctly classify members of the population based on a dichotomous dependent variable. Compared to other multivariable methods, recursive partitioning:

• Advantages are:
  • Generates clinically more intuitive models that do not require the user to perform calculations.
  • Allows "adjustable misclassification penalties" or misclassification costs in order to create a decision rule that has more sensitivity or specificity. This has also been called the "dispersity index" which is the sum of the false-negatives and false-positives. Either the false-negatives and false-positives can be weighted in order to preferentially reduce their occurrence.
  • May be more accurate.
• Disadvantages are:
  • Does not work well for continuous variables
  • May overfit data.

A variation is 'Cox linear recursive partitioning'.

Examples are available of using recursive partitioning in research of diagnostic tests. Goldman used recursive partitioning to prioritize sensitivity in the diagnosis of myocardial infarction among patients with chest pain in the emergency room.

Calculations

Unweighted analysis

An 'Initial misclassification rate' is calculated by assigning all cases to a single class. Using the example in the CART Manual, in trying to diagnose 59 patients who have a disease of interest among a sample of 189 patients, arbitrarily classifying all patients as normal yields:
For the top node, also called node 1:

${\mbox{Initial misclassification rate}}=\left({\frac {\mbox{Total with disease}}{\mbox{Total sample size}}}\right)=\left({\frac {\mbox{59}}{\mbox{189}}}\right)={\mbox{0.312}}$

For the next nodes: The next best independent, classifier variable creates two nodes:

• Left node: 159 patients; 118 have disease and 41 are false positives who do not have the disease
• Right node: 30 patients; 12 have disease and false negatives

${\mbox{Misclassification costs}}=\left({\frac {\mbox{41}}{\mbox{159}}}\right)+\left({\frac {\mbox{12}}{\mbox{30}}}\right)=\left({\mbox{0.258}}\right)+\left({\mbox{0.400}}\right)={\mbox{0.658}}$

${\mbox{Relative misclassification costs}}=\left({\frac {\mbox{0.658}}{\mbox{0.312}}}\right)={\mbox{2.109}}$

Weighted analysis

In this analysis, the sensitivity is preferenced by weighted it by 2.2, which is the ratio of patients without disease over patients with disease.
For the top node:

${\mbox{Initial misclassification rate}}={\mbox{2.2}}*\left({\frac {\mbox{Total with disease}}{\mbox{Total sample size}}}\right)={\mbox{2.2}}*\left({\frac {\mbox{59}}{\mbox{189}}}\right)={\mbox{2.2}}*{\mbox{0.312}}={\mbox{0.686}}$

For the next nodes: The next best independent, classifier variable creates two nodes:

• Left node: 159 patients; 118 have disease and 41 are false positives who do not have the disease
• Right node: 30 patients; 12 have disease and false negatives

${\mbox{Misclassification costs}}={\mbox{2.2}}*\left({\frac {\mbox{41}}{\mbox{159}}}\right)+\left({\frac {\mbox{12}}{\mbox{30}}}\right)={\mbox{2.2}}*\left({\mbox{0.258}}\right)+\left({\mbox{0.400}}\right)={\mbox{0.568}}+{\mbox{0.400}}={\mbox{0.968}}$

${\mbox{Relative misclassification costs}}=\left({\frac {\mbox{0.968}}{\mbox{0.686}}}\right)={\mbox{1.411}}$

External links

• CART website