
Explanation:
A is correct. Before we can calculate the information gain as , we first calculate for the base-level Gini measure by looking at the output variable being considered before we know anything about the features.
There are 5 properties that sold above EUR 8,000,000 and 5 that sold below.
Using the feature "occupancy status" as the root node, we examine this feature and find that for the 4 properties that were occupied, 3 sold above the amount and only 1 sold below.
In a similar fashion, we find that for the 6 properties that were not occupied, 2 sold above the amount and 4 sold below.
Thus, the weighted Gini measure for this feature is obtained as:
Therefore, Information Gain = , which rounds to approximately 0.09 (the slight difference from the source's 0.0902 is due to a minor calculation variance, but 0.09 remains the correct answer choice).
B is incorrect. This is just the Gini measure for the sold properties that were occupied.
C is incorrect. This is just the Gini measure for the sold properties that were not occupied.
D is incorrect. This is the unweighted sum of the Gini measure for the sold properties that were occupied and the Gini measure for the sold properties that weren't occupied ($0.375 + 0.444$).
Learning Objective: Show how a decision tree is constructed and interpreted.
Reference: Global Association of Risk Professionals. Quantitative Analysis. New York, NY: Pearson, 2023, Chapter 15, Machine Learning and Prediction [QA-15].
Ultimate access to all questions.
No comments yet.
Q-93. A quantitative analyst supporting the acquisitions team of a European corporate real estate firm is using the decision tree technique to create a model for forecasting property prices. The analyst compiles a training data set comprised of information from 10 recent property sales, as shown in the following table:
| Property | Use of site | Occupancy status (Y=occupied) | Expected positive cash flow | Sale price greater than EUR 8,000,000 |
|---|---|---|---|---|
| 1 | Office | Y | Y | Y |
| 2 | Retail | N | Y | N |
| 3 | Retail | Y | N | N |
| 4 | Office | N | Y | Y |
| 5 | Retail | N | Y | Y |
| 6 | Retail | N | N | N |
| 7 | Office | N | Y | N |
| 8 | Retail | Y | Y | Y |
| 9 | Retail | N | N | N |
| 10 | Retail | Y | Y | Y |
The table also includes the target variable of the model: a class label indicating whether the property was sold for a price greater than EUR 8,000,000. The analyst selects the occupancy status as the feature that is used as the root node of the decision tree. What is the estimated information gain of the split put forward by this root node?
A
0.09
B
0.37
C
0.44
D
0.82