What is meant by model drift?
Correct Answer
C) A model losing accuracy as the market changes
Why this is correct: Model drift refers to a valuation model losing predictive accuracy over time because market relationships embedded in its training data change. This degradation occurs as buyer preferences, economic conditions, or supply-demand dynamics shift. Why the other choices are wrong: "A model returning different values on each run" describes randomness or instability, not drift. "A model being applied outside its licensed region" is a scope issue. "A model whose vendor has ceased supporting it" relates to maintenance, not accuracy decay. Exam tip: Model drift is why periodic testing against current market data is essential for automated valuation models.
Why This Is the Correct Answer
Option C is correct because model drift means a valuation model loses predictive accuracy as the market changes. The relationships captured in its training data, such as how buyers value features, shift with economic conditions, preferences and supply and demand. As a result the model's estimates gradually become less reliable unless it is tested and updated.
Why the Other Options Are Wrong
Option A: A model returning different values on each run
Option A is wrong because a model returning different values on each run describes randomness or instability in the model's output. Drift is a gradual loss of accuracy over time, not run-to-run inconsistency.
Option B: A model being applied outside its licensed region
Option B is wrong because applying a model outside its licensed region is a scope or usage issue. It concerns where the model is used, not accuracy decaying as market conditions change.
Option D: A model whose vendor has ceased supporting it
Option D is wrong because a model whose vendor has stopped supporting it is a maintenance issue. Lack of support may contribute to problems, but the term drift refers to accuracy declining as the market moves away from the model's training data.
Market moves, model drifts
Picture a boat anchored to old data while the market current carries prices away. The farther the market moves, the farther the model drifts from accuracy.
How to use: Use this image when a question asks why an AVM's accuracy declines over time.
Exam Tip
Connect drift with time and changing market conditions. Options about randomness, licensing or vendor support describe different problems.
Common Mistakes to Avoid
- -Confusing drift with random variation between model runs
- -Treating drift as a licensing or geographic scope problem
- -Assuming a model stays accurate without periodic testing against current sales
Concept Deep Dive
Analysis
This question tests the definition of model drift in automated valuation. The key idea is decay over time: a model built on past market relationships becomes less accurate as those relationships change. Look for the option that links lost accuracy to a changing market.
Background Knowledge
Automated valuation models learn price relationships from historical sales data. When market conditions change, those learned relationships can become outdated, so periodic testing against current sales is needed to detect and correct drift.
Real-World Application
A lender's AVM was calibrated on sales from a period of rapid appreciation. After the local market cools, a review against recent closed sales shows its estimates running consistently high, prompting the vendor to retrain the model.
More Emerging Methods Questions
A loan is eligible for Fannie Mae's value acceptance + property data option, and the lender elects that option. What does the lender obtain in place of an appraisal?
An appraiser uses a building-permit file to investigate an addition. What is an important limitation of that source?
A real estate salesperson, acting solely in a brokerage role, prepares a CMA to help a listing client choose an asking price. Which statement is best?
An appropriately credentialed appraiser is offered a desktop assignment on an unfamiliar property type. A necessary competency gap is known before agreement. If the appraiser elects to proceed, what is required?
How should an appraiser identify potentially distressed transactions in a data set?
Why should an appraiser identify the data sources used in the report?
How should an appraiser treat a value estimate found on a consumer real estate website?
An appraiser builds a spreadsheet regression to support adjustments. How is it treated?
May an appraiser use data from a prior assignment for a different client?
The intended lender’s applicable assignment conditions require an interior inspection. The client asks the appraiser to deliver a desktop appraisal instead, and the inspection condition has not been authorized for modification. What should the appraiser do?
People Also Study
Real Estate Market
13.6% of exam
Property Description
11.8% of exam
Land or Site Valuation
4.5% of exam
Sales Comparison Approach
16.4% of exam
Cost Approach
13.6% of exam
Previous Question
Under Fannie Mae's Selling Guide, a lender obtains a hybrid property data collection from an insurance inspector, gives it to an appraiser who completes Form 1004 Hybrid, submits the appraisal to UCDP, reviews it, and delivers the loan. Which required lender step was skipped?
Next Question
Why might an appraiser check a listing service in addition to recorded transfer information for the subject?