Problem
When users contact an agent on Zillow's home listings, they are given an option to check a box that says "I want financing information." This used to trigger a transactional email that was simply an upsell for our mortgage products that didn’t really give the user what they ask for.
Zillow has a quality score metric that helps determine lead quality. While this email drive lots of revenue, the quality score told us that the users weren't actually ready to convert. This email's quality score was ~15%. Our target is 25% or higher.
User Pain Points
In user research we have learned that home shoppers often feel overwhelmed by the mortgage process because they:
Don’t always understand how much they need to put down on a home. Many think they need 20% and don’t know that the minimum amount is 3% (or even 0% in certain cases).
Aren’t always aware that PMI is required if they put less than 20% down, and they don’t realize how much it can add to their monthly mortgage payment.
Don’t always understand that mortgage rates are different for every scenario.
We've also learned that they are strictly house-driven. They care about one particular home and aren’t interested in general mortgage information.
And finally, we learned that they don’t want to talk to a lender until they feel more confident.
Results
Because the current version of this email had such high visibility and drove a lot of revenue, we A/B tested my new version against the current version. Here are the results:
Quality Score: 41.8% (178% increase from control. Target score is <25%)
Revenue: $1.2m/year (20% increase from control)
These results tell me that not only is this email giving users the content that they want, but it is educating them enough that they feel confident about talking to a lender.