Day 141: Nextdoor's Winter Travel Study — Where Are the Methodology and the Advertising Results?
Another day, another Nextdoor LinkedIn post promoting research, insights, and the platform’s value. This time, the subject is winter travel, household planning, and how businesses can use Nextdoor to advertise more effectively.
I read the article several times. I came away with more questions than answers.
The article is titled When Do People Plan Winter Travel? What Nextdoor Research Says About the Household Planner.
There's nothing wrong with conducting research or sharing findings. In fact, I encourage it. But when a company promotes research as evidence of consumer behavior and uses it to support its advertising platform, I want to understand what's behind the numbers.
And that's where the questions begin.
Where is the research methodology?
The article discusses findings about winter travel planning, but where is the supporting methodology?
Some basic questions deserve answers:
How many people participated in the survey?
Who was surveyed?
How were participants selected?
When was the research conducted?
What questions were asked?
What was the margin of error, if applicable?
Were the results representative of Nextdoor users or a broader population?
These aren't unreasonable requests. They're the basic details that help readers understand what research actually tells us.
I previously contacted Jacob Chavis about Nextdoor Insights research after public references suggested I could get additional information by reaching out to him. I'm still interested in reviewing the underlying research and methodology.
If the full study is available, why not make it easier to access? If it isn't available, say so.
AI and travel planning: What's really new?
The article also discusses how people use AI and software to plan travel.
Technology-assisted travel planning isn't exactly new.
I remember using MapQuest when it was software installed on a computer. Before that, people used paper maps, guidebooks, travel agents, and all sorts of tools to organize trips.
MapQuest wasn't generative AI, and I'm not suggesting it was. It's simply an example of how people have been using technology to make travel planning easier for decades.
The technology has evolved. The tools are more sophisticated, and generative AI adds new capabilities. But the underlying desire to plan a trip, compare options, and make decisions with technology’s help is hardly revolutionary.
What makes Nextdoor advertising effective?
Here's where I really want to understand the message.
I also saw a Nextdoor post on X discussing the research in the context of effective advertising.
I went back and read the article several times. I couldn't find a clear explanation of what makes advertising effective, how Nextdoor measures that effectiveness, or what specific guidance a small business receives.
Are we talking about impressions? Click-through rates? Engagement? Leads? Store visits? Actual purchases?
Those are very different measurements.
And if a small business is spending money on Nextdoor advertising, shouldn't it clearly understand what it is trying to accomplish and how it will measure success?
My customer experience perspective
I've spent more than 20 years working in learning and development, customer experience, and contact center operations. Measurement has always been part of the work.
I've worked with metrics such as:
Average Handle Time (AHT)
Average Wait Time
First Call Resolution (FCR)
Customer Satisfaction (CSAT)
Calls per hour
Abandoned calls
Quality Assurance (QA) scores
Voice of the Customer (VoC) feedback
And those measurements aren't limited to day-to-day operations. They're used throughout the employee and customer lifecycle.
When you introduce a new hire class, change a procedure, roll out software, or implement a process improvement, you establish a baseline. You identify the business objectives and determine what should change.
Then comes the implementation.
You plan the rollout, prepare employees, provide training, conduct a soft launch when appropriate, move into full implementation, and measure the results.
You monitor the numbers, gather feedback from employees and customers, and determine whether the change actually accomplished what it was supposed to accomplish.
You don't simply announce that a new system will make everything better and walk away.
You measure it.
And you combine quantitative results with qualitative feedback. Surveys, focus groups, employee input, customer comments, and even word of mouth can help explain what the numbers are telling you.
A suggestion for Nextdoor: Hire Karen Romero
Here's a suggestion for Nextdoor: You really need to hire my former colleague and friend, Karen Romero.
She has the kind of QA experience and analytical perspective that could help Nextdoor evaluate whether its advertising campaigns are actually effective.
Think about it. Advertising effectiveness shouldn't be determined solely by how many people saw an advertisement or clicked on it. A proper QA analysis could examine the campaign's objectives, messaging, audience experience, customer interactions, and results to help determine what worked, what didn't, and what needs improvement.
Karen could help craft a meaningful approach to evaluating those campaigns, using QA analysis to go beyond surface-level numbers and identify opportunities to improve the customer and advertiser experience.
She's on LinkedIn, and Nextdoor can reach out to her there.
I'm making this recommendation because I know the value of having the right people involved in measuring performance and improving processes. Sometimes the answer isn't another marketing slogan or another research announcement. It's bringing in people who know how to evaluate the work and turn findings into actionable improvements.
Karen, consider this a public endorsement!
What happens after a small business buys an advertisement?
This is the part I think deserves more attention.
Does Nextdoor give a small business survey percentages and advertising tools, then leave it to figure out the marketing strategy?
Or does Nextdoor offer consultation to help that business determine:
Which audience it should target?
What type of advertising message is most appropriate?
How should the campaign be structured?
What does success look like?
Which metrics should be monitored?
How should the business interpret the results?
What adjustments should be made along the way?
If these services are available, Nextdoor could communicate that value much better.
Small businesses don't necessarily have dedicated marketing departments, analytics teams, or advertising specialists. They may be spending money they can't afford to waste.
An advertising platform should explain not only how to place an ad, but also how it helps businesses understand and evaluate the results.
And no, I'm not suggesting that Nextdoor can guarantee increased revenue. No advertising platform can reasonably promise that every campaign will produce a particular financial result.
But it should explain what it measures, what support it provides, and how businesses can evaluate whether their advertising investment is working.
The bigger picture: Research, transparency, and trust
This is becoming a recurring theme in my Nextdoor case study.
Nextdoor promotes research, insights, advertising opportunities, partnerships, and the value of its platform. Yet I continue to have questions about the details behind those claims.
Research should be supported by accessible methodology. Advertising effectiveness should be measured and explained. Small businesses should understand what they're buying and what resources are available to help them evaluate their investment.
These aren't complicated concepts. They're fundamentals of customer experience and business accountability.
And when a publicly traded company promotes its ability to help businesses grow, investors and customers alike should understand how it delivers that value.
Nirav, add this to the list of questions about why NXDR is struggling to build investor confidence. I wouldn't be surprised if some of these same concerns show up in a Google AI discussion about Nextdoor a year from now.
Day 141. The questions continue. The door is still open.