Comments (2)

By brantcooper, September 2, 2010 9:52 am

By now all Lean Startup and Customer Development practitioners should know that if you’re not getting out of the building, you’re not doing Customer Development. Each of the following, while often a necessary and beneficial activity, does not constitute Customer Development:

• surveys
• automated customer feedback mechanisms (e.g., uservoice, get satisfaction, et. al.)
• embedded product use analytics
• marketing analytics
• feature request mechanisms
• sales calls
• product demo
• usability testing
• focus groups

Each has its place in the Customer Development process, but without live Customer Development Conversations, you are likely compromising your ability to learn your way to Product-Market fit or startup scaling.  What you seek to learn evolves over time, as do the tactics you employ, but every step of the way should be grounded in real time conversations.

Generally speaking:

Pre-Problem-Solution Fit, you concentrate on learning as much as you can about the problem, who are the real customers (user? buyer? boss?), and possible solutions.

Pre-Minimum Viable Product, you concentrate of learning, developing and testing the minimum features and functionality required o solve the problem to a degree the customer will buy.

Pre-Product-Market Fit, you concentrate on learning about funnels, testing messaging and positioning, and likely iterating on product and market segment in search of P-M fit.

The conversation itself is difficult for many. The key to effective conversations is in developing the conversation around your objectives for the discussion.  Establish 3 or 4 “must learns” for each conversation.  Depending on what you’re trying to learn, you can use “open-ended” questions and direct questions.  Use your conversations to calibrate your other tactics.  Are you asking the right questions in your surveys?  Do responses gibe?  Are product demos necessary from the buyer’s perspective?   Are users using the product the way they say they want to?

I thought I’d share some recent experiences my clients have had with customer development conversations to help illustrate conversation tactics.

1. Talk problem first, not solution.

Client: “I can’t stop talking about the solution.  It’s how the conversation starts.”

Clearly, whenever you meet someone for the first time, you need to introduce the space your product is in.  You must provide a context for the conversation.   You need to be able to state what you’re about succinctly, so you can move on to the purpose of the meeting.  Otherwise, you spend the whole time trying to explain what you’re doing.  This is why the elevator pitch is so important.   In a conversation, you don’t necessarily repeat the pitch verbatim, but you use components of it to steer the conversation.  So, for example, if you are testing your problem assumptions, use a classic sales cold call method of “flipping” the conversation from talking about yourself (solution) to the customer (problem):

Hi, I’m Brant Cooper from Market By Numbers, and I teach Founders Customer Development principles to help get their startups off the ground; (intro that provides context)

I often hear from startup CEOs like yourself, (The Flip)

That they have trouble figuring out how to prove their business model and how to prioritize what they should be working on; (problem hypotheses)

Do you experience this at all? (Open ended question)

Follow up questions depend on the answer.  If answer is no, you might say: “That’s great, it sounds like you have things under control. “What are the primary issues you face as CEO?” or “Do you hear other CEOs that talk about these issues?”

2. Except when that doesn’t work.

Client: “I couldn’t get her to describe her pain.  She kept wanting to know how she could help me!”

The contact was a senior person in the exact type of company needed to confirm a key hypothesis.  My solution would help her company’s relationship with its clients, but I couldn’t get her to talk about that.  Instead, she talked about problems her clients had and the opportunities available to solve them.  I asked if she was a sales person and it turns out she was.    I said it sounds like she’s a good sales person, who understands the needs of her clients, and a good contact, but not his customer. I suggested my client ask her to refer him to her company’s product managers who would be more likely to be interested in his ideas.  “More contacts to speak with” should always be a core objective.

If a problem statement doesn’t resonate, either your problem statement is not articulated correctly, is flat out wrong, or you are not talking to the your customer.

3. This is not feature mongering.

Client: “Conversation inevitably turns to features discussion.”

If you are talking about features, see 1. above.  If your contact or customer is talking features, slow it down by by asking why.  Use the same 5-whys approach Eric Ries talks about to discover a problem in your development process to figure out what is driving the feature request.  Continue to ask why the customer wants specific functionality until they are able to tell you the actual problem they’re trying to solve.  This helps you consider a couple of things.  First, is the feature a high priority to the customer?  Second, are you building the right Minimum Viable Product?  Obviously, one data point is not enough to draw conclusions, but it contributes to the analysis.

4. How to test messaging.

Client: “Can’t I just A/B test?”

It’s fine to use split testing to test messaging, but it’s most effective when you’re optimizing your funnel. If you do it too early, you actually don’t know if you are optimizing for the right product and market.  Also, you can find out that one message works better than another, but you can’t learn why.  In a live conversation, not only can you ask why a message doesn’t work, but you can test several iterations in the same conversation.   When testing messages live, I like to use the “pause method.”

5. Ask them.

Client: “Everyone says I need Facebook, Twitter, a blog.  How do I know?”

If there are two things the world doesn’t need more of, they are Internet Marketers and Social Media Gurus. It’s easy to get caught up in the excitement and clearly Internet and social media marketing can be effective.  But their effectiveness depends less on which expert you hire than whether your customer and their buying process intersect with your online tactics.  I spoke with a CEO recently who had two B2B deals in pilot for his new startup.  He had personally orchestrated the sales process through 1-1 relationship building in a carefully honed market segment. Yet his marketing plan called for Internet and social media marketing that didn’t jive with his experience.  He immediately described a shotgun approach to figure out what the right online channels would be.  While it might be the case that online marketing would be successful and even necessary to scale, at that time all evidence pointed to offline methods.  Using the “Flipping the Funnel” idea, I recommended he Ask his existing customers!  Here’s a question you can ask straight out to your contacts:  Do you belong to social networks?  Do influence your buying decisions? What blogs do you read, etc.

I hope you find this helpful.  What issues do you encounter during your Customer Development Conversations?

Comments (5)

By brantcooper, July 28, 2010 7:36 pm

Now a couple of days away from the Lean Startup Machine startup weekend, I wanted to get down some initial thoughts on the event.  When approached about participating in the event, I was immediately intrigued by the idea, as long as it took the lean startup principles seriously.  Much to their credit, organizers Trevor Owens, Ben Fisher and Kyle Kelly were open to any and all ideas to make the event conform to Lean Startup and customer development principles.  And much to Eric Ries‘ credit, he threw his support behind the idea once such conformity was demonstrated.  Still, this was an experiment.

The more one adopts these principles, the more one can find ways to adopt them in all areas of life — they become “meta,” as Patrick Vlaskovits would say — and this event was no exception.  It was Lean Startup Machine’s Minimum Viable Product.

By all accounts (that I’ve heard), the event was a rousing success.  Here are some more or less random thoughts about the weekend, some of which I hope to cover in more depth soon:

1) I’m blown away by the people who attended: smart, opinionated, creative, dedicated team-players with some really interesting ideas.  And they all want to be startup founders.  Many will scoff at whether this is a good thing or not, but I think it’s great.

2) Customer Development is a great conflict resolution tool.  When you reach a loggerhead, formulate opposing opinions as hypotheses and go test them.

3) While there was reluctance among some and a few Engineers stayed inside completely, whole teams hit the streets of NYC to engage customers.  It was awesome to see!  I can’t wait for the video.

4) Clearly enterprise B2B ideas are at a disadvantage when it comes to weekend customer development.  But B2C rocked it and B2SMB took advantage of New York’s vast number of local businesses.

5) Good team balance was essential.  Those teams with naturally social members kicked customer development butt.  People were making phone calls to business owners across the country, setting up Craigslist ads, conducting surveys, interviewing by telephone and pounding the pavement for person-to-person discussions.  There was more combined customer development in one weekend than most startups do in a year!

6) Customer Development is hard.  Several assumptions were crushed over the weekend and for the more brutal failings, there were no easy follow on steps.  It’s one thing for a market segment to fail, it’s another when a core idea is roundly  rejected.  But it happened.   It’s easy to become demoralized by negative validation, but the teams pressed on.

7) We saw some amazing pivots, product mockups that reflected the changes, and then customer validation of the pivots!  That’s pretty amazing for a weekend’s work.

8 ) Some people had a tough time understanding the difference between seeking evidence for their idea and testing their assumptions.

9) This event has great potential.  There were some rough spots, but no major problems and the learning that went on was tremendous.

10) It will be interesting to hear more feedback, but my general impression is that this was the first real encounter with customer development for most of the participants and that the experience they gained was invaluable.  My belief is that to truly grok customer development, you must “get a win;” meaning you need to experience first hand the empowerment that comes from customer validated ideas.  I think we had a lot of that!

If there’s something in particular you’d like to hear more about the weekend, please let me know in comments.

Comments (1)

By Patrick Vlaskovits, April 29, 2010 1:11 pm

Brant and I have finally finished our book, The Entrepreneur’s Guide to Customer Development:  A cheat sheet to The Four Steps to the Epiphany, within which we have included interviews from successful entrepreneurs in order see if their startup experiences mesh well with Brant’s and my interpretation of and experiences with Customer Development.  (I won’t beat around the bush, while our interviewees may not have called it Customer Development per se, they certainly practiced elements of what Steve Blank has codified as Customer Development in almost all but name.  And without exception, they applied fierce and relentless skepticism to all aspects of their businesses.)

We’ve had the pleasure of speaking with Jeff Smith (Smule), Fabrice Grinda (Zyngy, OLX), Ranjith Kumaran (YouSendIt), and Bruce Moeller (DriveCam).  We’ve condensed their experiences into case studies which are featured in the book.  However, there was so much great material, we simply could not include all of it.  Therefore, I’d like to take this opportunity to share an insight that came out of our interview with Bruce that we found quite edifying, one that goes to the heart of the Customer Development methodologies.

Background:  DriveCam uses video technology, expert analysis and driver coaching to reduce claims costs and saves lives by improving the way people drive.  From the DriveCam website:

DriveCam’s palm-sized, exception based video event recorder is mounted on the windshield behind the rearview mirror and captures sights and sounds inside and outside the vehicle. Exceptional forces such as hard braking, swerving, collision, etc. cause the recorder to save critical seconds of audio and video footage immediately before and after the triggered event.

[Emphasis mine.]

Bruce shared an interesting story about how assumptions made in the lab, based on data and “sophisticated” math undertaken by “sophisticated” analysts, fared in the real world of cement mixer trucks.  Remember, the DriveCam device’s core feature is to record audio and video when triggered by exceptional forces such as swerving.  When DriveCam went after the cement mixer truck market, they calibrated their devices based on the assumption that cement mixers would flip only if subject to a large sideways g force.

Seems reasonable, right?  After all, cement mixers are big, heavy trucks, and not to mention, filled with, well, the eponymous cement.

Turns out, not so reasonable after all.

Bruce recounted that when one of their first customer’s cement mixer trucks flipped over, the DriveCam device had failed to record what had occurred and what may have caused the accident — the customer was irate and Bruce was more than a little embarrassed.

Turns out that (outside of the lab!) cement mixers trucks can flip at very low speeds (1-2 mph) while at normal g forces when encountering things in the chaos of the real world, very ordinary and common things such as soft road shoulders.  Bruce’s customer knew this and was counting on Bruce and the DriveCam team to know this as well.

Lesson learned:

“My philosophy is you don’t know what you don’t know and if you were ever right in a given moment, and if your guesses were ever true it would be serendipitous.  You must attack your assumptions at all times. My basic tenet: question yourself, because the world is ever-changing.”

-Bruce Moeller

For more insights that speak directly to the Customer Development processes, please purchase The Entrepreneur’s Guide to Customer Development:  A cheat sheet to The Four Steps to the Epiphany.

Comments (4)

By brantcooper, February 3, 2010 12:10 pm

Because of the overwhelming response and great feedback for the the Customer Development image I recently shared, I decided to share another from our upcoming book. Please let me know what you think.

Figure 2. My interpretation of Ries' Lean Startup: Customer and product development interrelatedness

*CPS = Customer-Problem-Solution

As shown in Figure 2, customer development and product development are two distinct, but interrelated and iterative processes. As Eric Ries describes, the Customer Development team works on testing the problem-customer-solution assumptions, while the Product Development team tackles the solution.  The product development process receives input from customers indirectly through customer development, and (in the web world) directly through measurement of product usage.  The product development process actively iterates on the product, releasing new or different functionality directly to the customer as quickly as possible.

The customer development process receives input from customers indirectly through product development reports on feature usage, but also directly from customer development processes and analytics.  The customer development process iterates on core business assumptions, product functionality, and acquisition and conversion assumptions, resulting in updated hypotheses, honed messaging, positioning, marketing tactics, and feature requirements.

In the Customer Discovery context, a lean startup is not one that necessarily uses lean manufacturing precepts per se, but rather one that uses fast, iterative development practices in conjunction with customer development methodologies in order to:

1)       Validate core hypotheses (customer-problem-solution),

2)       Produce an MVP,

3)       Achieve Product-Market fit,

4)       Produce a development and marketing roadmap for scaling.

Creating a proper iteration loop requires you to predefine success and failure for each stage, and a means to measure your progress.  For example, in the web-based world, Dave McClure’s AARRR metrics (Acquisition, Activation, Retention, Referral, Revenue) might be applied to measure the stages from concept to product-market fit.

(BTW, if you are interested in being notified when the book is published, sign up here.)

Comments (13)

By Patrick Vlaskovits, January 3, 2010 9:12 am

Success and Cognitive Bias

One thing that often strikes me about conversations regarding start-up success is the pervasiveness of the narrative fallacy and hindsight bias.

We can go to Wikipedia’s entry on Taleb for a definition:

Narrative fallacy: creating a story post-hoc so that an event will seem to have an identifiable cause.

Allow me to illustrate.  What caused YouTube to grow at phenomenal rates in 2005/2006, eventually leading to a $1.65 billion acquisition by Google in 2006?

Was the cause:
Continue reading 'Cognitive Biases, Positive Black Swan Events and Startups'»