The Enterprise Growth Playbook
The Enterprise Growth Playbook
THE ENTERPRISE
PLAYBOOK
How to build a high-performing
Growth Team in a large enterprise
/andyfboyd
THE ENTERPRISE GROWTH PLAYBOOK
2
/andyfboyd
THE ENTERPRISE GROWTH PLAYBOOK
OVERVIEW...........................................................78
FOCUS ON THE ENTIRE SYSTEM.................................... 15 ADD EXPERIMENT TASKS AS PART OF YOUR SPRINT............. 94
CONCLUSION........................................................ 128
CHAPTER 4: PREREQUISITES..............................................46
GETTING STARTED........................................................ 66
A
re you looking to build a growth team and do not know where to
start? Look no further. This is the enterprise growth playbook,
developed through experiences building growth teams in small
and large enterprises. This includes building my own teams, participating in
established teams, and helping to launch many internal growth teams.
First, a bit of background on me. Over the course of my career, I’ve used
growth tactics against a target KPI to see consistent strong double-digit
improvements and many cases of high triple digit gains. I have spent half of
my career in small companies both in digital marketing as well as product
management – mostly focused on launching and scaling new products.
The latter half of my career has been spent in IBM. After helping to bring
IBM Watson to market, I built the growth team in IBM Watson, which
became a model for other growth teams in IBM. In a corporate function,
we took my model and established multiple “growth squads” within various
parts of IBM. I later moved into the Cloud unit where I have focused on
growth at the portfolio and product level.
To be fair, I didn’t create all these teams. Some I created, some I didn’t.
Not all the growth teams succeeded. We failed in some cases, but we
saw tremendous success in many others. I learned a lot of lessons
along the way. I will share these lessons to help you establish a high-
performing growth team.
6
INTRODUCTION THE ENTERPRISE GROWTH PLAYBOOK
Now, back to Growth. People often think that “Growth” is a silver bullet, as
with the “Get Your Free Email at Hotmail” example or the Dropbox referral
program, that catapults a product/business to success. These tactics were
effective and generated amazing results, but I do not have any of these
examples, personally. While perhaps not as creative, my results have been
significant and consistent in their own right and that has everything to do
with having the proper cross-functional team, a good growth process, and
have a growth culture. You can experience results like this too.
Disclaimer: The thoughts and opinions in this e-book are my own and
don’t necessarily represent IBM’s positions, strategies or opinions .
7
CHAPTER 1:
THE JOB OF
GROWTH
CHAPTER1: THE JOB OF GROWTH THE ENTERPRISE GROWTH PLAYBOOK
G
rowth is a relatively new role in larger companies. But what is
it? In simple terms, the growth team is focused on growing the
business using a cross-functional, agile team and data-driven
decision-making. The primary outcome should be to accelerate growth
of the business defined by some key KPI such as users, revenue, usage/
adoption, and retention; however, the growth team provides other
benefits as well. Your growth team can provide three critical functions
for your product portfolio:
9
CHAPTER1: THE JOB OF GROWTH THE ENTERPRISE GROWTH PLAYBOOK
While the growth team should have deep expertise in the numbers of
your business and what levers will move them the best, it is critical
to note that they are not a reporting function. Relying on the growth
team for reporting is a mistake. The growth team knows the numbers
inside and out and how to move those numbers. Bogging them down
with reporting will hurt your business. Growth is a business building.
Reporting, on the other hand, is operational. The reporting/analytics
team will report on the numbers and provide insight but typically are not
involved in improving the numbers directly.
I like to say that a good growth team will get neck-deep in the data
and walk around in it. By this, I mean that they will spend a lot of time
digging into the most critical numbers to understand what is happening
in the business. They will peel the onion layer by layer. More importantly,
once they understand the numbers, they will get to work to improve
those numbers.
Initially, they may make some small wins, they may fail, they may even hit
some home runs. The net effect of all this data-driven experimentation is
that they start to deeply understand what works and what doesn’t. They
will understand what drives the numbers.
10
CHAPTER1: THE JOB OF GROWTH THE ENTERPRISE GROWTH PLAYBOOK
The knowledge about what moves the numbers is when they become a
powerful asset and producing three benefits for the organization:
11
CHAPTER1: THE JOB OF GROWTH THE ENTERPRISE GROWTH PLAYBOOK
Most would argue that a growth team is not responsible for product market
fit. Product market fit should be the role of the Product Management
function. I agree with this, but I also believe that the growth team cannot
function if there is no product market fit. You cannot grow and scale a
business that is fundamentally broken. Before the growth team can really
get to work, there must be some validation that there is product market fit.
12
CHAPTER 2:
TENETS OF GROWTH
- WHERE GROWTH
WORKS BEST
CHAPTER 2: TENETS OF GROWTH - WHERE GROWTH WORKS BEST THE ENTERPRISE GROWTH PLAYBOOK
I
f you asked professionals, “What is a growth team?” most would have
no clue. From the enlightened, you would most likely hear a multitude of
answers that center around marketing and A/B testing. Marketing and
A/B testing are certainly important components of building a strong growth
team; however, it’s only one part of what makes a growth team successful.
A good growth team will do much more than marketing, a good growth
team will work across the entire business but not all at once, mind you. A
good growth team will look for areas of opportunity and inefficiency across
the entire business that they can capitalize upon to accelerate growth. As a
growth leader, you must think about the customer experience as an entire
system that you can exploit.
CONFIGURE
CONTINUE
VISIT VIEW CREATE AND SETUP USE CONVERT
USING /
WEBSITE REGISTRATION ACCOUNT PRODUCT PRODUCT TO PAID
SPENDING
(OPTIONAL)
SALES CUSTOMER
PROCESS SUCCESS
PROCESS
14
CHAPTER 2: TENETS OF GROWTH - WHERE GROWTH WORKS BEST THE ENTERPRISE GROWTH PLAYBOOK
With this as our construct, we’ll break down some of the core tenets upon
which you must build your growth team to make it more effective.
CONFIGURE
CONTINUE
VISIT VIEW CREATE AND SETUP USE CONVERT
USING /
WEBSITE REGISTRATION ACCOUNT PRODUCT PRODUCT TO PAID
SPENDING
(OPTIONAL)
SALES CUSTOMER
PROCESS SUCCESS
PROCESS
15
CHAPTER 2: TENETS OF GROWTH - WHERE GROWTH WORKS BEST THE ENTERPRISE GROWTH PLAYBOOK
16
CHAPTER 2: TENETS OF GROWTH - WHERE GROWTH WORKS BEST THE ENTERPRISE GROWTH PLAYBOOK
The number of paying customers would look like this over 5 years:
700
600
500
400
300
200
100
0
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61
Imagine you could improve the “view registration page conversion rate” by
25%. With this improvement, the number of paying customers would grow
to look like this over 5 years:
17
CHAPTER 2: TENETS OF GROWTH - WHERE GROWTH WORKS BEST THE ENTERPRISE GROWTH PLAYBOOK
This is a strong improvement, and I’m sure your boss would be quite
pleased with the progress; however, imagine if you could improve a few of
these levers across the system.
IImagine you improve the “view registration page conversion rate” by 25%,
the paid conversion rate 25%, and the retention rate 25%. You can see the
growth curve is much better:
18
CHAPTER 2: TENETS OF GROWTH - WHERE GROWTH WORKS BEST THE ENTERPRISE GROWTH PLAYBOOK
LIGHTWEIGHT (CONTINUOUS
IMPROVEMENT) PROCESS
When I share some of the results my growth teams have achieved, people
are intrigued and they typically ask, “What is the secret?”. People expect
that I will share an extremely interesting experiment such as the “Get Your
Free Email at Hotmail” example. These tactics were incredibly effective, but
I do not have any of these examples. The answer I give is “process.”
IIn fact, you would be quite bored if I was to describe to you most of the
tactics we employed. The real secret is a simple process that facilitates
continuous improvement. In my experience, a simple weekly process gets
your team focused on constantly improving. Success then comes over time
through constant, systematic small wins. To borrow a baseball analogy, a lot
of singles and a few doubles, triples, and maybe a home run.
19
CHAPTER 2: TENETS OF GROWTH - WHERE GROWTH WORKS BEST THE ENTERPRISE GROWTH PLAYBOOK
To illustrate the point, imagine you are confronted with two possibilities:
Now, you may have already seen this math - so, if you have, then my
apologies. For those of you who have not, the answer is that you want to
get 1% better every day. At the end of the year, you would be 37x better
from where you started vs the 10x in one shot. I won’t cover the process in
this section, but rest assured it is focused on consistent improvement. It
is also lightweight and flexible, which allows teams to make changes and
adjust quickly based on learning.
20
CHAPTER 2: TENETS OF GROWTH - WHERE GROWTH WORKS BEST THE ENTERPRISE GROWTH PLAYBOOK
WORK ACROSS
FUNCTIONAL BOUNDARIES
For starters, you miss out on a lot of opportunities by not bringing cross-
functional skills across silos. Secondarily, because of the power of
compounding, you must have the ability to work all the touchpoints to
improve the entire system, and you need your peers in all functions to help.
CONFIGURE
CONTINUE
VISIT VIEW CREATE AND SETUP USE CONVERT
USING /
WEBSITE REGISTRATION ACCOUNT PRODUCT PRODUCT TO PAID
SPENDING
(OPTIONAL)
21
CHAPTER 2: TENETS OF GROWTH - WHERE GROWTH WORKS BEST THE ENTERPRISE GROWTH PLAYBOOK
CONFIGURE
CONTINUE
VISIT VIEW CREATE AND SETUP USE CONVERT
USING /
WEBSITE REGISTRATION ACCOUNT PRODUCT PRODUCT TO PAID
SPENDING
(OPTIONAL)
22
CHAPTER 2: TENETS OF GROWTH - WHERE GROWTH WORKS BEST THE ENTERPRISE GROWTH PLAYBOOK
I’ve also seen examples where a product manager/engineer has been able
to dramatically improve the results from a marketing demo by a adding
deeper understanding of the customer needs/benefits on a feature.
23
CHAPTER 3:
GROWTH LEADERS -
CREATE A GROWTH
CULTURE
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
I
t is an expected norm that new, smaller, entrepreneurial companies
are more inclined towards a working growth mindset - everyone wants
to “act like a startup.” This norm is not because large companies
are not fast or smart. In my large company experience, I’ve seen teams
repeatedly achieve the impossible and deliver a project with amazing
speed. Similarly, I’ve worked with the most brilliant minds in the world.
A big part of the reason that large companies struggle with something
new, like a growth team, is because the systems, processes, and
cultures are designed and optimized around a different way of doing
business. Growth, as a newer set of skills, was not around twenty years
ago. What is more, as companies grow, they build silos where teams
become distributed and form microcultures. These are the things that
make it difficult to operate more nimbly.
As previously noted, I have come to believe that the process and culture
are perhaps most important. We will focus on the process, but you must
also work to establish the proper culture. Your job is to create a culture
that fosters cross-functional work that is aligned on a common metric,
which rewards learning. It must also allow a process that enables iteration
vs too much planning.
25
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
We will cover each of these in more detail but this is your cheat sheet:
• Velocity goal for experimentation • No capacity for experimentation • Velocity – OM, Marketing and Engineering leadership, commit to a
target number of experiments per month
• Deep collaboration between functions • “Protect my turf” – working in silos, throwing • Collaboration – Product Management, Marketing, (optional) Sales
work over the wall and Engineering team attend sprint meetings and daily scrum
• Accountability – Product Management, Marketing and Engineering
leadership attend “end of sprint” readouts on results
• Empowered team • A heavy process, with too many approvals • Cross-functional team design/launch experiments - Marketing,
Product Management, (optional) Sales and Engineering are
empowered to work together at the level of execution to decide,
design and launch experiments, should not require multiple
approvals
• Transparent, open conversations about what is • only reporting positive results, hiding details • Reward learning and action – reward the team for acting. Celebrate
working vs what is not. of failed experiments, a “failed” experiment if the team learned or has a new hypothesis
and is taking the correct next action. Don’t accept “it failed, and we
don’t know why”.
• Consistent incremental progress • Too many big bets • The right mix of big bets and incremental gains. Have a focus on
small improvements daily which will compound to larger gains.
Celebrate “small” wins.
• Data for decision-making, not perfect data • Spending too much time trying to get • Decision-making vs perfect data - focus the team on making
“perfect data” decisions to improve adoption/retention, not “perfect data”.
Whether you are in a large or small company, data and metrics drive your
actions. As a company grows, and the silos start to form, it is inevitable that
we will select different metrics that we will own and/or drive. If your executive
team is smart-enough to align your metrics, then count yourself lucky. All too
often we are governed by metrics that do not necessarily align outcomes.
26
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
For example, the marketing team may have a pipeline target. The product
manager is responsible for an overall revenue number. The sales team is
responsible for new MRR per month. In theory, these numbers align, but the
reality is that they don’t always align.
27
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
Teams take local action in their role to achieve their number, but it loses
efficiency because the other teams are not wholly focused on this same
number. If the strategic objective is to grow the “next generation” product,
then the metrics for the team, or a subset of the team, should align around
the adoption objective for the next generation product.
Now, I 100% advocate aligning metrics like the example above; however, if
possible, the most effective growth teams I’ve been a part of have aligned
around the same number.
28
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
For example:
When we aligned the team around the same metric, everything snapped
into place and improvements started to compound upon one another. In
the marketing example, the product and marketing teams teamed together
under the mantra of “you bring them to the funnel, we’ll bring them through
the funnel.” Our actions would compound upon one another. This resulted in
doubling our trial metric in only two months.
So, the question is, what do you do? Executive leadership (top-down) and
functional leaders (bottom-up) align around a single focus metric. This
will get the team focused and eliminate the subtleties in differences in
measurements. Note, the single focus doesn’t have to be forever but pick an
area to focus on for a specific timeframe.
As the team becomes more cohesive, you can expand to select other targets.
Finally, build executive accountability around that metric such as regular
reporting: cross-functional where the executive leader and functional leader
are looking at the results and the actions to drive that number.
29
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
30
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
If you are only making monthly releases, you are effectively only learning
every two months because you need at least 3 dots to see a trend. If you
release weekly, you learn something new every 2 weeks. The team who
releases weekly will complete 4 learning cycles in the same amount of time
that the “monthly” team completes one cycle.
Now, imagine how quickly you can learn if you release daily. Of course, some
experiments take longer than 1 week to run, nevertheless, the guidance
holds. The more releases/experiments you run, the more quickly you can
learn. In this day in age, you cannot afford to learn slowly, particularly in the
technology industry.
31
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
DEEP COLLABORATION
BETWEEN FUNCTIONS
Product Management:
Define the product
Design
Design the product
Development
Build the product
Marketing
Market the product
Sales
Sell the product
32
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
Or, perhaps, the marketing team crafts their messaging without the benefit of
the input from sales who has had a myriad of customer conversations. In this
regard, the sales team can help the marketing team develop messaging that
has already been “field tested.”
PRODUCT PRODUCT
MANAGEMENT MANAGEMENT
(ACCOUNTABLE) (RESPONSIBLE)
33
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
EMPOWERED TEAM
34
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
Whatever the case for your team, push the decision-making authority down to
the growth team, which removes the layers of approvals. In some cases, you
need proper approval processes so you will need to ensure your processes
have the appropriate level of granularity. Do not let all decisions get hung-
up in a process. Provide proper guidance for what constitutes a bigger and
non-reversible decision and simple guidance for the team around when the
decision needs to go through it. This allows the team to act quickly where they
can but ensures the right oversight on things that require it.
In some cases, the decisions are not well-contained within the team who is
making the changes. For example, the team is making decisions that affect
a product/experience that is owned by someone else. In this case, I have
a rule, which is “we turn the key together.” The growth team can setup the
changes to get it ready to launch and then ask for “approval” (or, if possible,
just provide an FYI for awareness) to the person who owns that process/
experience. This helps to ensure a good working relationship with the
stakeholders that your growth team must work with.
35
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
Because we care about our personal brand, we sometimes tend to report only
positive outcomes. In simple terms, the world becomes rosier as information
floats to the top while the ugly failures stay down at the front lines. The reality
is that we need both the positives and negatives in order to learn what does
and doesn’t work. The failures are a form of data that you as a leader can use
to make decisions and grow your business.
36
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
There are two simple checks to ensure the classification of a “good” failure:
2. When the team presents the failure, have they taken the time to learn
what caused the failure and are now actively taking the logical
next step?
If the answer to both is “yes,” then the team should be supported in their
efforts and not adversely penalized. If the answer to either is no, then it is truly
a failure and you should hold the team accountable. Failure with no learning
and no next step is truly a failure.
37
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
This means we create a big plan (i.e. roadmap or project) and doggedly
pursue the delivery of that plan. Sometimes this is the right thing to do, but
not always. On the other hand, we can make significant improvements by
focusing on consistent incremental improvement. While the small wins may
not seem like much initially, the magic of the small improvements is that they
can compound over time. This can lead to significant outcomes.
To be clear, you do need large projects, but we should also focus the team on
consistent, small improvements daily which can compound to larger gains.
38
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
In many cases, the data we want is imperfect: we want more data, the data
isn’t totally accurate, etc. We should get good data where we can; however,
sometimes we can’t get perfect data.
As a leader, your job is to look for trends and make decisions, and in many
cases, the data is good enough for decision-making. To get past the issues
of “perfect data,” understand where the issues are with the data. Focus on
understanding accuracy and reliability.
Your job as a leader is to simply understand the sources of bias in the data. As
long as it is generally reliable, you should feel empowered to make decisions
to keep moving your business forward.
39
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
1. DATA IS IMPERFECT
It can be quite difficult to get good data in some companies. For example,
accounting systems may be complex due to international accounting law.
You may have access and permission issues, and data and systems such as
analytics and sales tools may not all “talk” to each other. Alternatively, it may
be impossible to design a good A/B test because other teams are changing
variables underneath you without your knowledge or ability to control.
Whatever the reason, your data will always have flaws. Fix this where you can
but get comfortable with the fact that the data isn’t perfect – it will likely never
be perfect, there will always be bias.
40
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
Understand where and what the issues are so that you can make decisions
knowing where there may be bias. Waiting for perfect data will only slow
you down.
We have all done it. We have all manipulated data to tell a good story.
Employees are naturally inclined to share the most positive news while
downplaying the negative. Statistical rigor can help minimize this, but it
is not a perfect cure. Unless you do all the analysis yourself, which will
limit your effectiveness as you grow in your career, then you need to
understand that people will naturally share the positive and you may not
always get the negative.
When you view yourself as the decision-maker, you lessen your dependence
on perfect data. This will make you more effective as a leader and, ultimately,
an executive. To do this, you must train yourself on three principles:
41
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
A mentor shared this principle with me, and it entirely changed the way I think
about using data for decision-making. This person, now a CEO, said that
he does not tolerate his team “asking for more data before they can make a
decision.” He asks, “If you get more data, will it change the decision you will
make or only make you more comfortable?”
If people were honest with themselves, nine times out of ten, the answer is,
“Make me more comfortable,” in which case he says to make the decision. In
the cases in which you do need more data, get it. Learn to ask yourself this
simple question and you will find that your decision time increases as well as
your confidence in your own decision-making skills.
120
100
80
60
40
20
42
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
If your data is reliable, it may measure something like 101, 99, 98, 102, 100.
While the data is not exactly accurate, it is reliable.
103
102
101
100
99
98
97
96
1 2 3 4 5
43
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
In simple terms, if you are looking at a small number with low variation, it will
take a long time to confirm (statistically) that the change is, in fact, better or
worse. This can make it difficult to make decisions. It can also limit your ability
to launch new tests.
If a statistical approach is not possible or will take too long, watch the trends
and look for big changes. In many cases, you can look at the data and decide
if it is making a difference. The chart below was a target metric that we were
trying to improve. Regardless of the statistical data, we knew in week one that
it was better, and we did not wait to confirm. We rolled it out straight away.
35
30
25
20
15
10
44
CHAPTER 3: GROWTH LEADERS - CREATE A GROWTH CULTURE THE ENTERPRISE GROWTH PLAYBOOK
I have had countless other cases where we looked at a line and saw
relatively no change. The mistake is to say, “Wait, let us gather more data
and see whether the number improves.” The chart below shows a change
we rolled out. If you squint a bit, it looks a little better. It could also be a
statistical variation.
0.4
0.35
0.3
0.25
0.2
0.15
0.1
0.05
Now, the caveat is that I’m not saying to ignore statistics entirely. If you
can take a rigorous approach promptly, that is a good thing. However, in
many cases, we do not always have that luxury. If you find yourself in that
situation, then feel empowered to decide based on whether the change is
material or not.
45
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
CHAPTER 4:
PREREQUISITES
46
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
A
s we have already covered, you should not build a growth team
if fundamentally you do not have a viable business. You will be
dumping water into a leaking bucket. The growth team should
focus on scale when you have something viable. That being said, you
may not have the luxury of waiting on product / market fit before starting
your growth team. In this case, the growth team can work closely with the
product management function to understand where the issues are and then
address (and validate) them together.
Let us digress into a brief segue into what is product market fit and how to
do some light validation before you start.
Marc Andreesen defined Product market fit in his post, “The Only Thing
That Matters.” Andreesen does not define product market fit as being in
a good market with a product that can satisfy that market. He goes on to
describe when it is and is not happening:
47
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
This book will not go into exhaustive detail on validating product market fit,
but there are two steps you can perform to check for product market fit -
customer conversations and benchmarking. These analyses will help you
walk away with an understanding of whether you have a product that you
can work with or not.
Customer interviews are exactly what they sound like - speaking with the
sales and customer success team or the customer success team finding
out which types of customers you win with and why customers choose
you vs. the competition. Speak with a few new customers and, if you can,
a few “losses” (customers who considered your offering but decided not
to proceed) about the same thing. It will not take many conversations to
understand whether or not you have a viable product / market fit.
48
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
If you have product market fit, similar to Andreesen’s comments, you will
find generally happy customers using your product to solve real problems.
The lost deals will have reasonable explanations. If you do not have it, you
will find dissatisfied customers who are struggling to use your software
in real ways. Losses will find consistent themes around the fundamentals
– not solving a problem, no need for it, does not work as advertised, too
expensive, etc.
For the quantitative types, you can also compare your key conversion marks
with industry metrics. Such as trial conversion rates, paid conversion rates,
and retention rates. While there is always some bias in averages, you should
find that your key KPIs are in the same ballpark of the industry averages.
If the explanation above leaves you feeling dissatisfied, there is another tool
you can use to determine whether you have product market fit. The product
market fit survey created by Sean Ellis is a quantitative tool that enables
you to understand help you understand if early customers consider your
product a must-have. You can read a detailed description of how to use the
survey on the Growth Hackers blog.
49
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
The survey asks a simple question to understand how users would feel if
they could not use the product. Ellis posits that understanding how users
feel if they cannot use the product is a leading indicator of whether there is
a true product market fit. How can you use the tool, it is simple, the survey
is a single question.
## Very disappointed
## Somewhat disappointed
## Not disappointed
The survey should be sent to users who have recent “real usage” of the
product. To describe “real usage”, Ellis uses an example of Uber – the
popular app that matches riders and drivers to provide transportation
between locations for a fee.
50
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
After you’ve sent your survey to users with real usage, the question is
inevitably how to determine whether there is product market fit. Sean
Ellis has benchmarked nearly 100 startups and has found that the magic
number is 40%. According to Ellis, companies that struggle to find growth
typically had less than 40% of users respond “very disappointed” in the
survey, whereas companies with stronger growth potential typically always
exceeded the 40% threshold.
To be effective, there is a small set of tools that your growth team will
require to be efficient. These tools enable a deep understanding of users,
the ability to optimize conversions, and reporting. It is important to note
that all these tools are not mutually exclusive, some of the tools may span
multiple categories. By the way, if you do not have budget, the good news
is that there are a lot of free tools that you can use to get started, such as
Google Analytics and Optimize for example.
51
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
User behavior is at the core of growth. Happy users result in happy and
retained buyers, ergo improve user behavior and improve the business.
However, you cannot improve user behavior if you do not understand it.
There are two broad categories of tools to help you better understand user
behavior: qualitative and quantitative tools.
QUALITATIVE
Qualitative is good old fashioned “talk to users and understand their needs.”
The objective is to understand your customer in a deep way that analytics
simply cannot. For example, understand what customers need, why they
choose you, where they struggle to use your product, and what problems
your product does or does not solve for them.
There are many questions you will want to answer. Talking to customers
and prospects is one of the most valuable things in which you can spend
your time. There is a vast array of materials you can use to learn this such
as Customer Development (Steve Blank), Design Thinking, User Interviews,
etc. If you are fortunate to have a design team with user research skills,
count yourself lucky; however, a good Product Manager should be fluent in
these types of techniques.
52
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
Barring these user interviews, there are also a variety of tools that make this
easier. There are tools such as Full Story, Tea Leaf, and others that record
users’ sessions. Your growth team can (and must) watch these sessions to
understand how users are using your product.
QUANTITATIVE
“Quantitive” is the hard data that we all know and love. While we are all
accustomed to looking at reports such as revenue, web traffic, etc., these
metrics are not to which I am referring. The most important tool is a tool that
enables the ability to do cohort analysis.
Cohort analysis breaks your users into smaller groups for more detailed
analysis. In terms of segments, the sky is the limit. You can segment users
based on any number of things, such as when they become a customer,
campaign codes that brought them to you, amount of annual spend,
people who have/have not used a particular feature, and more. You need
this ability to look at the groups of users who you are affecting based on
your experiments.
53
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
OPTIMIZE CONVERSION
To improve conversion, you’ll need the ability to interject a change into the
user experience / product to (hopefully) positively influence performance.
There are many ways to do this. Typically, the best way is to change the
product itself. This of course takes time and assumes you know what to “fix”
in order to positively change performance. In the absence of knowing the
correct changes and having the time and resources to change the product,
you need tools that allow you to interject and test. There are two basic tools
you’ll want: A/B testing and nurture
You have likely heard of A/B testing because it is a big part of the ability to
optimize conversion. If you are new to the term, an A/B test allows you to
segment groups into two cohorts to compare whether one variation (web
page, product feature, etc.) performs better than the other.
CONTROL VARIATION
Of course, there are other more advanced types of testing such as multi-
variate testing. There are plenty of resources available regarding testing, so
this section will not cover this. The focus of this section is to cover the tools
you need to conduct your testing.
54
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
If all else fails, you can also use the “poor man’s a/b test.” The poor mans
a/b test is essentially measuring the baseline, making the change, and
measuring whether you improved over the baseline. This is not perfect,
obviously, but you should be able to determine if you are making changes
that are big enough to matter.
While both Optimizely and Google Optimize allow you to see conversion
metrics in the tool itself, the ideal scenario is to integrate the testing tool
with your analytics / BI tool. This will allow you to evaluate the performance
of your variation vs. control against any number of metrics.
55
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
NURTURE
CONFIGURE
CONTINUE
VISIT VIEW CREATE AND SETUP USE CONVERT
USING /
WEBSITE REGISTRATION ACCOUNT PRODUCT PRODUCT TO PAID
SPENDING
(OPTIONAL)
SALES CUSTOMER
PROCESS SUCCESS
PROCESS
56
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
HAPPY PATH
The simple guidance is that you should provide limited (only critical)
information in the happy path via in-app messaging. Critical pieces of
information that will educate and progress. If you cannot simplify the UI,
or provide this in the UI itself as informational bits, then you can use a
variety of techniques:
NEGATIVE PATH
For the negative path, the most effective technique is email. You can use
email to bring people back to the spot you lost them. For example, a user
creates an account but does not configure and use the product. You can
email the user a link to the configure section of your application along
with documentation and a short instructional video. In my experience,
the negative path emails (win-backs and bounce-backs) are the best
mechanism to improve conversion rates by decreasing the drop-off rates.
57
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
The growth team will not only need to understand what is happening with
cohorts of users, but they will also need to understand the overall health
of the business. This may include the full business / product or simply a
target KPI for which they are responsible, such as daily active users, a
conversion rate, etc.
The most common mistake that new teams make is too many metrics and
too many dashboards. This causes a few problems:
Therefore, the most important thing is the ability to condense your key
metrics to a few small leading and lagging indicators, which help you
quickly understand and diagnose health. You should aim to have only a
small set of three to five metrics.
This sounds impossible, right? Well, take, for example, the human body.
The human body is tremendously complex, yet nurses and doctors will
triage the state of a patient in the ER based on a few simple things: pulse,
temperature, blood pressure, oxygen saturation, respiratory rate, and pain.
These few vital signs diagnose the severity of an issue and point doctors
and nurses to where to focus next.
58
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
Similar to the concept of vital signs, you should have a small set of KPIs that
allow you to easily monitor and diagnose where there are problems within
your business and where you need to investigate further. The Pirate Metric
Framework by Dave McClure can help you do this as it is loose enough that
you can apply it to just about any business but rigid enough that it allows
you to measure the key vital signs across the funnel.
ACQUISITION
USER FINDS YOU
ACTIVATION
USES YOUR PRODUCT FOR THE FIRST TIME
RETENTION
CONTINUES USING YOUR PRODUCT
REVENUE
PAYS FOR YOUR PRODUCT
REFERRAL
REFERS OTHERS USERS
As a starting point for your KPIs, pick a metric from each category and start
to monitor and track this with your colleagues. You may make adjustments
and/or add other metrics, but this simple and concise framework will allow
you to escape the trap of too many metrics and dashboards. It will get you
focused on the metrics that really matter.
59
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
Once you have selected your metrics using the framework, I would suggest
you display them (if possible) using the month over month cumulative view.
The month over month view allows you to watch the day-to-day trends and
quickly understand how you are performing in the current month vs. the
previous month. It also allows you to see how you are performing year over
year. At a glance, this tells you whether you are growing or not.
60
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
BUSINESS
INTELLIGENCE
A/B
TESTING
EMAIL /
NURTURE
CRM ...
COHORT ANALYSIS / SEGMENTATION
AI MODELS /
DATA SCIENCE
DATA
This is not a technical architecture but a conceptual view of how the team
can work using the tools. At the data layer, you want information about
users, campaigns, web data, products, and usage of the products.
61
CHAPTER 4: PREREQUISITES THE ENTERPRISE GROWTH PLAYBOOK
Your growth team can segment users to get insights about usage,
conversion, and more. Once you have segmented those users, you can then
target them with tactics like A/B testing, email marketing, and even sending
them different sales and/or customer success campaigns. After you have
conducted an experiment against the cohort, you can use your business
intelligence tools to analyze the results.
If you want to go for extra credit, the data science team can build a pipeline
off to the side enabling them to do similar work, such as segment users,
find insights, and then experiment with various segments/cohorts of users.
EVALUATE TOOLS TO
RESULTS ENGAGE USERS
BUSINESS
INTELLIGENCE
A/B
TESTING
EMAIL /
NURTURE
CRM ...
UNDERSTAND AND
SEGMENT USERS
COHORT ANALYSIS / SEGMENTATION
AI MODELS /
DATA SCIENCE
DATA
62
CHAPTER 5: THE GROWTH PROCESS THE ENTERPRISE GROWTH PLAYBOOK
CHAPTER 5:
THE GROWTH PROCESS
63
CHAPTER 5: THE GROWTH PROCESS THE ENTERPRISE GROWTH PLAYBOOK
T
he basic idea of the growth process is having a steady stream
of experiments that are going to incrementally improve your
metrics. To do this, you will implement an agile system in which
you create a backlog of experiments, run weekly sprints whereby you
are launching new experiments, tracking active experiments and sharing
learnings through playbacks, and documenting the results.
WEEKLY COORDINATION
Marketing, Dev, Design, Product
REPORT MONTHLY
Metrics and Experiments
EXPERIMENTS
EXPERIMENTS RUNNING
64
CHAPTER 5: THE GROWTH PROCESS THE ENTERPRISE GROWTH PLAYBOOK
AGILE:
65
CHAPTER 5: THE GROWTH PROCESS THE ENTERPRISE GROWTH PLAYBOOK
RETAIN LEARNING:
## Monthly playbacks: what did you learn and what is next for a
broader set of stakeholders.
When you put all these together, you have a fast-acting team that is
constantly learning and improving.
GETTING STARTED
With a firm understanding of the value of a growth team and the general
process, the question is inevitably how to put it into practice. Let us now
turn to get your team organized and running. The process is simple, it
follows an agile methodology of “Sprint 0” to build your backlog and
then continue to iterate.
66
CHAPTER 5: THE GROWTH PROCESS THE ENTERPRISE GROWTH PLAYBOOK
To that end, you’ll need to build your experiment backlog and then establish
an ongoing growth process.
67
CHAPTER 5: THE GROWTH PROCESS THE ENTERPRISE GROWTH PLAYBOOK
68
CHAPTER 5: THE GROWTH PROCESS THE ENTERPRISE GROWTH PLAYBOOK
69
CHAPTER 5: THE GROWTH PROCESS THE ENTERPRISE GROWTH PLAYBOOK
For example, if you are focusing on user acquisition and activation, you will
give them a scenario such as, “You are evaluating products that do [insert
your product focus here]. Your task is to research [your product here] as a
possible option. You will sign up for the product, configure it, and use it for
the first time.” The user will go through the process with minimal prompting
from you or the research team. You will immediately start to see areas that
are strong and areas that need improvement. This will give you a rich set of
qualitative understanding as a basis for your growth work.
The next step is to go through the product and document, visually, the flow
that you are going to improve. This must be a shared resource for the team.
You may say, “We know the product, and we do not need to do this.” Don’t skip
this step. This step is important, particularly in larger organizations, because
people tend to get too far removed from using the actual product. They talk
a lot about the product, the business, and the users but never actually use
it. Watching real users and documenting the product yourself helps to align
everyone around what the user is truly doing with the actual product.
70
CHAPTER 5: THE GROWTH PROCESS THE ENTERPRISE GROWTH PLAYBOOK
When you are done, the output should look something like this
GOOGLE SEARCH WEB PAGE REGISTRATION PAGE ACTIVATE ACCOUNT LOGIN (DASHBOARD)
Signup
offline process
After you have documented the steps of the process you are trying to improve,
the next step is to try to build a funnel to show the drop off at each stage of the
process. A histogram quickly shows the scope of the drop off at each stage,
which will help you to identify where to focus.
1200
1000
800
600
400
200
71
CHAPTER 5: THE GROWTH PROCESS THE ENTERPRISE GROWTH PLAYBOOK
After documenting the process and gathering the data, you will likely
already have a handful of ideas for things you want to do to improve your
metric. Start to lay those ideas over the top of the histogram, it will start
to paint the picture of the ideas that you have and where you can make
the best impact.
1200
800
600
Reduce fields
Improve copy
400
Bounce
back
200 Nurture
72
CHAPTER 5: THE GROWTH PROCESS THE ENTERPRISE GROWTH PLAYBOOK
You will want to log your experiment ideas into a tool such as GitHub,
Trello or Northstar.
## PROBLEM
An insight regarding a problem area based on
qualitative or quantitative data. Example: The 12
## SOLUTION (HYPOTHESIS)
This is what you think will happen. It is best if you can
6
quantify the result, but it can be inefficient to create
an entire business case for each action. Example: If we
remove the phone number field, we can increase the 4
73
CHAPTER 5: THE GROWTH PROCESS THE ENTERPRISE GROWTH PLAYBOOK
## EXPERIMENT
This is the design of the experiment. It is best to list
as many details as possible. Where possible, include
screenshots of the original and variations. Screenshots
help to communicate the change and are more
important for people who revisit the learning later,
well after people have forgotten the exact specifics.
Example: The experiment will show an original with all
form fields. The variation will include all form fields but
will remove the email address field. We will target this
to 20% of the traffic. We will target it to all audiences
because it does not require any type of translation.
## METRIC
This is obviously the metric you want to improve. I
typically suggest building a report or dashboard to
show the metric before you launch the experiment. In
some cases, you may believe that you can measure the
experiment as intended only to find that there are some
nuances which prevent you from measuring it in the
way you intend. If you create the report at the outset,
before you launch the experiment, you will be sure you
can measure it appropriately. If not, you can adjust the
design / metric to ensure you can measure what you
intend to measure.
74
CHAPTER 5: THE GROWTH PROCESS THE ENTERPRISE GROWTH PLAYBOOK
STEP 5: PRIORITIZE
Since you cannot tackle all these ideas at the same time, the next step is
to prioritize. Group your ideas against the dimension of low to high impact.
The impact is measured by the ability to improve the key metric. Then shift
them around based on easy and hard to execute with the keys here being
time, resources and complexity. The easier tasks are obviously simple, fast,
and have resources, whereas the harder tasks are some combination of
complex, time-consuming, and may or may not have resources to complete.
Before you check this step off, agree on the experiments that you intend to
launch as part of your first sprint.
PRIORITIZATION GRID
RETARGETING CAMPAIGN
HARD TO EXECUTE
75
CHAPTER 6: THE GROWTH JAM THE ENTERPRISE GROWTH PLAYBOOK
CHAPTER 6:
THE GROWTH JAM
76
CHAPTER 6: THE GROWTH JAM THE ENTERPRISE GROWTH PLAYBOOK
T
he getting started process outlined earlier is good for teams who
are starting fresh; however, it’s not always practical to start fresh.
In some cases, you are working within an established team and you
need another mechanism to generate new ideas to spur growth – whether it
be holistic growth or a focused objective.
The process to use in this case is the Growth Jam. The Growth Jam is a one
or two hours focused brainstorming session which will generate an idea
backlog and prioritize the top ideas generated in the session. What is more,
the Growth Jam is fun for everyone who participates. Sometimes we spend
too much time in the day-to-day and do not get enough time to focus on
growing the business.
77
CHAPTER 6: THE GROWTH JAM THE ENTERPRISE GROWTH PLAYBOOK
OVERVIEW
Running the session is easy. There are three main parts to cover: framing,
agenda, and the brainstorm session modules. Below is a high-level
template, each will be described in further detail.
78
CHAPTER 6: THE GROWTH JAM THE ENTERPRISE GROWTH PLAYBOOK
FRAMING
Framing the Growth Jam should be done in advance of the meeting, and it
is perhaps the most important part of the entire exercise. In the framing, you
will want to set an extremely targeted objective, include the target KPI you
are trying to improve as well as the time frame in which you want to improve
it. A common mistake in brainstorming is that people do not consider the
boundaries of what they can or cannot achieve; therefore, you will also
include within which parameters your work will need to be constrained.
Finally, as a growth leader, you should have a good view of many of the
opportunities that some of your peers operating in different silos may not
see. To start the brainstorming, give them a list of some of the assets and
resources that the team can leverage in pursuit of executing the ideas.
It is important to note that people will come up with ideas that are outside
of the boundaries of the frame, which is acceptable; however, during the
voting session, which will be covered shortly, you will want to direct people
to vote on the ideas that meet the targeted objective within the constraints
you have provided.
79
CHAPTER 6: THE GROWTH JAM THE ENTERPRISE GROWTH PLAYBOOK
AGENDA
The first half of the meeting is focused on brainstorming (diverge), and the
second half is focused on refining the focus and solutioning (converge).
During the first half, your job as a facilitator is to get the ideas on the table
which is done silently. If participants start to present ideas, kindly advise
them that you are not yet “problem-solving,” and that the team is simply
generating ideas and solutioning will follow later in the session.
80
CHAPTER 6: THE GROWTH JAM THE ENTERPRISE GROWTH PLAYBOOK
During the second half of the session, your job is to get buy-in on the top
ideas and then start to refine the idea – getting the key issues, blockers,
and details on the table. You will likely not solve the entire idea in this one
session. You are simply priming the pump as the smaller squads’ form
around each (top) idea.
There are two sample agendas below: a one-hour and a two-hour agenda.
As the facilitator, you can adjust the duration of the meeting based on the
amount of time available and the amount of discussion you want to have.
More discussion is helpful in the brainstorming and refining the details. It is
possible to run the session in one hour, but the best sessions are typically
at least ninety minutes. This allows for good discussion, but it is not so long
that the team loses patience.
81
CHAPTER 6: THE GROWTH JAM THE ENTERPRISE GROWTH PLAYBOOK
FACILITATION
To run an effective Growth Jam, you must allow some time for pre-work.
This is important in the creative process; however, during the session, there
are three main sections of the collaboration document:
1. Ideas - brainstorm
PRE-WORK
Therefore, prepare the Growth Jam framing and agenda and a virtual
collaboration space in advance. We typically use a Box note or a Google
Doc for collaboration. Send the agenda at least 24 hours in advance, if
not 48 hours, and ask the team to start documenting their ideas before
the meeting in the collaboration space. You will give them instructions on
the framing and then the “template,” (to be described later in this section)
direct them where to post their ideas in advance. Some of the participants
will not document ideas until the meeting, which is to be expected, so you
will allow for some silent brainstorming time.
82
CHAPTER 6: THE GROWTH JAM THE ENTERPRISE GROWTH PLAYBOOK
IDEAS
The Ideas part of the Growth Jam is focused on generating ideas and then
voting as a team to filter up the top ideas.
GENERATING IDEAS
You will direct participants to write their idea in a simple template (below).
Most of the elements are straight-forward, but the two most-important items
are the “time to implement” and “revenue size estimate.” Note, revenue may
not be the objective, in which case this is the impact on the target KPI.
83
CHAPTER 6: THE GROWTH JAM THE ENTERPRISE GROWTH PLAYBOOK
For both of these items, focus on rough sizing. This will help them think
through the impact, with some simple numbers, as well as the difficulty
in execution. These are not hard estimates or a business case. Think
of a t-shirt size or Fibonacci number for agile estimation - the goal is to
quantify the idea against impact and execution, which will help during the
voting process.
DISCUSSION OF IDEAS
When everyone is done listing their ideas, the participants should have
some time to read through all the ideas that have been generated. Inevitably
there will be questions about ideas in the list. Allow participants to ask
questions to help clarify the description and the logic around the sizing.
Note, this is not a time for solutioning. The discussion should be focused
on clarification. As the facilitator, you will find that participants will jump to
solutioning. Redirect the focus back to clarification or move on to another
question if the team goes too far into the details on one particular topic.
84
CHAPTER 6: THE GROWTH JAM THE ENTERPRISE GROWTH PLAYBOOK
TOP IDEAS
The “Top Ideas” section covers two main topics: voting the best ideas up
(filter-up), and agreement/disagreement with the selections (filter-down).
VOTING
During the voting section, direct the team to cast votes on their top ideas
with each participant only receiving three votes, or whichever number is
appropriate. Before they cast their votes, remind them to vote on the ideas
that best-satisfy the objective while considering the constraints. They
should not arbitrarily vote for the idea that they think is “the coolest idea.”
This part of the session should also be done in silence and anonymously, if
possible. Similar to brainstorming, this helps minimize groupthink and voting
for the idea from “the highest-ranking employee” in the room.
When everyone is done casting their votes, count-up the totals and select
the top three ideas, or whichever number of ideas you have the capacity to
execute. Move these into a separate section of the document so that the
team can focus the remainder of the session on these ideas.
FILTER-DOWN
85
CHAPTER 6: THE GROWTH JAM THE ENTERPRISE GROWTH PLAYBOOK
IMPLEMENTATION
The other benefit is practical in that you have all the key stakeholders “in a
room together” (virtual or physical). All too often, after the brainstorming is
finished, people instinctively go back to problem solving within their silos.
This slows down execution because information does not flow freely. You
may also find decision-making is slowed. Refining the start of the plan
together allows a cross-functional discussion of the issues as well as fast
decision-making across silos.
86
CHAPTER 6: THE GROWTH JAM THE ENTERPRISE GROWTH PLAYBOOK
## Tentative timeframe
87
CHAPTER 6: THE GROWTH JAM THE ENTERPRISE GROWTH PLAYBOOK
Oh, and by the way, when you get to the “important details” section, this
is the place where the team can finally start to criticize and solution ideas,
so let them at it. They have been dying to get to this part.
Finally, after refining the ideas, close the session and agree on a
timeframe for when the team will get back together to review a final plan.
If that is not necessary then decide on a timeframe for when the team
will have the target launch date decided. A completed idea may look
something like the following:
88
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
CHAPTER 7:
KEEP IT MOVING -
THE ONGOING AGILE
PROCESS
89
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
W
ith your backlog now created, the goal is to launch your
experiments and then begin the iterative, agile process to keep
improving your metrics. Assuming you are working with part
of an established marketing and product team, you will need to integrate
your growth process into the established process. Pause before you jump
into sprint one because there are a few simple changes to make to your
existing agile process.
90
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
If you are new to Agile, you should take some time to read about the
methodology to understand the principles and processes. This e-book will
not go into great depth to describe Agile but will offer a brief primer.
The basic tenets which apply to the growth process in this e-book
are as follows:
91
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
The basic method of organizing your Agile sprint follows a process like this:
92
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
The preceding section loosely describes a sprint cycle. Your agile team will
continue to loop through this process: prioritize the backlog, launch the
experiments in the backlog during a sprint cycle, then repeat the process.
Finally, there are a series of agile ceremonies that govern the sprint process
to enable your team to continuously deliver work. While this is not an
exhaustive list, the most basic set of ceremonies are:
## Sprint planning: before the start of the sprint, the team will
prioritize the backlog and define the work that will be completed
during the sprint.
## Daily Standup: daily, the team will meet together to discuss the
work in progress. This is not a detailed status update, the team
members will discuss: what did I complete yesterday, what
will I work on today, is there anything that is blocking me from
completing my task(s).
93
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
ADD EXPERIMENT
TASKS AS PART OF YOUR SPRINT
Assuming you are working within an Agile construct, you likely have tasks
for your different functions such as development tasks and/or design tasks.
The first change is to add experiments as part of your sprint, which has
two facets: creating experiment cards and then adding them to your
existing sprint.
94
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
## TITLE
Create a simple title for the experiment
o E.g. “Bounce back nurture”
## INSIGHT
the insight from quantitative or qualitative (user research) that you
have observed.
o E.g. “We have seen that 20% of users drop off after
the account creation and never return to login to use
the product”
## HYPOTHESIS
based on the insight, the behavior or metric you want to change
based on the insight.
o E.g. “We can reduce the drop off between account
creation to login from 20% to 10% by sending an email
with how to get started content and login link to users
who have created an account but never logged in.”
95
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
## EXPERIMENT DESIGN
the basic framing of the experiment
o E.g. “We will send an email, targeting users who created
an account but haven’t logged in after 48 hours.
The target will be English-only, based on the
web browser setting.
o Note: where possible, include screenshots or a visual
representation of the experiment
## TARGET METRIC
the metric you wish to improve
o E.g. The conversion rate from account
creation to login
o Note: If possible, build the report and include a link to
the dashboard / report before you launch the
experiment. In some cases, you may not be able to
easily report upon the metric you wish to influence;
therefore, building the report before you launch the
experiment will guarantee that you can measure the
change from the experiment.
96
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
Now that you have created one, or multiple experiment tasks, you will add
experiment tasks in your sprint along with your development and design
tasks. This ensures you have visibility on the experiments the growth team
is working on. It also integrates it into the development flow. You will likely
need design and development resources to implement your experiments.
97
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
98
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
The tasks here are experiments that are live, gathering data. There are a
few benefits for this:
## It helps remind you that you launched the experiment, you are
gathering data, and you will need to analyze it before closing it
out. It is easy to fall into the trap of saying, “We will run a test,” and
launch it and move on without having the rigor to analyze the result,
which is where the learning truly happens in the test.
99
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
People often make the mistake of keeping what they have learned to
themselves. In the best case, what has been learned lives on in tribal
knowledge. In the worst case, the person leaves the role and the learning is
lost. You do not want this; you want to retain the learning so that everyone
can benefit from it whether or not they conducted the experiment.
## Share the learning with the team: As part of your agile process, you
likely have playbacks to demo the work that was completed in a
sprint. After the experiment is completed and analyzed, the growth
team should “playback” the experiment results, whether positive or
negative, to the entire team during the sprint in which the analysis
was conducted.
100
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
101
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
With your backlog created, and the agile process adjusted, you
are now ready for sprint one. As you move through your sprints,
your growth team will be focused on four basic tasks:
LAUNCH
MONITOR
In sprint one, you may not have any live experiments yet; however, as you
move into your next sprints you will have experiments live. With your live
experiments, you should go through, monitor, and review the results of the
experiments to see how they are progressing.
You are looking to see whether they are complete (enough data to decide
whether or not the experiment was a success), or if they need to continue
to gather data.
102
CHAPTER 7: KEEP IT MOVING - THE ONGOING AGILE PROCESS THE ENTERPRISE GROWTH PLAYBOOK
PLAN
Based on what you are learning with your active experiments, or through
an ad-hoc analysis of user behavior, you will start to draft and plan the
next experiments that will fill the icebox and backlog in the coming sprints.
Inevitably, you will need to prioritize the experiments you will launch, but
throughout the sprints, you and your team will generate new ideas.
PLAYBACK
REPEAT
You will repeat the plan, launch, monitor, and playback for all of your
subsequent growth sprints.
103
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
CHAPTER 8:
TOOLS - EXPERIMENTS
BY GROWTHHACKERS
104
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
T
he process discussed in Chapter 7, “The Ongoing Agile Process”,
makes no assumptions about the specific tools and systems
that your growth team uses to manage day to day activity and
collaboration. If you can select a new tool to manage your growth process
then consider using Experiments.
SETUP OBJECTIVES
A growth team is typically charged with improving one KPI or a small set of
KPIs. Creating a three-layer-cadence of KPIs that gives you both the focus
but also the flexibility to act upon where the biggest opportunity lies. The
layers are: North Star Metric > Objectives > Ideas.
105
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
One of the many benefits of Experiments is that you can add your team’s
objective(s), KPI(s), directly into the tool. Before really getting started with
Experiments, take the time to add your objectives into the tool. This will
serve as the foundation for all of the ideas and experiments, not to mention
the process, that your growth team will work upon. In the image below, you
can see that the team has defined three common objectives.
106
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
After objectives have been defined, you can map all ideas and experiments
against that objective. As a growth leader, you can look at the specific
objective to quickly understand the ideas, active experiments, and learnings
against that target objective. In addition, if you track the improvements, you
can track the progress against improving the KPI. In this regard, you can see
the longitudinal impact of your efforts which is the true power of growth.
107
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
GROWTH IDEAS
Now that you have defined your objectives, the next step is to start to
generate ideas on how to achieve your objectives. New growth teams
often struggle with how and where to start. If you need help generating
ideas, chapters 5 and 6 describe two processes that will help you
generate your idea backlog.
108
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
If you happen to find an idea that you like, you can easily import it into your
project by either selecting the individual idea or multiple ideas. The ideas
will then show up in the ideas section of your project.
109
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
EXPERIMENT CARDS
Now, with a backlog full of ideas, you have a new problem, how to
organize your ideas. Experiments provides a mechanism for this in the
Ideas section; however, before we jump to Ideas, let us take a brief segue
into experiment cards. At the most granular level, the experiment card is
the singular idea, it is the collection of experiments that ultimately drive
the process and related improvements.
110
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
Experiments will allow you to define other facets of the experiment, add the
following items which will be useful in managing your process and reporting:
111
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
ICE SCORE
ICE score stands for Impact, Confident, and Ease of Execution. This e-book
will not go into great detail on ICE score, you can read more about ICE at
Growthhackers.com. In short, the ICE score is as follows:
The ICE score allows you to rate the ideas for the purposes of prioritization.
In a small team, the prioritization discussion can be relatively easy;
however, prioritization can be more difficult when there are many ideas to
consider. This tends to happen when working in a larger team with multiple
stakeholders who are submitting ideas. This is where the ICE score can be
particularly helpful.
112
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
OBJECTIVES
You have previously learned about Objectives; Objectives are the higher-
level goal of what you are trying to improve. As described above, growing
the business against a defined set of KPIs is one of the core functions of a
growth team. Your team likely has a primary objective – or, a small set of key
objectives – such as increasing signups, increasing monthly active users,
decreasing retention, etc. Map your experiment to the specific objective
you are trying to affect.
113
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
COMMENTS
Comments are a discussion from the team about the experiment. For
anyone familiar with modern agile tools, the comment function has become
an indispensable mechanism for collaborating “outside of the meeting”. The
growth team can leverage the comment features to ask questions, make
progress, etc on the experiment outside of the meeting – with all the detail
retained for future use.
114
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
A good growth team will likely work with many stakeholders and those
stakeholders will always have their own ideas – or, even if they don’t have
ideas, they would like to contribute to the process. Another benefit of
Experiments is that it allows you to collaborate with your stakeholders’
ideas in two ways:
## Vote on ideas: On each idea card, you will see the “clap” icon. The
clap feature allows anyone to vote for ideas, providing a numerical
score for the most “claps”. If your team and your stakeholders
are voting regularly for ideas, you can then use the clap feature
as a filtering mechanism to bubble the “best” (based on votes,
anyways) ideas to the top of your list of considerations.
115
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
116
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
117
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
## Share the learning with the team: As part of your agile process, you
likely have playbacks to demo the work that was completed in a
sprint. After the experiment is completed and analyzed, the growth
team should “playback” (share) the experiment results, whether
positive or negative, to the entire team during the sprint in which
the analysis was conducted.
118
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
119
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
120
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
GROWTH MEETINGS
121
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
While we have briefly covered the sprint process, we have not discussed
the Growth meeting. If you are following an agile methodology, the Growth
Meeting is your sprint planning meeting. Experiments provides a feature to
manage your growth meetings, aptly named “Growth Meetings”. The growth
meeting should have a basic agenda as follows:
## Active experiments
## Sprint planning
While the agenda topics are quite straight-forward, the remainder of the
chapter will cover how Experiments can help you lead these topics.
122
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
DASHBOARD
123
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
124
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
ACTIVE EXPERIMENTS
Your growth team will always have some set of experiments running. Before
you plan your next tasks, quickly discuss the experiments in the active
queue. This is not a detailed status update, it is a short discussion on what
you are seeing in the data as well as how close the experiments are to
completion – completion in terms of having the ability to make a conclusive
“it worked” or “it did not work” decision.
This discussion will help you understand whether you are blocked in a
particular experiment. For example, you should not plan to work on and
launch a new experiment on the “signup form” if you have an active
experiment running there. The discussion will also help you adjust your
priorities for the next sprint. For example, if changes on a marketing page are
not yielding much improvement, your team may be better served to focus on
a different part of the funnel to keep making progress on your objective.
125
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
SPRINT PLAN
The last part of the agenda is the sprint planning, which is selecting
the next set of experiments to move forward. While this has not yet
been discussed, Experiments allows you to nominate ideas, in the Ideas
interface, by clicking on the “star” icon on each idea card. Nominated
ideas will be shown in the Nominations sections, these are the ideas for
consideration in the next sprint.
126
CHAPTER 8 TOOLS - EXPERIMENTS BY GROWTH HACKERS THE ENTERPRISE GROWTH PLAYBOOK
If you are light on new ideas, you can go back to the Ideas section of
Experiments and find new ideas. Click on the star icon to nominate the idea
to move the “best” ideas into the nomination queue.
127
CONCLUSION
CONCLUSION THE ENTERPRISE GROWTH PLAYBOOK
A
rmed with the knowledge in this book, you now have the tools
you need to launch your own Growth Team. As you have learned,
a growth team can be a powerful tool in your pursuit of growing
your product or business. While we often hear of tactics that ignite
exponential growth, the reality is that there are many simple improvements
you can make which can accelerate growth.As a growth leader, the key to
achieving these results is to provide your team with the proper tools and
lightweight process. Perhaps, most importantly, you must create a strong
growth culture to help your team thrive. I hope the material in this book will
enable you to do that effectively.
129
CONCLUSION THE ENTERPRISE GROWTH PLAYBOOK
WORKS CITED
Andreessen, Mark. “Part 4: The only thing that matters.” THE PMARCA
GUIDE TO STARTUPS.
blog.pmarca.com, June 25, 2007.
The Experiments logo, images and any parts thereof are Copyright (©) by
Growth Boulevard, Inc. https://growthhackers.com. All rights reserved
130
/andyfboyd