What Do Audiences Really Think
What Do Audiences Really Think
By Joshua Jay from Dr. Lisa Grimm, who asked me to Dr. Grimm about some of the fundamental
perform magic and speak in her college “truths” in magic that I had become skeptical
classroom. Dr. Grimm is a researcher and about. How much do people care about the
Professor of Psychology at The College of secrets? What makes for strong magic? Are
New Jersey, where she also conducts research people really as fooled as we think they are? I
As magicians, we deceive our on human cognition. She wanted an insider’s had dozens of questions. While she didn’t know
audiences. But are we deceiving perspective from a magician. She believes — the answers, she had a path to finding them:
ourselves? Are there things — big correctly, I think — that magicians have a lot statistics, experimentation, and analysis.
things — that we get wrong about to offer the field of psychology, and vice ver- Our collaboration began in January 2015
our craft? And more importantly, are sa. It sounded like a fun gig, so I booked it. and continues today. In partnership with Dr.
there things our audiences can tell I opened with some magic, then spoke to Grimm and The College of New Jersey, we
us that we aren’t asking? the group. I always use the same talking points have designed experiments to gather quan-
The answers, it turns out, are for speaking engagements: the basics of misdi- titative and qualitative data on the topics of
“yes” and “hell yes.” rection, and why magic is important. I spoke to magic, magicians, and deception.
“Magic by the Numbers” is a students about why people love magic and why “Magic by the Numbers” uncovered
new research study about magic, and they are fooled by it. I explained that audienc- enough information to fill a book. But what
I’m proud to be a part of it. The goal es, as Jerry Andrus put it, come to the wrong exactly did we find?
of “Magic by the Numbers” is to get conclusions for the right reasons. Some of our findings revisited what we
into the minds of people who watch But as I spoke, I could feel an existential thought we had right, like whether women
magic. Magicians have written plenty crisis coming on. I was sharing these thoughts like magic more than men (they do) or what
about what they propose makes for because I believed them, and my beliefs were the most commonly thought-of cards are (red
good magic. But what do audiences confirmed by everything I have read or been Threes). When people close their eyes and
really look for in a magic effect? told by wiser magicians. But where did they think of a magician, what kind of person do
To find out, I collaborated with a get their information? Could they be partly they picture?
major academic institution and an or entirely wrong? What if we magicians are We also tested things that, until now,
accomplished team of psychologists the ones making inaccurate assumptions — magicians have only guessed at. For example,
and scientists. And it all started with jumping to conclusions about our audiences? when participants view the exact same clip
a phone call from a stranger. What matters in a magic trick? Do we of an effect, enjoyment is higher when the
understand magic as well as we think we do? performer is introduced with accolades —
Suddenly, in front of 100 students, I was awards, TV credits, high fees, etc. Did you
filled with doubt about the very subject on get that? The same clip is enjoyed 52 percent
which I was supposed to be an expert. So more if people think they’re watching some-
I did what any magician would have done: one great. An ounce of reputation is worth a
more card tricks. pound of presentation.
01 MAGIC • SE P T E MBE R 20 1 6
Who Did We Study?
To me, what makes “Magic by the Numbers” particularly
helpful is the perspective. There have been numerous recent studies
involving magicians, but the perspective (and the intent) has been
different. Previous studies on magic have always been conducted by
scientists — from the outside looking in. But without a magician’s
perspective, I have always found their findings underwhelming.
I am not aware of a single systematic study conducted for the
magic community. Until now. Here, we are examining magic with the
specific intention of learning how to better deceive and entertain our
audiences. It’s an insider’s look inward.
“Magic by the Numbers” is a comprehensive study designed by
myself, Dr. Lisa Grimm, and her research team, led by Nick Spanola
at The College of New Jersey. The study involved 526 participants:
482 from the United States and 44 from Europe, Latin America, and
Asia. The ages ranged from 18 to 80; the average age of the people
we tested is 30.8. We were unable to include children in our study,
even though young audiences are a particularly important segment of
We tested the effects of scale and prox- the population. Most participants were paid to complete the survey,
imity on magic. Do people prefer you to making this the only scenario I’m aware of in which magicians paid
vanish a helicopter on a far-off stage or to the audience to watch magic.
vanish a coin right under their noses? (Scale My background is in writing, not science, so I initially was con-
matters more to most people than proxim- cerned that 526 people was not a large enough sample size. However,
ity.) Is it stronger, in the audience’s mind, Dr. Grimm correctly points out that most studies of this nature use
to vanish, change, or produce something? fewer than 200 participants.
(Changes test strongest.) What kind of trick Here is how the process worked: in conversations with Dr. Grimm,
is least memorable to audiences? (Card I outlined questions or areas I wanted to test. With her research
magic, sadly.) team — and a big nod to Dr. Grimm’s assistant, Nick Spanola — Dr.
Audiences of different backgrounds have Grimm formulated ways to test for answers that eliminated bias.
different tastes, and we tested for this, too. Controls were used when possible, and A/B formats were often used
A person’s gender, age, and even religious to compare one result to another.
background affect how much they like Much of the magic shown to participants was clips of my perfor-
magic, and what kind of magic they like mances or tricks that we video recorded in a studio. We also used
best. We’ll explore the baggage our audi- several well-known magic clips from other magicians. We chose clips
ences bring to a magic show, and what we with a history of high click rates and good reviews, to ensure we
can learn from this. showed magic that resonates with the public.
At the core of our study is the shocking (Note that on the subject of gender and accolades, the sample size
revelation that what people like most and was slightly smaller and was tested later in our study.)
least about magic is not what you might
expect. In all, we tested for 54 questions I
developed with Dr. Grimm and her research
team. Some of the answers confirm what
magicians have known for years, and in these Special thanks to the following people, who offered their assistance with
cases, we now have evidence for our claims. the article and the analysis. Simon Aronson, Kent Axell, Eli Bosnick, Rod
But in an alarming number of cases, what Doiron, Andi Gladwin, Harrison Greenbaum, Anna Jay, Raj Madhok,
we’ve been taught is dead wrong. Mike Vance, Ken Weber, and Gabriel Zucker. Thanks also to Dr. Lisa
I’ll take you through our findings one Grimm’s research team at The College of New Jersey: Heather Bruett,
topic at a time and, wherever possible, I’ll Jess Cassera, Rachel Dickler, Andrew Edelblum, Danny Gallagher, Erin
offer some analysis on how we might use Largey, Stephanie Mallinas, Alexa Nagasue, Adam Oppenheimer, Kaly-
this information. These answers are tools for ani Parwatkar, Christian Sabella, Nick Spanola, and Tom Weiss.
entertaining the public, so a good place to
start is by asking the public what entertains
them.
M AGIC • SEPTEM B ER 2 0 1 6 02
How Much Do People Like Magic?
We started out by asking people to rank 81% See a film
their interest in a range of entertainment.
And much like studies that found that pizza
is addictive or that people buy more food 70% Go to a concer t
when it’s cheaper (both real studies), we
found exactly what we expected: people 65% See a comedian
would rather see a movie, go to a concert, or
enjoy a comedian than see a magician live.
We also wanted to determine whether the 59% See a magician live
environment played a role in the enjoyment
of magic, so we tested for both seeing a magi- 54% Go to a par ty
cian live and watching magic on television.
and lastly Square, which was chosen by just Two of Diamonds 90%
88% 84% 80% 86%
80%
6.5 percent of the people.) Three of Diamonds 70%
70% 68%
Three of Clubs 60%
Men
Three of Hearts 50%
40%
Women
Four of Diamonds 30%
13% 11% 31% 7% 38% This is called semantic framing. The concept
is that different words give us different percep- Part of understanding a person’s
Now to playing cards, which are the tions of events. In this case, if you say to a spec- beliefs in magic is understanding a
results in this section I looked forward to the tator “Think of any card, but not something person’s beliefs outside of magic.
most. If we can gain some simple insight into obvious like the Ace of Spades or the Queen of We asked all participants a series of
which cards most people think of, we can put Hearts,” you can follow it up by making sever- fundamental questions about belief.
this secret advantage to use in a number of al statements with relative confidence: “You’re
useful ways. thinking of a red card. And it’s a spot card. A 24 percent of men and 41
When asked to think of any playing card, Diamond. The Two of Diamonds.” As before, percent of women identify
these are the results: Hearts came in first (36 I don’t suggest you rely on these numbers as themselves as “religious.”
percent), followed by Diamonds (24 percent), an effect, but it’s valuable to know how most
and Clubs and Spades (each at 18 percent). people will think before even they know. 44 percent of men and 72
The most commonly thought-of card was the Here’s another example of semantic fram- percent of women report
Queen of Hearts, followed by Ace of Spades, ing. When asked to think of any color, it’s believing in God.
Seven of Hearts, and Two Hearts. very hard to discern in advance what people
are going to think of. But if you say, “Think Is it possible for humans to
of any color, such as green or yellow,” one “read” the minds of other humans?
color emerges as a clear favorite. Blue was 12 percent of men surveyed believe
18% 36% chosen 33 percent of the time. When blue mindreading is possible, while 10.4
wasn’t chosen, purple and red were the next percent of women surveyed believe
likely favorites. By giving the examples of it is possible.
green and yellow, you effectively eliminate Can people communicate with
those choices, and at the same time cause the dead? Only 12 percent of men
people to choose a color that contrasts surveyed believe so, but 34.3 percent
greatly with your examples. Similarly, if you of women surveyed believe commu-
24% 18% ask someone not to think of an obvious nication with the dead is possible.
card like the Ace of Spades or the Queen Is it possible for humans to do
of Hearts, note that this phrasing effec- “real” magic? 12 percent of men
tively eliminates any Ace or Queen from surveyed believe real magic is pos-
Interesting, I think, but not that useful. being chosen, and it pushes people toward sible, and 14.2 percent of women
But if we change a tiny aspect of how we ask selecting a low-value Diamond. People are surveyed believe it.
the question, we can drastically affect the sensitive to our phrasing; they react to it,
results and learn something useful. and in ways that they might not be aware
We conducted an A/B test in which half of or fully understand.
M AGIC • SEPTEM B ER 2 0 1 6 06
How Do They Really Feel?
We already explored people’s existing people perceive someone as having virtuosic We tested for different accolades in each
feelings about magic, then took a brief detour skill, would they appreciate and enjoy the clip. Audiences are most impressed by television
into what cards and colors and symbols show more? performances. The other accolades are appre-
people are most likely to think of. So far, our In the case of Ben Earl’s video, partici- ciated about the same. However, magicians in-
study has been concerned with preconceived pants did enjoy the clip more if they were troduced with some kind of accolade (anything
notions of magic. Now we dive into what told in advance that what he was doing was at all impressive) were more deeply appreciated.
aspects of magic people enjoy most after they extremely difficult. They attributed to Ben The takeaway here is that introductions
see it. What do they remember most? What more skill, surprise, complexity, and enjoy- matter. As a convention organizer, I’ve intro-
do they forget? Are they as fooled as we ment when they perceived his talent to be duced many magicians. When I ask how they
think they are? world class. Eighty-five percent of those who would like to be introduced, the majority of
The first experiment we did concerned the thought what they were seeing was difficult performers say things like, “Whatever you
framing of magic performances. It was anoth- wanted to see Ben perform more material. want,” or “Just keep it short,” or “It doesn’t
er A/B test; we divided the population into Only 33 percent of those who were told matter.” If you care about how deeply your
two testing groups. Both groups were shown nothing about Ben’s skill wanted to see more audience appreciates you, it does matter.
the same video: Shawn Farquhar’s FISM-win- material. Quick caveat: This isn’t a license to invent
ning routine, “Shape of My Heart.” The first Certain accolades matter more than credits, just encouragement to use the ones
group was simply asked to watch the video. others, it turns out. What is more impressive you’ve already earned. Sure, you were in the
They weren’t told anything specific about to an audience: great skill, performing on audience for a taping of The Tonight Show.
Shawn or his effect. The second group was television, winning awards, performing for That doesn’t mean you were on The Tonight
told that they were about to watch the World celebrities, or being expensive? Show.
Champion in Sleight-of-Hand Magic perform
the routine that helped him win magic’s
highest honor. Everyone from each group was
then asked to rate their enjoyment of the clip, 6.2
e
r
e
s
ill
ed
ip
he
ick
qu
on
Sk
sh
az
Tr
ni
e D
an
m
/U
ut
m
g
A
er
ed
O
ow
s
W
re
ct
Sh
Be
pe
gu
ick
ex
Fi
Tr
ow
g
t
e/
yin
g H
Tr
n
rp
wi
Su
no
Ab
so igh
cians has never been tested until now. We were bl t be possibl depending on where they are, who you are,
M
lute
e
ly possi
e
interested in finding out how far people would and what you’re doing. But this data suggests
stretch their disbelief, and whether there are al Magic to the dea that in virtually every show you do, some
Re lk
magicians, tricks, or circumstances that cause of your audience believes that what you are
d
Ta
people to believe that what they are seeing is 40% 48% doing is real.
real. Is it possible to pinpoint who is most like-
To begin with, we asked if they think it is Possible Possible ly to believe? A self-identified belief in a God
possible for a human to memorize an entire is positively correlated to belief in talking to
deck of cards. Seventy-three percent of people of people also believe it might be possible to the dead, mindreading, moving objects with
thought this might be possible, and the older move objects with the mind. the mind, and a belief in real magic. But since
the subject, the more they thought it would beliefs are not something we wear on our
be possible. This revelation shows a shocking open-mind- faces, this aspect isn’t particularly helpful in
Then we asked if people think it is possi- edness about the possibilities for authentic choosing volunteers or audience members.
ble for humans to read the minds of others: magic, especially given the complete lack This data could be useful to those who
sixteen percent absolutely did, and forty of evidence to support any of it. But certain believe it’s ethically wrong to claim super-
percent think it might be possible. Nearly 40 performers — Uri Geller, Derren Brown, and natural powers in a magic show, and could
percent think it might be possible to do real David Blaine come to mind — have a perform- equally be used for those wishing to make
magic, and 48 percent believe it may be pos- ing style that is so realistic that many people do their performances appear more like the real
sible to talk to the dead. Thirty-five percent believe that what they are doing is real. thing.
Looking Ahead
I shared our study with a valued friend, mostly because I just To these people, my only response is this: your audiences disagree
couldn’t believe some of the results. He couldn’t either, which is with you.
why he initially rejected the very notion of approaching magic with Even if your only takeaway from the study is to use an introduc-
laboratory coats and clipboards. tion to your show, your show can improve. If your only take-away
“Magic is art, not science,” he said. “If you do market research is to do more card magic with other props, your show can improve.
on what tricks are most popular, you’re making magic for your If you focus on using spectators who want to come onstage with
audience, not art.” you, your show can improve. Small, measurable improvements.
I agree. If everyone only performed magic that audiences And beyond these concepts, there are dozens of other tools for your
identified with, our shows would all look the same: dreadfully safe toolbox, if you are honest with yourself and your magic.
and broad, and risking nothing in terms of experimentation. There In an old musicians’ parable, an orchestra is about to begin a
would be no element of surprise that the audience so clearly craves. performance of Beethoven’s “Fifth Symphony,” arguably the most
I believe that the very best magicians explore new horizons, and famous piece of classical music. Backstage, the conductor says, “I
show audiences what they never expected to enjoy or think about. know all of you have played this piece innumerable times, and the
But anyone who entirely rejects feedback from their audience audience has heard it many times. But tonight, I want you to play
is missing an amazing opportunity. Knowing what our audiences for two distinguished guests. The first is a little boy who is hearing
think about magic is important. Understanding how our audience Beethoven’s ‘Fifth’ for the first time. The second is an old man, who
thinks about magic is invaluable to anyone wishing to improve. will be hearing it for the last time.”
This study is no different from a thumb tip or a card force or a I think about this sometimes before a show, for motivation.
comment from someone after your show. They are tools, and the But our study confirms that it’s also quite literally true. Of the
best magicians use every tool available to them. 526 people who participated in our study, 28 percent have never
Other magician colleagues rejected these results because they seen a magician live. This is shocking to me. For 49 percent of our
clearly conflicted with something in their own experience. “I do participants, more than a year has passed since they have seen a
only card magic, and I get amazing reactions,” someone told me. magician live, and only 23 percent have seen a magician within the
“My show has been filled with the classics for longer than you’ve last year.
been alive and I’m not changing a thing,” another one wrote. “Peo- When you look out into the audience at your next show, remember
ple hate being fooled. We’ve known that for years,” said another. that for many of them, you are the first magician they have ever seen.
M AGIC • SEPTEM B ER 2 0 1 6 10