A compilation of the various market
research projects conducted by and for industry-related trade
associations, publications, and others.
Printer
Version
Industry Research Studies
An Informal History of Industry Research
How Not To Read Research Studies
INDUSTRY RESEARCH STUDIES
Note: These are listed in chronological order.
1. Hobby Manufacturers Association. HMA released a new
study that pegs the size of the industry (plastic model kits,
radio-control, model railroading, etc.) at $1.2 billion. For more
information, visit www.hmahobby.org
and click on Press Releases.
2. Craft & Hobby Association. CHA sponsors an Attitude
& Usage Study, conducted by Ipsos, which is updated
quarterly. The full year's data is now available in three separate
Excel spreadsheets now posted in the Research section of the main
website, www.craftandhobby.org.
This info is free to current CHA members and accessible with their
user ID and password. Non-CHA members should contact Keri Cunningham
for purchase info at kcunningham.org or call 201-794-1133. Now
posted for the year ending 12/31/07 are Category Sales Reference
Sheet, Household Participation Rates, and Cross Participation. Plus,
the year-end Powerpoint presentation made at the CHA winter show
will be posted the week of 2/25/08 and available at no cost to CHA
members for review and/or download.
CHA has also partnered with Phoenix Multicultural to conduct and
publish The Impact of Hispanic Crafters on the U.S. Craft Industry.
Finally, CHA published The Academic Value of Hands-on Craft Projects in Elementary Schools Study.
To read the Executive Summaries of these studies, visit http://www.craftandhobby.org/research.html
3. The Professional Scrapbook Retailers Organization has
released its 2007 National Scrapbookers Trend Report. For
ordering info, visit http://thesmartgroup.biz/trending/order.htm.
4. The Craft Yarn Council of America's 2007
Tracking Study Consumer Purchasing Habits & Motivation. For more
info, contact Exec Director Mary Colucci; call 212-570-9883 or
800-662-9999; email info@craftyarncouncil.com.
5. The State of Specialty NeedleArts 2007, by The National
NeedleArts Association. Members may access the executive summary
at www.tnna.org. The cost for
non-members is $195 for the entire survey and $75 for each section
-- consumer, retail, and wholesale. Call TNNA at 800-889-8662 or
email tnna.info@offinger.com.
6. The 2007 Consumer Participation Survey published
by Craftrends is in the magazine's December issue. To read a
summary of the study, visit www.craftrends.com
and click on Cover Story. An expanded version will be available in
mid-January.
7. Creating Keepsakes has updated its Scrapbooking
In America study. Highlights are in the December issue of Craftrends.
The complete study is available for $49. Call 888-247-5282 or visit www.ckmedia.com/sia.
8. Lion Brand Yarn conducted a study of knit/crochet
enthusiasts' use of the Internet, including blogs, podcasts, and
groups. Visit http://yarncraft.lionbrand.com
and scroll down to the Oct. 29 entry.
9. The State of Beading: Consumer Purchasing Habits, Trends, and
Motivation, sponsored by Interweave Press. Published in 2004. A four-page summary is
available by contacting Jaime Guthals, publicist, at JaimeG@interweave.com.
The complete survey is $200. Call 800-272-2193.
10. The 2006 Quilting in America study, sponsored by Quilter's
Newsletter (published by CKMedia) and Quilts Inc. The
cost for the complete study is $95. An executive summary is
available at http://quiltersvillage.com/qinamer06.
For more info, email Ryann Anderson at randerson@ckmedia.
Others. Various consumer enthusiast magazines have surveyed their readers
concerning their buying habits, brand preferences, etc., and often
are willing to share the results with market researchers and
potential advertisers. Check with the publishers or ad directors for
individual magazines.
AN INFORMAL HISTORY OF INDUSTRY RESEARCH
by Mike Hartnett
The first published record of the size of the craft industry
appeared in Profitable Craft Merchandising magazine in the
late 1960's or early 1970's. Publisher Jack Wax announced that the
total annual sales in the fledgling industry were $300 million.
At a trade show the following January, industry pioneer Bill
Mangelsen asked Jack how he had compiled that figure. Bill said Jack
looked around to make certain no one else was listening and
whispered, "We gotta start someplace."
That was the industry standard until the mid-late 1970's when the
Hobby Industry Assn., the forerunner of today's Craft & Hobby
Assn., conducted studies of its members. Unfortunately, many HIA
members were suspicious of revealing their sales figures to the HIA
staff – HIA dues were determined by a company's sales volume –
so they either ignored the questionnaire or under-reported their
sales.
The resulting studies were so inaccurate that they had little or
no credibility. By the early 1980's I was editor of Profitable
Craft Merchandising and one year when I happened to know that
the true sales of a single floral company were higher than what the
HIA study reported was the size of the entire floral category, I
refused to publish the results.
The HIA studies died soon afterwards.
For years there was no size of industry study at all. During that
time trade magazine editors such as myself and HIA staff members
were bombarded by market researchers, stock market analysts,
potential investors, and others desperate for data. Current and
potential industry businesses would call, too, needing data to show
their bankers.
We would explain to the callers that there was no data. They
would insist they had to have numbers. To get them to hang up, I
would give them HIA's phone number. I later learned HIA would give
them my number.
As tiresome as those phone calls were, I do understand the
callers' intent. Why would anyone invest money in an industry that
doesn't even know how big it is?
One year I was sitting at a bar one night during a trade show,
having a drink with Karen Ancona, then editor of CNA, and Susan
Brandt, then the HIA communications director. We complained about
the time spent talking to these people and how they wouldn't leave
us alone.
We concluded the only way to get these people off our backs was
to give them a number. And if we all agreed on the same number, then
maybe these callers would leave us alone. We decided to settle on a
number, then say to the callers, "There is no study, but if I
had to guess, I'd say...."
We had another drink and decided that the size of the industry
was $3 billion. The three of us used that figure throughout the
year. The following year at the trade show we met in the hotel bar
again, decided our plan had been successful, and we should continue
it.
So we asked ourselves, "Ok, so how much did the industry
grow this past year?" We had another drink and concluded that
it had grown 10%. Therefore, the new size of industry was $3.3
billion.
We used that $3.3 billion figure, and midway through the year one
of these market experts we'd talked to told the Wall Street
Journal, in what was no doubt a very authoritative manner, that
the size of the industry was $3.3 billion.
Hmmm. Maybe if we'd had a few more drinks first, the industry
would have been at $4 or $5 billion.
Finally, Real Results.
Probably one of the most significant events in the history of the
industry was in 1987 when Jim Scatena, now CEO/President of
FloraCraft, convinced the then HIA board of directors to spend real
money to hire a market research firm to conduct a real size of
industry study.
An outside firm gave the study instant credibility; members were
far more likely to respond when they knew their individual
questionnaires would remain confidential. There were doubts raised
by members about the veracity of the data, but that's inevitable. If
my retail store had flat sales in, say, acrylic paint, but the
survey said paint sales increased, I'm going to no doubt wonder
about the study. Many people probably doubted the results because
the results were averages, and no one has a perfectly average
business.
But all those bankers, analysts, and others didn't doubt the
results. Now, finally, they had some numbers. Now, finally, it made
sense to invest in, or give loans to, an industry company.
It was expensive – a lot more expensive than buying drinks for
Karen, Susan, and me – but over time it inspired outsiders to pour
millions of dollars into the industry for expansion and new product
development. We wouldn't have grown to where we
are today without such investments.
So the study, which surveyed retailers, vendors, and consumers,
was conducted every other year, but as time went by the number of
responses declined, and some major players – e.g., Wal-Mart and
Hobby Lobby – declined to report their numbers, and so the
researchers had to guessitmate their sales. Their guesses were as
accurate as anybody's (sales/sq. ft., x number of feet x number of
stores, etc.) but they were still guesses.
By then the studies said the industry had grown to $10+ billion.
Finally some board members decided there were far more sales in the
industry than the study was capturing, and a new method was needed.
Instead of trying to capture all of the appropriate retailers and
manufacturers and plead with them to respond to the questionnaire,
why not just go directly to consumers and ask them what they spent
their money on, and how much?
That meant a new study, a new research company, and a completely
new methodology. And the results, published about 2001, showed the
industry had, uh, doubled. Now suddenly we're over $20 billion.
(This is a classic example of how you can't compare studies that
used different methodologies.)
Since then the subsequent studies have indicated that the
industry has continued to grow – a far cry from "we have to
start somewhere."
HOW NOT TO READ RESEARCH STUDIES
1. Remember, we have not died and gone to heaven, so no
study is perfect. And even if it was, it's a picture of the past,
not the present. It takes months to conduct research, then tabulate
and publish the results.
2. Every study has a different methodology, so comparing
one study to another is truly an apples-to-oranges dilemma. Trying
to take the CYCA yarn data and have it fit perfectly with the
TNNA yarn research and the CHA study will just give
you a headache. Each study is not a piece of a single jigsaw puzzle
that, when fit together with other pieces, forms a logical whole.
3. Was the study conducted for the first time or was it a
repeat of an earlier study? If it's a first-timer, consider it a
baseline. Any specific data might be a result of a flaw in the study
rather than the "truth." But if a study repeats the
methodology of a previous study, then the differences in the results are probably
genuine trends.
4. Know a study's "margin of error." For
example, if a study with a margin of error of 5 reports the
percentage of households with a cross-stitcher is 20, then you can
assume the true percentage is somewhere in the range of 15% and 25%.
If an earlier version of the study revealed the percentage of
households was 18% with the same margin of error, then you cannot
conclude with 100% certainty that cross stitch has increased.
xxx