Surveying Wargamers w/ Brant from Armchair Dragoons
Transcript
all right it says that we're live no countdown no countdown I you know what I've been too lazy to set up a countdown I'm a bum you know me I'm just an absolute bum and that's how it is but I care about academic research projects which is why you're here I also want to note that instead of a countdown you have a stream that starts on time Fred so I don't think starting on time is the problem I think it's the ending on time that they they struggle with on occasion I think it might be both oh could be can we blame one his frenchness or uh do we have of course actually one of my favorite things they changed it sadly um but it used to be that if you typed the word frenchness into Google translator uh the word that would come out was La
frion that's actually really funny no all love to Fred obviously um but let's get down to business for while you're here so everybody who's watching this is brand from the armchair drons uh we're here to hang out and talk about an academic survey uh about war games and the kind of data that he's hoping to collect and just a really cool project so brand take it away talk tell us about your project yeah sure so um so first of all it's it's more than just war games we are we are looking for the entire hobby gaming audience so whether it's uh war games or tabletop role playing games or collectible cards stuff or or tabletop minis or whatever it is um we still want you involved in in this uh in this research project and what we're doing we're we're building on one that was done back in ' 06 um back when I was a grad student at Ohio State um partnered with uh my my committee adviser there and uh and another one of my fellow grad students and we we I don't know the history behind why gamma is headquartered in Columbus but they are so drove downtown sort of knocked on the door and said hi I'd like to talk to you about this research project we're doing would you like to help and uh they said sure but by the way we want to get a couple of our own questions into this thing if you don't mind and and so we did and that was cool and uh and so we ended up doing this big survey and look academic surveys just so folks are are prepared going into this this is not like some 10 question little Google form poll kind of thing this will take you 20
to 25 minutes to go through all of because academic surveys academic research is is ridiculously comprehensive um and it can take quite a while to to finish this thing so we ended up with like 3500 respondents to the one that we did back in 2006 and and once we had kind of narrowed down the key populations we ended up with just under 3,000 I think we were like 2990 for actual usable uh responses that we could go through um which of the time was a crap ton um I mean that's that's a whole lot of uh of survey responses which is nuts um so we were looking into the the motivations behind hobby Gamers and why they play what they play excuse me and then uh and then also a handful of uh kind of community involvement some marketing questions some uh some purchase Behavior questions those were the kinds of things gamma wanted um and and we got a lot of cool stuff out of it but then I I've been wanting to redo this thing a bunch over the years here we are like almost 20 years later finally uh you know started reaching out to some academic folks that I know and uh and and Dr Ian Mercer who's at fairly Dickinson University he's in the business school so I my background was uh was always in the communication world uh on the academic side uh Ian's in the in the business school and said yeah hey I'm interested and let's redo this but there are some particular things he was interested in looking into and so that that uh lent to
some some evolution of this project and so now we've got the motivations Factor we've changed up the way we're looking into some of the community involvement and Community engagement piece and there's a big chunk at the end that's about um entrepreneurship and entrepreneurial intent and and that's the part that the Dr Mercer's really interested in uh and and look a large part of that is because how many gamers do we know that have said hey I got a great idea let's make a game company to publish this like the the the hobby game world does not not seem to be short of people willing to be entrepreneurs even if it's just a side hustle and so part of what uh part of what Dr m is looking into is taking the the same kinds of measures that they use for entrepreneurship elsewhere and applying them to the gamers and seeing whether or not they actually do come up higher or lower on that on that intent scale um so that's that that's the one overthe world Viewpoint of it um we certainly dig into any or all of those facets of of where we are with this um for the details just so folks can find it and I'm sure we'll mention it multiple times here it's games survey.org is the URL that is set up and redirects to Fairley Dickinson's uh survey server they they use qual Trix is their data collection tool and so uh all you got to do is remember the gam survey.org part and it will redirect you to where you need to go the data collection is staying open all the way through July 1st originally
we were going to cut it off the middle of uh in the middle of April um but we realized with our schedules nobody's getting around to actual data analysis until after Origins so we're like we'll just extend it all the way to 1 of July leave it open we can talk about it at Origins we can talk about it at other uh game conventions things like this so we're just like just leave it open and let it keep going so are you put a little origin QR code we we actually have QR codes made up for this how did I know these little games survey.org tabs I was handing these out at Gamma Expo to folks and like leaving them on the tables there and everything for people to to snag so I've still got multiple stacks of them that I can I can leave on tables and hand out around Origins when I'm there I forgot to take them with me to bucke game fest last weekend uh do you can you say how many respondents you've had so far last time uh I got word from Ian we were around 1,400 uh but that was like two weeks ago so I'm sure it's gone up from there but but I don't know for sure just it's north of that but I can't tell you how far north of it is all right but we need to collectively beat 3500 to beat the last one you know that's uh my my goal is to yes beat what we had last time um which honestly because we did have some junk respondents in there um 3,000 would beat what was there last time if we get 3,000 usable responses then we'll beat it so all right so that'll be good um
we've had some folks that have gotten into it like this is way too long I totally know you know partway through like I mean we warned you ahead of time that it was going to take 20 minutes to do this it's you know if you didn't know that going in that was your happen yeah I uh so I have taken the survey everyone it was not that bad yeah well we actually had one of the other media dudes do it on his phone like right after we told him about it in the uh in the media room at Gamma Expo he kind of blazed through it fairly quick and he's like it wasn't so bad and and I'd never seen the phone interface like you can get a preview of it on the screen but I'd never really seen the phone interface and uh he's like yeah it goes through really easy on the phone so so that was kind of cool um I you know the the last time we did this with the Ohio State server this was before everybody had smartphones and web enabled phones so nobody cared about the phone interface you know nobody was going to do it on their phone so I did it on a laptop like an old fogy yeah but that that is my way um but yeah I mean we we've had some folks complain about like you know I stopped when it got to all the Myers Briggs type stuff because that doesn't you know that's not we don't that that's has nothing to do with the games you're right it doesn't tell me what kind of games you play but that wasn't the point the point was take the games you play and and we're going to use that as a part of the comparison for how do you
measure on the motivation piece how do you measure on the community engagement piece how do you measure on your level of Entrepreneurship um we're not collecting email addresses from anybody like we're not gonna start spamming you with hey here's a great business opportunity because we don't even know who you are so you know um we we're just trying to get a sense of where gamers are relative to the general population on a couple of specific measures so we mentioned the entrepreneurship measure and then you kind of in passing just mentioned a couple more so what exactly are you hoping to learn from this survey and then is there any room in the questions where you could end up with some extra surprises yeah so so the main one that I was interested in was was always the motivations um why do people play the kinds of games they play and uh and and that was the key thing that we built the original survey around um those same questions are back in this survey it's the exact same questions that we had back at know4 couple of things there um for for the academic minded folks that that are dealing with uh social science research and and specifically quantitative research they'll recognize all the terms the rest of y'all go look them up um but but originally we were doing an exploratory factor analysis we had all of these different fa uh Factor scales and we were trying to figure out which ones grouped together in an exploratory fashion this time around we're going to run a confirm factor analysis to see if what we found the
first time still holds true this time so so that is that is one piece of the motivational uh the the motivational scales that we're interested in and I'm actually I'm going to grab it off my side screen here and I'm going to drop a link into the chat um let me make sure this is g to work uh it's not gonna work don't acent drop your only fence no no I wouldn't inflict that on people I'm I'm gonna let you share it with everybody else but there it is um so that uh that's the link to the motivations behind uh the players that we found back in ' 04 and so the way we were able to group some things together was the idea of um fantasy so sort of the escapism element of things or the competition element or the challenge of figuring out a puzzle for some folks there was an actual kind of arts and crafts component to things uh for some folks there was a a social izing component to things um interestingly we found both a socializing component and a Solitude component separately within the motivational factors I was gonna say some of us don't do this for social reasons exactly and it's and I'm interested to see how much that may have changed with so many more solitaire games and Solitaire enabled games over the past har many years now one of the other things that that might uh change the way the measures of solitude look is that when we did did this in ' 06 we were also looking at digital Gamers and
so we were looking at folks that that were doing computer war games and computer role playing games and some of the MMOs um we we've kind of left the digital folks out of this survey and we're just really focusing on the tabletop and and I the Lars count I mean they count as tabletop but sort of that that in-person uh type of gameplay um when you ask about some of the the interesting findings so one of the things that we did find um as you you would expect the Miniatures War gaming wargaming crew uh scored really high on kind of arts and crafts sorts of motivational measures they were heavily motivated for for building and painting and Manufacturing and crafting around things um one thing that was kind of interesting is that the war Gamers didn't score all that high on the competition metric they were uh they were kind of middle of the road on on the competition piece um they were a lot more into U the the challenge of things and kind of learning and exploring things which you know when you kind of explain it sort of makes a little more sense around the war Gamers top war Gamers the Euro Gamers were the ones that scored the highest on the competition metric so they were the ones that were just out to win and so kind of Min maxing whatever strategy they could to to force a win in whatever game they were in uh so that's that's an example of a couple of things we found in the motivational factors um one of the things we found that gamma uh thought was kind of interesting in so so the mid 2000s were
right around the time the the Third Edition supplement crash had started to happen for tabletop role playing stuff and uh and 35 was starting to be released for D and and so that was that was making a lot of the older Third Edition supplements useless and some of the third party Publishers were were kind of looking around and wondering if they were going to stick with this business but it's also when you started to see a second wave of card games starting to take off a little more the collectible card games um after the late 90s crash of the first wave of them one of the things that we found is the folks that were ccg players were hardcore ccg players and the genre of card game really didn't matter so much um this was right when Pokemon was really starting to take off and and become a major thing magic was still the 800 pound Grill in the room kind of still is um Yu-Gi-Oh wasn't quite a thing yet but this is before like the Marvel stuff was all that big um the ccg players were totally Gaga for all things ccg everybody else absolutely hated them and it didn't matter whether you were a Euro gamer or a role playing gamer or a war gamer it didn't matter they hated ccgs and so gamma turned that around and pass that back to a lot of the stores they said they were like I didn't go to a store and check but that's that's what they said they were going to pass back to the stores and say Hey you know as you're looking for how you're displaying stuff in your store maybe don't group products
by like similar genres and put the fantasy ccg stuff next to the fantasy role playing stuff because you're just gonna piss off both audiences and like those things sort of separated in the store so the ccg guys can focus on their card game stuff um I think a lot of stores ended up doing that anyway because a lot of the card game stuff started getting kept behind the counter just it it was walking away so they started keeping a lot of that behind the counters um but that that was an example of of some of the marketing stuff that gamma asked us to look into and something that we found there um so that's super interesting I would never have thought of that like I can't so this goes to show you right like I started going to game stores more seriously and like you know I played games as a kid I rediscovered Katan Magic Gathering actually and um like Ticket to Ride like in maybe 2010ish somewhere around there and started gaming more heavily around then so I've never really been to a game store where the Fantasy games would include a ccg yeah like that's that was just gone by the time I started to go to game stores it's really interesting yeah and you know part of what we're looking at in all of this is the the market has changed in I mean it's been 16 17 18 years whatever it is 18 years now the Market's changed the the people in the market have changed the the retail outlets have changed because Amazon at the time was just selling books you know like we were all buying textbooks on Amazon but but they were
uh the the market has definitely changed the composition of the game audience has changed and so that's that's there have been a lot of things that are now different people's tastes and what they play may have changed back then I was playing a lot more I I was playing a look when you're when you're in school you've got a lot of time to play all kinds of stuff when you're chasing kids around the house less so so at the time I had more time to play both role playing stuff and more war game stuff now I hardly ever play any role playing stuff I still read a bunch of it but I don't get to play as much partly because I'm playing more war game stuff partly because I just don't have time for as many games as I used to um the the other thing that's happened is there have been entirely new categories within the game Space created the idea of the living card game that uses deck builder mechanics but all the cards come in the box like Dominion when first came out um and like all the subsequent expansions but but Dominion is a standalone in one box it plays like a ccg but you don't have to go collect the cards for marketing purposes like that didn't exist when we did the original survey yeah no my first thing that made me a solo gamer was The Lord of the Rings living card game from Fantasy Flight because I wanted to scratch the MTG itch without paying MTG money that works out great um but I wanted to be able to get all the cars have like go on a site or like open a bunch of packs you know and it um totally changed my gimi life that that change happened because I don't know
that would have become a solo gamer without Lord of the Rings and I think there's probably a lot of folks out there that do enjoy some of the the game mechanics within within some of the collectible card games whether it's a Pokemon or a magic the Gathering or whatever some some of the mechanics in there are are interesting to use in a game but the the the acquisition of the game drives them nuts you know the idea of having to chase around certain Power Cards and you have to have these to win and so therefore you got to spend more money just in the hopes that you get the right ones whereas something like a Dominion or the the you know Ascension or the Lord of the Rings living card games or whatever it's it's in the box and and you can buy like 15 Dominion expansions if you want that's fine but you don't gain any competitive Advantage for doing that right and also you know in advance what's going to be in the box so you understand what is purchasing yeah I was a I was a heavy magic player back in the mid 90s um I got out when Mirage was on the market which for folks that know magic knows know how long ago that was um but uh I actually showed up there was a very early interview like duelist magazine number five or six somewhere around there they had an article in there about magic on the web because at the time you know the worldwide web was this new fangled thing everybody get online through those uh AOL discs that everybody got mailed to them you know here's 20,000 free hours um I I was actually quoted in one of those articles
like I'm I'm one of the people that's in one of those articles um that when they were writing about it they reached out to me and said hey we're interested in your take on this so but but again he just couldn't keep up with with the marketing of it all and I there's other things I'd rather go play not have to mortgage any potential future house or children for this so so I I got out of it and went back to wargaming and role playing and so fair enough fair enough yeah so that's that's an example of of one of the things that we got out of this um one of the other things that happened in 04 and I haven't looked at the data this year to kind of see where it is yet one of the other things that happened in 04 we asked a handful of open-ended questions at the end of it sort of you know why did you first start playing you know whatever the your favorite hobby games were and what do you think G you know gaming still says about you as a person today kind of stuff and we were expecting you know a couple of sort of smartass quips here and there n man people wrote paragraphs people wrote like you know High School essays on this and it was insane how how much people kind of spilled their guts on all of this and uh and it was crazy um I'm I'm dropping another Link in here for you to share with the audience one of of my fellow classmates um Joselyn was not involved with the original research that we did um as a part of the the original data collection but she took the data set
afterwards and used it to help write her master's thesis by going through all of those open-ended questions she had a pair of research assistants helping her but they went through all those research questions and kind of categorized them by the the kinds of things people were talking about um and and did sort of a framing analysis that's not EX exactly what it was but similar to that of uh of the different uses and gratifications people got out of playing games based on the open-ended responses that they gave us that was a lot of text to go through um but it was amazing how much we had that that people were willing to share on that I'm hoping we get something similar this time around but I I haven't looked at the data yet to know yeah no it's that makes me really happy that like Gamers just want to talk about gaming I feel like it's like uh even solo Gamers right like they're actually among the more social Gamers when they're not gaming because you gotta go online and like share what you playing absolutely and and again I mean you know in terms of how much things have changed since then um Board Game Geek was it it wasn't non-existent but it wasn't near the the dominant factor that it is today Euro games were were climbing but at the time Origins was still largely dominated by card games and role playing games um you know several categories of games didn't exist certainly a lot of the current web connectivity didn't exist smartphones weren't a thing yet I i' I'd
have to somebody somebody in the chat tell us when the first iPhone came out but the iPad didn't exist yet so we we didn't really have tablets as a standalone category which meant we didn't have a lot of the apps that allow you to play tabletop games right very easily on those computers or you know never mind the phones or tablets much less play them against other folks on something like um you know board game arena or tabletopia or tabletop simulator okay so thanks Bill so 2007 is when you saw the uh when you saw the iPhone show up so as we're doing this survey like those things didn't exist you were playing solitire on your phone you know um not not I remember putting snake and Tetris on my graphing calculator in high school and that was my way like being bad in class i' play like I mean you can't stop the kids from playing games but it's a lot easier now there were when I was in college whatever the graphing calculator isure that all the the engineering nerds had had some basic like little eight bit Melody stuff that you could do and uh one of the guys was so proud when he programmed his calculator to play Aqua along from Jeth Rotel so that was the highlight of his engineering class our freshman year so I mean I I wasn't in any of the engineering classes I was an English major so um who knows man put in the request bug people for it maybe they will um yes I would like to see some
Fallout dual decks because I'm really interested The Fallout deck but yeah I I am all with you on this I am totally down for playing tabletop games at a table with some friends that said I also look at what Jim ozari and the the crew over at the drons do with tabletop simulator where they're they're playing they're actually live streaming them because if they're playing anyway that Jim just turns on OBS and streams it to his YouTube channel they're getting in three nights a week um some serious minis War gaming using tabletop simulator with guys uh literally from Italy all the way over to Singapore and and most of the crew that's playing are there's one or two in England um New Jersey uh northeastern Ohio up in Canada gyms in Milwaukee and then there's one or two left coasters in there that are one of them just south of San Francisco that are pretty regular guys in those game groups three nights a week those guys get together and play three hours of minis War gaming on tabletop simulator and that's not something they would be able to do like even at home uh just because you can't leave the stuff set up right tabletop simulator you hit save and you're done and like you come back and reload it and go oh that's wild yeah so I like to play on a table if I can but I've played so many online games of obsession this year um I've been playing PX Premiere Online and really enjoying it and also you know David Thompson and I are co-designing games together and we don't live in the same state so yeah we have to uh we had to to do tabletop
simulator in order to like design together so I also with friends ew no I'm kidding um but I I'm working on a design project right now with a guy who's out in m in uh in Oregon yeah so you know he and I are working on a project together so I like being able to play with other people in person um but I have adapted to yeah my my preference is to play with people in person in the absence of doing that I would rather play with him not in person than not play I think is is the key thing there well I also think it's probably how I started to become a solo gamer is a lot of solo Gamers will probably say the same thing um you know we're not a one uniform group of people so maybe but like uh I think a lot of solo exp players experience this like you start playing solo because your desire to board game outpaces your opportunities to board game yeah so instead of like wait for game night you play by yourself to like scratch the itch and then now I enjoy it as a thing in itself but I feel like it probably started because I wanted to game really bad and I didn't have anybody to do with as much as I wanted yeah yeah and you don't want to prop a mirror up across the table from you God no so we talked about motivations like you've gotten some sort of um you've gleaned some information about like consumer habits and like what people are interested in buying how people are G together uh I kind of want to Circle back around to the discussion of Entrepreneurship just because I feel like actually this could lead to a larger discussion about our culture now
things have really changed since 2006 everyone's a brand now um but how would you say like for people who are deep into the gaming hobby um to what extent are do you think we are mixing like business and pleasure I I I hesitate to make too much of a of a hypothesis there because whatever I say will certainly be invalidated by the data in like six months but but I do think there's even going back to when all of this started like when when you know Gary and and Dave created TSR and started publishing Dungeons and Dragons it wasn't like they tried shop it around to other companies first um you know they they hey we got an idea for a game let's go hit hit print and start publishing these things and and how many different companies out there um even in especially in the early days sort you know screw it we'll just do it ourselves you know how many of the the different companies out there were just folks that had an idea and said I want to be a game publisher um I was one of those guys in the early 2000s I sucked at it it's why I don't do it anymore so I uh you know I I'm fine with the design piece I didn't want to be in the shipping business which is what you are when you're a game publisher and I just didn't want to do that anymore um but but think about all of the big companies that are out there today right the whether you're talking about Green Ronin or Cobalt or or uh
piso or even watsy I mean those guys all started with hey we've got this idea for a game let's go try and publish it and they were showing up at Conor origins or whatever in those little 10x10 entrepreneurship booths with one product and a couple of enthusiastic folks trying to get people to come pay attention to them and buy stuff you know the the watsi guys people forget talislanta like that was an early watsi product that was around for a bunch before before Magic Gathering caught fire so that's the idea of hey I've got an idea for a product let me go form a company to hit print on these things I think given the nature the physical nature of the product in the in the hobby gaming world the barrier to entry was a lot lower than it was in a lot of other contexts right if you want to be making car flags for college sports teams like you got to go find a manufacturing facility that can make injection molded high impact plastic and then you got to find somebody else to print and sew flags for you and then you got to marry those things up to be able to put them on people's cars um that's a lot of manufacturing and that's very different than hey I've got an idea for a roleplaying game I can go down to I was about to say Kinkos to FedEx office right I'm dating myself here because I worked for them back when they were still Kinkos and and go down there and just you know start making photo copies and staple them together and sell them for 10 bucks to your
friends you know through mail order or whatever it it's very easy to find places to print paper stuff for things like role playing games or even decks of cards aren't that hard to get printed um especially not now but they weren't 30 years ago um compared to other kinds of Entrepreneurship or manufacturing you know if you wanted to be an entrepreneur and open a fast food franchise like how many corporate Hoops do you have to jump through to make that happen so so I think there's a I I think there's a bit of that spirit that that creative I've got a great idea Spirit already exists in a lot of Gamers and just how many of them take it that next step and start executing on that Vision so interesting yeah I think about it as somebody who you know has a YouTube channel I mean not everybody does right but lots of Gamers do and you know beyond Soler is an LLC I don't make like a lot of money or anything but I basically you know made it officially a business a couple years ago so that I could like you know handle my YouTube monetization which isn't much but like a sponsorship for the podcast um you I've taken on a lot of editing and some video work in recent years and I I I think thinking about Gamers as entrepreneurs right now I'm very curious about the data you're going to get because I also spend a lot of time watching Tik Tok and it's almost like everybody is a business and your business is you now yeah yeah and to what extent does that like spill over into gaming but it's also in makeup
and it's in books and it's in having cute kids or having an adorable pet you can make a business out of everything now so the uh the the last link that I just dropped in there for you to share with the crew is actually a paper that I had written um back in ' 07 on entrepreneurship in in the hobby game segment of the publishing industry and and look Dr Mercer's gonna far outstrip anything that I came up with in this because this one I didn't go out and and Survey participants in the market I was working from secondary data so I was talking to a lot of the the guys that run the distributorships about the companies that are that they're representing and selling through the distributorships I was talking to gamma about the membership numbers and how they were fluctuating and and one of the things that people use as a secondary measurement of Entrepreneurship is the volatility in a particular industry how many companies are coming and going in and out of that industry yeah um and so at the time it was very much in flux because the the data I was using was primarily 056 data when I was writing this in ' 07 um it was primarily 05 and 06 data at the time and uh and so that was right when Third Edition was crashing that was right when you had some new card game companies starting to come up that's right when some of the uh uh kind of hybrid companies where you had war game companies doing RPG
products and vice versa uh because like Avalanche press um you know they're primarily a war game publisher but in the early 2000s they had a line of probably 15 or 20 Third Edition Source books that they had published um for for role playing games um so you had a bunch of folks coming and going at the time um that's that's right around the time that green Ronin was taking off but guardians of order was going out of business so it was uh there was a lot going on and that that was using volatility as a measure yeah there's a lot of Entrepreneurship in the Hobby Games industry U at the time that's that's one of the things that that that paper discusses so yeah it's not a great paper it's certainly not going to you know withstand the kinds of stuff that that Dr Mercer is doing on entrepreneurship because that's his core academic interest and and kind of his shtick but as a Comm guy looking at this you know using the The Limited tools that I had for for looking at entrepreneurship that was something that I was interested in so that's really interesting I would be I would be very curious to see you know what this reveals too like you know does the nature of the entrepreneurship actually seem different like I actually really like that people like make a game and like want their game out there uh We've also you know so we we've seen the rise of sort of everybody is a business we've also seen the rise of large corporations that buy up smaller Publishers and so you know and get spun off with all of the parent company's debt so that the par doesn't go under
that's you know it's brilliant I wish I known that I could buy a company and just put all my debt on it and just spin it off let's just do that man that's an easy way to get rid of 800 million in obligations right there man like if only I had known that that was it was that easy there's a reason I refer to those companies as vulture capitalists right they're very good at picking over carcasses and creating them apparently um but you know uh I'm how will you will you be able to read do you think the data that you get in conjunction with these like other trends that you can kind of see anecdotally like how do but anic data is not what you're after so like no no what ends up happening and there will probably be some academics that will jump into the comment section four years from now and go no no no that's absolutely not what happens but but if you go hop on Twitter and use the hashtag overly honest methods and scroll through their for a while like one of The Inspirations for a lot of these hypotheses is hey I've observed something that I think makes sense with this framework around it let me find some way to test it and for folks like me with a social science background and and quantitative business analysis kind of falls into that same social science realm but but your quants in the polyi world and the sociology world and the psych world all fall into
a very similar category how do we measure this like how do we statistically assess and measure these things because qualitative research man that's a whole lot of in interpersonal interviews and I just don't like that many people like I want to sit down and have to talk to you that much but but what can we do in terms of of creating that that theoretical construct and figure out some way to measure against that um so what what you're talking about there is yeah there's a lot of anecdotal evidence that we've seen of certain kinds of behavior do the numbers hold up against those hypotheses or not and and this goes back to to exploratory versus confirmatory research right when we did this originally back in in ' 06 we were asking a lot of research questions it wasn't does this compare to what we expect it was we don't know what to expect what do we find if we ask these questions and that's that's the kind of stuff that we were finding whereas um that that was really different if you've already got something that you've observed or something that had had been measured in the past and you want to see if it's changed over time um so so I'll be interested to see you know again I'm I'm trying to sort of stay out of the way of the entrepreneurship stuff even though that's a lot of what the survey asks towards the back end of that survey because that's not my area of expertise that's that's the stuff Dr MC cares
about that's stuff he's worried about um folks that have gamed with us at Origins have met Dr Mercer he's a he's a regular with us at the wargame HQ there um but he's he's up at fairly Dickenson University up in New Jersey is where he's based out of um that's that's more his area of interest I'm interested in seeing how the motivational factors have changed over time and and do they hold up with the same audience components that we had before um that's that's that's the the thing that I'm really interested in and we sort of changed some of the things we were asking about audience engagement we didn't ask a ton on the previous 06 survey we got a lot more into it on this one um we in part because there's other people that have done similar research in other fields that we adapted to be able to use for this that just didn't exist back in '06 a lot of that stuff's happened in the last eight or nine years he visit K wanted to say hi by that I mean he wanted to dig his CLA in like and so I paid attention to him so here we are are you done now now you got what you wanted okay love me leave me all right got acknowledged on camera so Russ yes construct validity that is that is definitely a big piece of it um in' 06 we didn't know what kinds of construct validity we were going to have we've got a better sense of that now because we're building on some existing research that didn't exist back then um so we're we're hoping to see where some of that goes um
we'll have to see there's a bunch of lessons that we learned from 06 uh there were some questions that we pulled out there were some things that quite frankly were were sort of American Centric that that we pulled back out one of the questions we asked about sort of military service and and we Justified it to ourselves because at the time uh a bunch of the countries in Europe still had um some conscript armies where there's sort of required military service uh but we just it it was such a negligent factor that we just completely punted it this time around um it it was completely irrelevant we do ask a lot of demographics on that first screen um a bunch of those quite frankly are required by the university and and folks that have done University Research will understand that yes they're gonna they're require a bunch of stuff and I think part of it as soon as you mention this half the audience is gon to flip their over this but but part of it is the University wants to ensure that you're not over sampling or over representing particular populations and that's not to say that there's any sort of quota system involved in who you're targeting for your research what the university is looking at is the kinds of research that's being done across the entire University so not just this project that we're doing but all of the different research projects across the entire University from all of the different grad students and professors and Survey organizations and teams and whoever's working on stuff they want to make sure that you're not over under representing the population as a whole um across everything the university does so it's not that they're they're picking on us
in particular they we're just another piece of a large aggregation of data um one of the other things we learned from 06 when we were doing the types and genres so is it a is it a tile L game is it a card game is it a collectible card game is it a role playing game is it a computer game whatever and then we had the genres so is it is it fantasy is it you know historical war is it sci-fi is it whatever um in the genres we completely left out the horror genre like that was just a mistake on our part we just spaced and just like all the cthulu people were like you didn't put horror like well crap you're right we didn't like we just missed it um in our defense four people at Gamma missed it also because we had four different people at Gamma review this thing before we hit publish and they all missed it too so uh but we did get a little more granular in terms of the the kind because we weren't dealing with digital games at all we were able to get more granular in the tabletop games so so some of the like roll and right sorts of games um living card games didn't exist back then so we did uh segment living versus collectible card games um some of the tile Lane games have gotten to be a lot more popular there's a lot of different variations on the tile Lane games um it's not just endless flavors of carcassone um so so there's there's been a bunch of different stuff we did call out the Train games separately this time around because there's there's a huge train gaming community that that's that's a big thing for those guys that
is the truth so another question that might actually take us all the way to the end of our hour I'm just curious so okay one thing that makes I think you know people are self- selecting to answer the survey yeah but the thing that I it just makes me crazy about surveys so you'd be the expert on this is people always you're asking people how they perceive themselves but they're not necessarily it's like it's self-reporting so there's a lot of people who click like I strongly agree that I'm a wonderful person I'm basically a candidate for saood so um how what do you do about that when you're interpreting data like this how do you like ask questions to minimize it as much as possible do you bother um and then you know how do you interpret what you get do you just take it at face value or there's something in place to kind of some of it is accepting the limitations of the tool folks tend to have a fairly high opinion of themselves um in certain cases you can kind of shift the center of the bell curve to account for the fact that everything is inflated yeah know uh ideally if you're doing a bell curve on grade distribution you will appreciate this as an instructor uh the C should be in the middle and everything tails off in either direction the 88 is the middle of the bell and and you know the a pluses are still a fairly significant number and then you know like the the One D in the
entire school is that lonely dude way off on the end somewhere um so so you can shift the center of the bell curve a little bit if you need to based on uh the the term that folks use in the social science world is the zcore of something um and that is measured the zcore allows you to compare things that have very different scales because the zcore measures how many standard deviations from the mean something exists so if something scaled 1 to 10 and something else is scaled one to 36 like you could still compare those to each other by comparing the zc scores of certain things which tells you how far from the mean in either direction they get um I'm so happy that you said that because I used to know how to get the zcore on my ti 83 graphing calculator but I did not actually understand what it meant and I was just told to like get it periodically yeah and that makes so much sense like wow why did nobody just say that yeah and and so the the place that could use zores the most and you never hear them discuss because it' probably just hurt too many pe people's brains when you start comparing um Sports over various eras you know you can't compare quarterbacks from the 1970s everybody you know pass interference didn't exist and everybody was running the ball and no you pull out the zcore how many standard deviations above the mean was this quarterback on certain performance metrics compared to today so you could do some things that way um nobody will ever do that because
that's like you think they're you know nuts about analytics being weirdos now you know God forbid you pull those out um so that but that's another way that you can sort of compare where folks kind of self assess quite frankly a large part of it is in sort of how you craft the questions because it's not so much uh you know how uh you know I am always right in the arguments I have but sort of how many arguments do you end up in and so you know that can be more of an indicator of somebody more willing to pick a fight than it is just you know well of course I'm right people argue with me because they're morons um I mean that's how works for me so yeah absolutely um I'm never wrong I'm just temporarily misguided um but but yeah I mean so so there's there's a couple of different mitigating factors right um it it's except limitations of the tools uh learning the best way to craft the questions to match the tool in its limitations and then some some statistical gymnastics you can do to to normalize the data are really the the three kinds of things that you can do um and that's again a lot of it is going back to point number one you're accepting limitations of the tool I mean there's only so much you can do one of the things that came out back in uh in ' 06 that that I saw in some uh and some people responding and and reacting to some of the initial stuff we put out um the the Miniatures
wargaming crew my gut says they were way over sampled compared to the rest of the the hobby War Games world we had a lot of those guys reply back then and I think it's just they're better organized than a lot of the other uh facets of the hobby because there's like four major websites that those guys congregate on and so many of them are hmgs members that it's really easy to find the minis wargaming guys and you can get it out to a whole lot of them very easily what was happening is we were saying you know hey our sample included the following percentages and there's like you know 26% were minis War Gamers or something I don't remember exactly what the percentage is and we saw people's reactions going holy cow this survey is all screwed up there's no way Min War gamers are 26% of the hobby population we never claimed that like that's never what we said what we said is of the people who responded to the survey 26% of them were minis Gamers I'm not trying to get a representative sample of of everybody that's playing in the hobby I there's no way of knowing what that is um I mean beyond that look I I I happen to know a handful of the people in the chat here they are gaming omnivores much like I am I've got got I don't know 300ish war games in here I I don't have as many War Games as some of the other hardcore War Gamers because they tend to come and go more frequently if I'm not going to play it I'm gonna find somebody
who will but if you start adding up how many role playing products that I've got up here man it is easily four figures and maybe in the the 2000s um if I add PDFs I'm in the 3000s easy not core rule sets but like individual products so like you know all the D andd modules and aers and the map sets and all that stuff yeah once you add the PDFs I'm easily into the 3,000 PDFs don't cost anything they don't take up any storage space so I'm a total packrat for those things I enjoy reading them um but which you know if you're G to put me in a box somewhere in the Hobby Games World which box you trying to put me in right you know and got a ton of Euro games because the kids enjoy playing you know the Ticket to Ride series with me so I can always get those out and play with the kids no yeah um so that's you know for for folks like me where what box would you try to put those in if you're trying to get a representative sample of the entire hobby like when we were growing up they were just all adventure games like that's that's how you refer to all of them I mean it's the guys that run the origins awards are the Academy of Adventure Gaming arts and design and that covers everything that we're surveying so that's interesting yeah I never really thought of any of my games as adventure games that was the that was the term of art back in the 70s when when all that stuff was first exploding because board
games were sorry and clue and Monopoly you yeah so and Euro games didn't exist as a thing back then so that's interesting yeah Meandering Mike is right PDF's out of sight out of mind yeah yes yes yes it's like a it's empty calories did you really eat them if you can't see them there's been more than a few times when somebody has posted something in in the Forum somewhere and said hey there's this you know you should check out this this latest edition of this cool role playing game and here's some stuff and I'm going yeah that's kind of cool let me pop over to drive-thru oh I already own it that's happened so many times so many times so it's crazy so thank you Mr Phillip sir um go go get some friends to complete it too really appreciate it yeah so kind of as we start to wind down if anybody's got any questions for brand please pop them in the chat uh but Brent why don't you talk to us just one more time about how people can help you by doing the survey yeah so so the the the primary thing is please go complete the survey and again it's look it it's going to take you about 20 minutes like it's an academic survey it's not a short thing there are some places in the survey where the scales do flip from uh they they invert and that was always intentional to make sure people are paying attention and not just c c c see you know like like people would do with their their end of grade tests um it it
does take a little while but that's because we're we're trying to be thorough about the way the questions sort of cross check each other as a part of of being St statistically valid measures um so that that's the biggest thing the the next biggest thing is please share it far and wide please get as many other people as you can to to join in and take the survey as well uh don't go take it four times yourself like once is enough for you we appreciate that uh but let's let's go get some friends to uh to participate um Russ for what it's worth the survey is clearer than the uh 1714 rule book so so that should help Russ and I had we we puzzled we had a five player game of it g we had to puzzle our way through 1714 a little bit this past weekend at Buckeye gamefest oh here there's there's ambiguity we'll just say it that way what well you know there there were more than a few times where we had sort of executive rulings at the tabl like all right can we all agree this is gonna mean that and and that's what we just all agreed to and went with um so the the next thing is please go ask some friends to do this also and and even if you're not writing full paragraphs on those open Ed questions at the end um please you know go go through the scales in good faith and give us give us your best realistic answer we're not asking for any data that we can come back and find you with what's in there we're not asking for any personally identifiable data in there
there's a lot of demographic questions again the university sort of makes us do that but but we're interested in trying to get the best possible pictures we can of the hobby gaming World along these different facets that that quite frankly do kind of matter in in our understanding of the hobby of what we do why we do it ways that we can improve doing it we can use these kinds of you know the the kind of information we get here to to maybe better tune some of the games to better Target some of the games hey here's this really cool game that you should know about but we know to to to point certain people at it because it focuses on these things that matter to that audience you know it's everybody likes to make fun of of algorithms on computers but you know when you appreciate sometimes you appreciate targeted ads rather than non-targeted ads right I don't need to see car ads show up in my social media feeds ever I can't tell you the last time I saw a car ad show up I just don't care um yeah but now that you've talked about it is your phone anywhere around because you're gonna start to see over here but it's on silent everything so it didn't interrupt this yeah we we'll see what happens maybe now I'm G to start getting car ads and I'll blame it on Liz and then and then one more question from me um which is uh how will we how and about when will we hear about the results of the survey like what are yall hoping yeah to do in terms of of letting us see the
results of our Collective inputs yeah so the the basic descriptive stats again like we're required to collect the demographics but they're also some of the easiest things to break down so some of the initial descriptive stats that kind of break down the population that replied to the survey we'll probably have out by the end of the summer so you know the survey talk to you know the the respondents of the survey had this many tabletop War Gamers this many fantasy role playing guys this many collectible card guys with guys gals people um and uh I need to start saying folks more than guys and gals sorry I I'm still working on it to you I always like I'm totally guilty of the hey guys and then I'm like oh wait well I used to do Peeps but apparently like that's no longer people associate that with the marshmallows so I mean I hate those things so it's not something I'm ever going to associate it with but anyway we'll have some of those descriptive stats back fairly quickly the the straightup statistical measures where we're just aggregating the scales and sort of dividing those based on the factor analysis or the the things that Dr Mercer is going to do the the numbers around them will probably get crunched fairly quickly the challenge is and folks that are are watching this or know what academic writing looks like getting all of that packaged into a good academic paper is timec consuming and
some of those probably aren't going to show up until early 2025 um so some of the descriptive stats some of the community engagement pieces some of the marketing pieces will probably be able to get turned around fairly quickly um but the the longer more detailed paper like the ones that that we dropped in the links here in the chat um those those are going to take a little bit longer um just because the writing takes longer a academic writing is one of the most obtuse forms of human expression ever invented and it is painful to have to go through both as an author and as a reader you know you're not the I actually used to get in trouble because I was told that all my work was too colloquial yeah but hey then my disputation got perfect marks for Clarity so you don't have to like what I said but you know what I said yeah yeah oh I I got I got hammered in in in my PhD program uh for for being too colloquial and uh and and not academic enough that some folks said I was imprecise in in my wording as well tell me where the ambiguity is show me specifically where you're not clear what I'm saying and and and they couldn't find it it was just I wasn't using flowery enough vocabulary for them guys my Master's Degree was in journalism not academic ease right this is the exact opposite of what I've been learning to do for the last several years which is make clear so people
can read it hey man you're picking you're picking Majors that are almost as non- moneymaking as mine yeah well the uh it would have helped if ID finished the PHD and not run out of money but the uh um so yeah it's a jocular way of answering hey the the bigger papers you probably won't see until early to mid 2025 but a lot of the number crunching that we're going to try and turn around fairly quickly we'll have it over at the armchair Dragoon site and we'll make sure that you know we we spread it around at least as many places as we spread the word about collecting information um and look we come back on a show and pull the stats up on screen and talk about them and that's cool too so let's do it yeah let's like let's let's say that's a future plan sure um around that look we've still got our solo wargaming survey thing we're going to rerun this summer also so we've we've got another thing to do later as well yes I'm super excited about that so yes those of you who did not do the solo War gaming historical gaming survey last last year you gotta come back and do it you get another chance to to not fail this summer exactly yeah it look survey research some folks will say h it's more survey research again well look I mean there's only so much experimental physics research you can do in the gaming world like there's going to be a ton of survey research because the audience is so spread out because it's the easiest kind of thing to put in front of people and they sort of understand what's being
asked of them so whether it's a survey like our uh solo wargaming survey that that you know we did last summer we're going to rerun this summer and I think the plan is to do it for the next several several Summers until we run out of steam yes um or the year- end one that we did at uh with the drons where we asked folks you know sort of how do you compare this year to the previous year uh where we were asking about kind of how their wargaming went over the over the previous year um the survey research can be useful it's it's all in the way you ask the questions and and accepting the limitations of what's there so something I've done a bunch of one of the guys that was on my my dissertation committee was the the guy who was the head of the center for survey research back at Ohio State at the time that's something that I've done a ton of and and kind of understand a bit still so that's You're Gonna Play to your strengths there fantastic all right so this is actually perfect I'm gonna cut us here because I promised that I'll make spaghetti for dinner tonight and it must happen so I just told everybody here they're fing for themselves right I got back late yesterday from bgf I never I didn't had a chance to get the grocery store yet so I told everybody man Monday night you're fing for yourself I'll have some something figured out Tuesday through Friday but Monday night man go make yourself some chicken nuggets I don't care amazing on a scale of 1 to 10 how do you feel about Dad's dinner Service uh but Brent thank you so much for coming on I'm super excited to see the results of the survey uh everybody
who's out there watching please go to games survey.org do the survey and tell your friends to go to games survey.org and do the survey yes that's too cool appreciate it folks thank y'all very much thanks yall have a wonderful afternoon and uh or evening depending on where you are and we will catch you soon with some results