Skip to main content
Loading video...

Beyond Solitaire Podcast 06: Caitlyn Leong on Professional Wargaming

Transcript 40:59

hey gamers this is Liz Davidson from beyond solitaire and I am super happy to be bringing you this podcast going beyond the board with a very special guest Caitlin Liang how you doing today Caitlin doing well thanks for having me on so I've had Caitlin on because she is awesome she is getting her master's in security studies at Georgetown and she has aspirations to be a professional war gamer so Caitlin I think a lot of people who are hobbyist we're gamers like myself are wondering what exactly is a professional war gamer so in my experience a professional war gamer is somebody who uses wargames simulations exercises based on political crises and the like to provide some sort of analysis to the government or the military or an NGO or a business about an issue that they're looking to better understand so many professional war gamers are also analysts by trade so they have some background and quantitative analysis and research to sort of supplement their wargaming and game design abilities so most people that I know professionally who war game are not necessarily wargaming analysts as their title although there are some jobs for those folks their defense analysts their policy analysts and they

do more gaming to supplement their other research portfolios essentially so when we talk about wargaming to study a specific topic does that mean that most war games at the professional level are custom-made to approach specific situations that people are dealing with who commissioned them yes almost entirely so usually what happens is a sponsor identifies a need or a specific area that they want to study so say for example what military platform should we be firing in the next defense budget you know what will give us the greatest advantage over our adversaries so the Department of Defense will say to their in-house war gamers or a defense contractor hey we want a game that tests the ability of these four or five different platforms to give us some sort of advantage over X type of adversary and then what a professional war gamer does usually with a team of analysts and a Design Lead so they sit down and they decide okay what is the research question what needs to be involved in this game in terms of variables in order to come out with an outcome an analysis that says you know this is the best platform for you to choose similarly you could examine a particular crisis you

know if there's a humanitarian issue for example the refugee crisis back in 2015 you can look at what happens to systems you know political systems governance when there's all of these people coming in from a war-torn country and how would for example the EU respond appropriately what are the options how do people kind of react on the first take and what can we learn from that outcome essentially so basically what professional wargaming entails is doing research into a topic and then using design skills to figure out how to model what you know in a way that's actually playable pretty much so it's a combination of creating a solid research model that ideally is replicable across multiple iterations of the game but also you know creating a story that can train people because there's multiple kinds of professional wargaming so in my experience I've mostly done educational wargaming which is designed to help train mostly military officers in understanding some of these complex issues and sort of where the military fits in also training government officials in thinking through their responses and what's appropriate but a lot of the wargaming that is commissioned by the government is more analytical in the sense that it's meant to generate some kind of out research

output so there's sort of two schools of thought on that and if you sort of read into the debate between those two schools there's differing opinions on the value of each and whether or not you can truly make an analytical war game because ultimately a war game is still play in some form and that kind of takes away a little bit of the analysis element because you're not just running it through a computer multiple times to sort of test the outcome but basically when it comes down to is yes you're designing something that will give you some output whether that output is learning or some sort of research conclusion so how do you know going in if the model that you're working with is viable I mean wouldn't problems come from basically teaching people on a model that doesn't work so that they're trying to apply something to a situation that doesn't actually fit how I mean is it how do you hedge your bets on that so speaking from my experience which I will admit is much more limited than some of the more established professional were gamers in the field I have tended in games that I've designed to try to avoid basing it on anyone analytical model and base it more on a body of research that attempts to be somewhat predictive of how a crisis or scenario would play out and then give the participants or players of the game the tools and the decision points to

play through their own biases about the scenario to some conclusion so a lot of the work that I've done is more about teaching people how to be aware of themselves in whatever role they've been given or whatever role they actually occupy because you're right like you could base a game off a faulty model and then the game falls apart when you're actually running it and having people play it and then of course your research output is null and void because you've made a bad game and the idea is that there's some form of testing and multiple research phases as you build the game out that would prevent that but there's always the risk of ending up with a bad game where you've built in biases that shouldn't be there or you've narrowed the decision field so much that the players only really have one of two options and that's not going to give you a good output in terms of figuring out what options there are if that's what you're seeking to study or you know what variables impact the ultimate outcome so it really does depend I think on what the purpose of the game is if the purpose is purely educational it's generally less analytical and therefore the model that it's based upon is not as important but when you're conducting research for a sponsor it is a lot more important that the model be as close to

reality and as close to what is necessary to answer the research question as possible and that's where you know there's this big debate in gaming about you know professional wargaming is how how professionally useful is the research that comes out of these and so professional wargaming waxes and wanes and popularity because sometimes people are really focused on the educational aspect and I like this is a great way to train the military and our leaders in crisis response before a crisis happens and sometimes it's like oh this is an excellent way to study this weapon system or our relations with this country and then other times it's like oh you want $500,000 to write a game and play a game and so it really depends on the administration what's going on in the world who is designing war games and sort of what the recent track record is and the problem also with professional war gaming is that a lot of these games are classified so there really is no way to tell unless you're already on the inside sort of what worked and what didn't oh that's really interesting so I'm gonna assume that from your perspective you find wargaming to be very valuable I think especially I liked what you were saying bias both identifying your own because you're asking players to inhabit the game world that you created and make decisions in it and also getting others to confront their own bias can you talk more about that and then maybe about other benefits that you see from learning through wargaming sure so I

think that what is ultimately important regardless of how you feel about professional wargaming versus hobby wargaming is that the point of playing through one of these scenarios is that you learn something and whether or not that learning is based on hard research and analysis is somewhat less important than what you learn about yourself as the designer or as the participant some of the best games that I have either participated in or run have been games where somebody came in knowing basically nothing about the scenario and how their role interacted with other roles and they left with an understanding of ok you know for example this is what an intelligence analyst does and this is the scope of Intel work for the u.s. versus a foreign adversary and I would argue that that at least at the more junior level is what's really valuable is understanding where you fit into the bigger picture and also being able to immerse yourself in that game world with minimal risk I mean that's what's so wonderful about playing games is it's meant to feel real but it ultimately isn't and so you can take risks and make decisions that you probably wouldn't make if you were that high level policy maker with five minutes to decide whether or not you know you're gonna press the button to launch nukes against for an adversary and what we've found is that in

designing some of these games most of the games that I've designed have been for students and young professionals is that people take away something about themselves and about how they understand situations and relate to the world regardless of whether or not they walk away with more area knowledge or more practical knowledge about a specific shoe area and I think that that really is the value of educational wargaming on the analytical side I will admit that I have designed very few games that are meant to have analytical outputs other than an after-action report about what the participants learned so we would measure the metrics of how much do you feel you've learned how prepared did you feel how accurate did you think your role was those sorts of things and write a pseudo research report based off of that for the sponsor but in terms of designing like a hard analytical model I really haven't had the chance to do that yet and the value there is that you again can potentially reveal biases of you know for example the army commander wants more tanks because he's very familiar with tanks and the Air Force wants more planes because that's their area of operation and sort of how do you balance all of those competing interests in a game where then you realize like oh actually you know what we need to be more effective as ships and that can be cost saving that can be repertory in terms of figuring out what the most

important aspect of you know warfare or Foreign Relations is but at the same time something to be conscious of is the fact that you know as American war gamers even if we're trying to design a game from a Red Team perspective where we're trying to put ourselves in the shoes of a Chinese or Russian analyst we're not ever going to be able to do it fully like we're trying to create as much as possible their perspective but since we don't innately have that perspective it is hard to be 100% true to reality and true to their experience so it's a fine line to walk in that respect but really it's about the learning outcomes whether it's something that you learn as a participant or something that an organization can take away as a lesson learned so when you think about wargaming in a professional sense it's definitely about learning but I mean I'm coming from the Kabhi aside we also think about things like balance and fun in in what sense I mean do professional war games have any sense of balance or is it strictly about recreating reality and therefore not quite a game the way that someone like me might imagine a game on game night so I think it depends on how you define balance and whether that's in the scope of the sponsors research question because there are certainly games that could be designed and that I have

designed where we've tweaked reality a little bit to allow for a better gameplay experience but that tends to happen more on the educational side where you want people to learn you don't want them to feel backed into a corner you know for example if they're playing as a country less powerful in the United States you don't want the United States to just be able to steamroll them even though you know in conventional and economic and military terms that is what would happen um but there is there should always be an element of fun because that's how you get people to buy into the scenario you know you can't have it has to be realistic enough that you can have you know high-ranking military officials buy in and say like yes this is something that will help us make a decision this is something that will help us train but at the same time to keep people engaged it has to be fun and you kind of have to mask that element a little bit because that's not what the primary purpose is but if you design a good game people will ultimately enjoy themselves it's just not necessarily the same as designing let's say a four-person board game where you know you kind of want everybody to be able to win based on their skill level like one player shouldn't be super-powered because then it's no fun and you open the box and you're like oh well that person's that person and there's no way I can win the game now because they have this super-powered ability and I'm just screwed so I guess that's where it differs a little bit is you're designing with the sponsor in

mind and with their goals in mind and you're not necessarily designing for pure fun and the joy of sitting down with a group of friends on game night but if you've designed a good game the story should be believable and it should still be fun although that's not necessarily how you would describe it as you're pitching the concept and briefing on the game you know you would say like oh it's an immersive game experience that's designed to model reality and give you access and for it to be immersive in all honesty it should be fun but you're not gonna you know get up and tell the Joint Chiefs oh this war games gonna be a lot of fun because that's just not how you know you're gonna get repeat business in that sense but people enjoy them and say like oh that was really enjoyable that's ultimately like what the fun is in a professional sense that makes a lot of sense so are you a hobbyist war gamer or board gamer as well outside of a professional context how did you get into gaming so I grew up playing board games with my siblings although admittedly we didn't get too far beyond like monopoly risk Stratego chess those sorts of things because I didn't realize as a kid what wargaming was like I enjoyed board games but I wasn't you know super plugged into

a hobby or obsessed with them and I played a little bit of D&D with my friends in college and then we all got too busy so that kind of fell by the wayside but the way I really got into gaming is through an organization at my undergrad it's called GW strategic crisis simulations and it's a student-run organization that's meant to if you're on the writing team and/or part of the Executive Board you're designing games that are meant to be educational on International Affairs topics for DC area students and young professionals and I got into it entirely by accident I was looking for something that was going to give me writing samples of all things as a freshman and a couple of my girlfriends and I were in the library like 2:00 in the morning and we words rolling through all of the clubs that were available at GW and we were like oh you know this sounds really interesting and they say that you'll be writing simulated news articles and things like that for these simulations let's give it a try so you know we filled out some Google Form it's like 2:30 in the morning none of us had any idea what to expect and the first simulation that I ever worked on was we called it rising tides and it was a red vs. blue game so it was China versus the US in the South China Sea so at the time very topically relevant and super interesting to

someone who is sort of just getting their feet wet and International Affairs and I wrote a plotline so each writer was assigned a plotline based on their own area of interest so we were grouped by humanitarian economic issues military issues and diplomatic issues and I was on the humanitarian economic team and I wrote a plotline with another writer about human trafficking through Chinese ports and the impacts of human trafficking between the US and China and we fictionalized some elements of it but I really really enjoyed myself and when it came time to run the actual simulation we had about believe 80 participants show up to play as I'm the u.s. or Chinese government various agencies and people were so immersed in the scenario that we had created and I really just fell in love with it and I kept writing and then eventually I joined the executive board and by the time I graduated I was the director of simulation so I was running the design team for these large-scale exercises that we were putting on four times an academic year in addition to smaller tabletop exercises once every couple weeks and that was kind of what I knew of wargaming and I considered that to be my hobby through college and I was lucky enough to intern at the National Defense University Center for Applied Strategic learning while I was an undergrad and I learned through that experience about

how wargaming and exercise design can be used for joy professional military education and I had the opportunity to help run exercises for military officers and to design these exercises that were being used as training for people who were in the master's program at ndu and I remember thinking it was probably my third week of the internship I was like ah man like I want to do this for a living and then I realized that a lot of people who are professional war gamers are also hobbyists or got their start in hobby gaming and we would have game days every other Friday and we would pull out various wargames and play against each other in the office on Friday afternoons I realized I really didn't know that much about the body of boxset war games that were out there and so from that on I've tried to be a little bit more aware and play more games and try to modify games with my friends to figure out you know what mechanics work what mechanics don't why is this fun what can we take from this and incorporate into professional game designs but I never intended to be in this field and I never intended for it to potentially turn into a career and what I found is that there's actually not as many opportunities for wargaming itself like I mentioned earlier there's a lot more opportunity to be in defense

analysis or policy analysis and do more gaming on the side as you know 5% of your total work portfolio and it's just been really interesting to see sort of what is out there in terms of both hobby gaming and professional wargaming because five years ago I didn't even know any of this existed yeah and you actually wrote a piece about it which is what led me to contact you your piece how to raise a war gamer impact Sims is very interesting what inspired you to write it so I had the great fortune to be one of the first students at Georgetown in the master's program to take a formal wargaming course professor they launched this inaugural course the fall I started the program and it's called basics of wargaming and I thought to myself hmm you know I've had game design for the last four years I'm self-taught for the most part maybe I can get something out of this maybe not I'll see you know what this class is gonna be all about so I rearranged my schedule to register and I sat there on the first day and I was like well I know nobody in this class and I have no idea what to expect but the course itself ended up being a crash course in the history of wargaming professional wargaming literature and then designing

an original box at war game and all of that experience led me to the conclusion that they're sort of something missing in how we understand where wargaming fits as a whole both in the hobby and professional side and also where the career pipeline is for all of these things and professor Bay's become one of my mentors and he said you know you have this really interesting set of experiences where you have more experience than most people who are looking to get into wargaming because of your work at GW and now the course that you've taken and at the same time Georgetown started up the Georgetown University wargaming Society and I joined the executive board as a founding member and now I serve as the president and so it sort of opened up this whole new set of opportunities to interact with professional war gamers who have been established in the field for quite some time and sort of the culmination of all of his experiences made me realize that part of the reason why nobody really knows where to go where why I didn't know where to go coming out of undergrad is because there's not exactly like a central hub of information there's not exactly a person to go to and say like hey I want to do for gaming like there's no career advisor for that at a university and you know you might connect to people here and there who mentor you and give

you you know sort of a push in the right direction but it's hard to piece together the right experiences to either work and Hobby game design or professional design and that's where I felt like it was important to lay out what my experiences had been so that not only if people who were coming up after me were interested you know they could say okay well this is what she did and these are the experiences that she's identified as being beneficial but also so that people who have been in the field for awhile and who are starting to think about who the next wave of war gamers will be can say oh you know we don't have these opportunities or we do have these opportunities but apparently you know up-and-coming folks don't know about them and I've been really fortunate that the article was well-received and I've heard from a lot of established war gamers you know hey this is really awesome or yet you know I don't totally agree with this point but this is definitely food for thought and ultimately all I wanted to do was get the conversation started so that as time goes on people have more of a jumping-off point if they're interested other than just kind of blindly wandering through their set of experiences looking for a job title that says we're gaming or something that has you know simulation design buried in the job description and my hope is that through this article the ongoing discourse around it and my work with the

Georgetown University wargaming Society we can connect more people to the right people and get more people interested in the field and get them to be aware about the benefits and sort of what the pitfalls are as well that's fabulous I also noticed in your article that you have been part of a design team for that war game for your class reconquering realm and do I understand correctly that you're trying to get it published yeah we are so we're trying to identify publishers who might be interested and going through the process sort of to spin up a Polish really polished copy of our rules and make the tweaks that were suggested to us by our classmates when we play tested as our final exam at the end of the course and whatever comes of it you know I'm really in it for the learning opportunity like if we do end up getting it published awesome that more people will be able to get their hands on it but if not you know just to even have the opportunity to shop it around and sort of see how the Hobby design side works is also really valuable so we'll see what happens um but it's just been a really cool experience to sort of through the course have both sides you know have the Hobby side where we played games together in class and had class game nights at office hours in the weekend but also design something that is professionally valuable to us as the students awesome do you want to tell us about the game just a bit it does have an unusual theme

because it's it's the Byzantine period correct yes it is so the game starts in 536 ad it is meant to model not with complete historical accuracy because we did fudge some of the timeframe to allow for more fun gameplay and a lack of super-powered characters Justinian's attempt to reconquer the Italian peninsula so it features two gothic generals and two Roman generals who all play against each other for control of the Italian peninsula and the idea is that it's a campaign level game where you have combat that we've modeled very closely off the wrists combat adjudication method where you roll the dice against each other and match them up and see who dies but also to include some high-level strategic and operational thought in the form of strategic objectives that need to be achieved in order to win the game and we've also thrown in the Justinian plague which can randomly strike at any time after the first year and right now the game takes about two and a half to four hours to play through to completion and we're working on trying to figure out if that's the right timeframe or if we want to shorten it a little bit or make it a little bit longer but the game is incredibly fun to play although I am biased I will admit that because you really get into the role of the gem

while you're playing so for example one of my design team members loved playing his Belisarius because Belisarius gets the most troops and he has the best combat modifiers because he's Rome's greatest general and then we fudge history a little bit to include the two Goths at the same time because they were actually kings and succession to each other and also to make narcy's the other room in general a little bit less lame but in the game we'd call it the angry eunuch and because he was and you get into that role and you're like ah you know Belisarius is really screwing me over and I have fewer troops and Justinian doesn't like me and this is garbage and then within your faction as a Roman or goth you kind of start playing against the other player and so there's multiple ways to win you can win as a faction you can win as an individual general and it's a really cool way to see a part of history that I think a lot of people tend to forget because a lot of people focus on the Roman Empire when Rome was great and not so much on the Byzantine period when Rome was trying to be great again and wasn't necessarily succeeding in that and we had a ton of fun studying the historical record we read procopius oh that just can't be beat yeah well and I mean he's it's really funny because he's so sassy about things like the way he describes people in battles it was like oh okay like

doing some revisionism here but you know it's awesome to be able to study especially ancient combat when you're first starting out designing a board game because ancient combat is a lot simpler than modern combat because you know the weapons were pretty standardized the tactics were relatively standardized sieges were pretty common and so we were able to build all of that into the game and make the justification you know it's based on history we've oversimplified it a little bit so that sieges do take multiple turns but you're not sitting there for the entire game waiting for Rome to fall and yeah and so we also were able to design these really cool card decks that helped modify the game as you're going along and we've given the Roman deck Latin names and we actually found a gothic dictionary online to help named the gothic cards although we're not entirely sure how accurate the translations are because apparently it's all based off with like one single surviving ostrogothic text and there's just this online dictionary for it so we got really into the immersive elements of the game design I particularly had a lot of fun designing the map because I hadn't had the chance to mess around with Photoshop or anything like that years and you know our hope is that if people ultimately

are able to acquire the game commercially it's something that's visually interesting and fun to play and that's a different balance than you know the professional side of things but reconquering room was a lot of fun to design and hopefully people will have a lot of fun playing it if it does make it out through a publisher well I mean it sounds promising to me of course I'm biased as a classicist I have one more question for you before I let you go though so you designed both sort of a hobby level game and you do professional game design and you've been playing war games so one thing that a lot of gamers will say is that it takes a lot of time to learn a war game that the rules can be quite complicated it can be an investment so how do you create professional war games that are up to the complexity of a situation but that are also learn about for the people coming in for that war game experience so in my experience what we've tried to do is narrow the rule set to three things which are have fun embrace your role and if you have questions ask because with educational games in particular especially for students and more junior folks there's always sort of this element of the unknown like I don't know what I don't know yet and rather than having people get caught up on like oh what am I actually allowed to do what

we've done is build in opportunities for people to submit what we call requests for information or RFI's and so let's say they get a simulated news article that says you know Russian submarines spotted off the Alaskan coast and they don't know necessarily what the capabilities of a Russian submarine are um they can google it or they can request from us as the control team so the group of us that are running the game hey you know how concerned about this should I be like what do I need to know in addition to the fact that there's this submarine and that way people don't have to be focused on what they know or don't know they just have to be focused on reacting to information and making decisions and what we would ask people to do in these simulations that we ran at GW was give us as the control team a list of their policy options like what they wanted done whether it was military action policy action they wanted to talk to a diplomat from the other country if that country was not being represented by players in the simulation and everything was kind of based off person-to-person interaction and that way you know you as the control team can make decisions about okaying or detailing things based on the research that you've done to support the scenario and also the strength of the argumentation of the person submitting the request but you don't have to build in this super complex rule said that everybody has to read and you know be married to and

understand like okay if I want to do X then I have to roll a dice that says you know 17 or higher on a d20 so basically professional we're gaming is a lot more maybe like role-playing with a lot of support from a team that's there to make sure you have the information you need to roleplay as well as you can essentially yes although in some cases there are very complex combat adjudication tables that are built through Excel or some other means where you input the probability of a certain action being successful so for example like I want to launch a satellite over X foreign territory and I don't want it to be noticed and then much like you would roll you know a d24 initiative and Dungeons and Dragons there's this complex analytical model that's been built to give the likelihood of success from you taking that action in the professional game and that's sort of what underpins the more military analysis games is these complex combat adjudication methods instead of just me as you know someone on the design team saying yeah you know that sounds about right I think you I think you've successfully launched the satellite and you've got an X Intel so it really depends on the purpose of the game but you're trying to create a situation in which people feel like they can buy into their roles and play the roles and ideally you know a lot of these games are for military officers so they're already in those roles and they don't have to pretend but you know there are

games where you have to put yourself in the shoes of you know your adversary and say okay well now I'm an analyst for Russia and what do I actually think about this and what would I do if I actually worked for the Russian government so it really depends on the purpose and scope of the game interesting so so as as a proponent of professional wargaming you have any last words for us before I go to where we can be found on social media um so I think ultimately what I would say is if it's something you're interested in definitely start by identifying what your areas of interest are and what your existing skill sets are and then focus on building a complementary skill set so my secondary background is in research and analysis on a number of international affairs related topics and what I've heard from a lot of people that I've spoken to in professional wargaming is really to be a successful professional war gamer wargaming has to be largely secondary to the rest of your work so you have to be able to do good quantitative analysis or good research or good briefing and building that secondary set of skills is really important and also try to identify opportunities to reach out to professional societies in your area in the DC area wherever you know you can find people on Twitter YouTube Facebook for example the Georgetown wargaming Society has a YouTube channel where you

can watch all of our recorded webinars since we're online for covin and identify those resources learn from those resources start reading the literature I mentioned in my article several books that are a good start and try our hand at game design you know even if you never publish a game even if you never run a professional war game it's very valuable to go through the process of starting with a scenario and then doing all the research and building something out and testing it because that's something you can talk about in an interview is you know hey I designed this game and this is what I learned because most people are not expecting you to be a you know completely formed war gamer they're looking for you to have the skill set that complements wargaming that also then compliments their work so I guess my advice to folks looking to potentially get started on the professional side comes down to identifying a complementary skill set and then also identifying what you can do to sort of self teach because at this point in time there's a lot of courses that you can take online through various professional societies but aside from that there's really no formal you know we're gaming degree or program and that's just because there hasn't been enough buy-in at most institutions to start something up but there's a lot of value in teaching yourself and identifying what it is that you want to do with wargaming whether that's hobby design or professional work kaylynn

thank you so much speaking of being found online I can be found anywhere as beyond solitaire but where can we find you so you can find me on twitter at caitlyn underscore liang you can also find me on face in LinkedIn under the same name and if you're interested in learning more about the Georgetown University or gaming society we are on Facebook and Twitter at gu wargaming and we can also be found online at GE wargaming comm fantastic Caitlyn thank you so much for coming on the show and giving us your time we really appreciate your insights thank you so much for having me happy gaming everybody

Progress saved