During HammerCon 2022, we ran a timed 60-second 5 question quiz to determine which country was the biggest threat in Cyber. We created adaptive questions sets that would correspond to selections, and we were not surprised by the outcome.

The quiz ran for 4 days, had 162 unique partial submissions and 47 complete submissions.

0
Quiz Days
0
Number of quizes started
0
Quizes completed

Quick stats

China is perceived as the most significant threat in Cyber according to 66% of all participants.

Over 60% of both technical and non-technical participants of the quiz selected China as the biggest threat in Cyber

Which country do you feel is the biggest threat in Cyber?

Russia is the least significant threat among both technical and non-technical participants, with only a 6% selection rate.

100% of non-technical participants felt Iran was not the biggest threat in Cyber, since they did not pick this option.

Parody was used in some of the questions, as they were designed to surprise individual this took this quiz.

66% of technical participants could not pick a world leaders name correctly in that leader’s native language, ex Arabic, Russian, Chinese, Korean.

63% of participants cannot select a world leaders full name in English without typos.

About this quiz

This is a non-scientific representation of a survey, and it not suitable for academic references. The quiz was designed to ask participants for personal opinions between May 19-23, 2022. This period was approximately 3 months after the 2022 Russian invasion of Ukraine as part of the Russo-Ukrainian war. A time where the media, and cyber security experts were unsure of global impact and reach of this conflict, which ultimately had visible kinetic effects that were in some cases cyber-enabled. See Microsoft’s analysis on the matter with this link.

The interface adapted questions to selections made by participants

We divided responses based on how participants identified themselves in their current work-role, either as technical or non-technical individuals.

Question 1 asked if the participant currently considered themselves in a technical or non-technical role. Q1 was used to help distinguish participants into two simple demographic groups.


Question 2 asked participants Which country do you feel is the biggest threat in cyber? The options were China, North Korea, Iran, and Russia. USA was not an option for selection given intended participant pool.

Selecting a value for question 2 determined the other questions for Q3, Q4, Q5 as they related to the world leader associated to the country selected.


Questions 3 through 5 are parody questions. Please keep an open-mind regarding satire.

Question 3 was visual selection of the world leader for a corresponding country. The images used are found on our Kleared4 t-shirts, available for sale, and are relative approximations of how the world leader appears in real-life, while not being a stereotype or exact caricature of the individual. Incorrectly picking the world leader would not allow question Q4 or Q5 to appear. Q3 was designed to help establish if a participant was ready to answer questions by visually selecting a caricature of the world leader associated to the country selected in Q2.


Question 4 was selection of the world leader’s complete name in English. Some of the selection options are misspelled versions of the leader’s name to determine if participants can accurately select correct spelling. Q4 was designed to gauge accuracy in selection given that we live in an era where typos are somewhat accepted.


Question 5 was selection of the world leaders complete name in their native language. Some of the selection options are humorous and are designed to reward correct selection while poking fun at the participant for selecting the wrong choice. Q5 was designed to expose participants to native communications of a foreign language. Some incorrect responses had educational value, while others simply joked at an incorrect choice.

Participants selected country’s they felt are the biggest threats in Cyber. Most could not accurately pick the leaders name in English and fewer could pick the leaders name within that leaders native language.

Clearly we struggle being a generally uni-lingual country. We also seem to struggle with “going native” or having a deeper understanding of other world leaders, and what motivates them to be “aggressive” within cyber. Most of us can assume that the foreign players can spell Joseph Biden without issues.


About participants and convenience sampling

Participants in this quiz are made up of people that were willing to answer a quick-fire quiz from their mobile device, or personal computer while answering the quiz without supervision. Attention span, and alertness of participants was not measured. Corrections or modification to previous answers were not possible. Double submission or submission after completing one submission was not observed. The quiz was socialized within a non military endorsed event, and social media. Anyone could take the quiz as participation was voluntary.


About submissions

A complete submission was considered after arriving at question 3. Although some participants did not answer questions 3, 4 or 5, we consider the submission complete due to the unexpected question of asking for a full name of a world leader, and then asking for the native version of this name in a language the participants may have no knowledge or understanding of. Since the quiz is timed, the timer would expire before participants could lookup answers to questions, and instead forced them to guess.


Of 47 complete submissions, 7 participants stopped at question 3 due to improper image selection, i.e. picking the wrong world leader image to a country. In this case 4 technical participants and 3 non-technical participants could not distinguish, and select between a caricature likenesses of Kim and Xi. The lack of selection locked questions 4, and 5. This led to the end of quiz as the timer expired.

Judge for yourself….

Xi?
Kim?

Instrument validation

This was the first live quiz performed during this event. The quiz software was programmed, and tested to ensure accurate response recording prior to the event. Three different non-participants tested the quiz for defects, and interface problems prior to the event. All were able to complete the quiz without preparation or instructions besides clicking a link to the quiz using their personal mobile devices or personal computers.

Researcher hypothesis and bias

H1. Most participants would be able to match a caricature of a world leader without having seen the image before.

H2. Non-English names for each world leader would result in less than 75% accurate selection.

H3. The caricature images of some of the world leaders would be subject miss identification due to unfamiliarity with images.

H4. Having a timer would result in more participants not completing the quiz.

H5. Having a timer would reduce the likelihood of using a web-enabled translation services to answer question 5, as this type of question is unexpected.

B1. The researcher personally believed Russia would score higher in cyber threats, given the current global situation of that time.

Detailed results

Q1. Are you currently in a non-technical or technical role?

15 Non-technical role32 Technical role
47 participants

Non-technical responses 15 participants got to at least question #3

Q2. Which country do you feel is the biggest threat in cyber?

73.3% China13.3% Russia13.3% North Korea0% Iran
None of the non-technical participants picked Iran as the biggest threat in cyber

Which country do you feel is the biggest threat in cyber? non-technical role responses


As a reminder, questions 3 through 5 are designed with satire in mind.

China 11/15 Non-technical role responses

Q3. Which person leads China? 

5/11 correctly picked Xi Jinping image3/11 picked Kim Jong-un2/11 picked Sayyid Ali Hosseini Khamenei1 person did not answer
Almost half of non-technical participants that selected China failed to pick the correct image

27 % of non-technical participants that selected China incorrectly matched the leader of China to a caricature of Kim Jong-un

46% of non-technical participants that selected China are likely to pick a caricature image of another world leader vs the correct leader

Q4. What is the leader of China called? 3/5 picked Xi Jinping

60% of non-technical participants that selected China correctly matched the leader of China’s full name in English.

Q5. What is Xi’s name in Chinese?

3/5 习近平 Xi Jinping2/5 people picked 孫子 Sun Tsu
Unsurprisingly, Sun Tsu and cyber go together due to unusual quotes in military tradoc

60% of non-technical participants correctly matched the leader of China’s full name in Chinese.

40% of non-technical participants incorrectly matched the leader of China’s full name in Chinese to Sun Tsu.


North Korea 2/15 Non-technical role responses

Q3. Which person leads North Korea? 2/2 correct image selection

Q4. What is the leader of North Korea called?

2/2 Kim Jong-un0/2 Kim Jong-um
All Non-technical participants picked the North Korean leader’s name correctly in English

100% of non-technical participants correctly matched the leader of North Korea’s full name in English.

Q5. What is Kim’s name in Korean?

1/2 김정은 picked Kim1 person did not select
The other person did not pick a response given that a 60 second timer was used during the quiz.

50% of non-technical participants correctly matched the leader of North Korea’s full name in Korean.


Russia 2/15 Non-technical role responses

Q3. Which person leads Russia? 2/2 correct image selection

Q4. What is the leader of Russia called? 2/2 Vladimir Vladimirovich Putin

Q5. What is Vlad’s name in Russian?  Владимир Владимирович Путин

100% of non-technical participants correctly matched the leader of Russia’s image, full name in English and Russian.


Technical responses 32 participants got to at least question #3

Q2. Which country do you feel is the biggest threat in cyber?

62.5 % China21.8 % North Korea12.5 % Iran3% Russia
Individuals that self identified as being in technical roles made the majority of responses to the quiz

Which country do you feel is the biggest threat in cyber? Technical roles

As a reminder, questions 3 through 5 are designed with satire in mind.

China 20/32 Technical role responses

China was picked amongst most technical participants and this stock image meta-data contains more history than most. “Famous Terracotta Army in Xi’an, China. The mausoleum of Qin Shi Huang, the first Emperor of China contains collection of terracotta sculptures of armored men and horses.”

Q3. Which person leads China?  20/20 correctly picked Xi Jinping image.

100 % of technical participants that chose China correctly matched the leader of China to a caricature of Xi Jinping

Q4. What is the leader of China called?

8/20 Xi Jinping8/20 Xi Jinpeng4/20 Xi Jenping
The participant pool for this quiz was more likely to choose a misspelled version of a world leaders full name than the correct option

60% of technical participants that selected China are likely to pick a minor misspelling of a world leader from another country.

We can assume non-American people, OK.. maybe a few Americans as well, would misspell our current President as Bidin/Bidden vs Biden.

Q5. What is Xi’s name in Chinese? 

5/20 习近平 Xi Jinping8/20 蝙蝠汤 / bat soup2/20 任正非 / Ren Zhengfei2/20 孫子 / Sun Tsu3/20 did not answer
Technical participants seemed to pick the most controversial of all options

25% of technical participants correctly matched the leader of China’s full name in Chinese

40% of technical participants incorrectly matched the leader of China’s full name in Chinese to “Bat Soup”

20% of technical participants incorrectly matched the leader of China’s full name in Chinese to either Ren Zhengfei of Huawei, or Sun Tsu


North Korea 7/32 Technical role responses

Q3. Which person leads North Korea? 3/7 correct image selection,

3/7 correct image selection4/7 picked the leader of China instead
Most technical participants that chose North Korea incorrectly picked the caricature of Xi Jinping

57% of technical participants that chose North Korea were likely to pick a caricature of another leader of Asian descent.

4/7 picked the leader of China instead, and blocked questions 4, and 5 by picking the wrong image.

Q4. What is the leader of North Korea called?

0/3 Kim Jong-un3/3 Kim Jong-um
All technical and non technical participants that selected North Korea selected a misspelled version of Kim Jong-un

100% of technical participants that chose North Korea incorrectly matched the leader of North Korea’s full name in English.