Competency levels in Skill Profiles are determined primarily by two data sets:
- The difficulty of Exam and Quiz questions & correctness of user responses
- Hands-on Lab complexity & results from the validation step (for a subset of Labs)
To understand the distribution of skill competencies on your Skill Profiles dashboard, it is helpful to understand the assessment design.
Beginner level questions are designed to gauge users' familiarity with the fundamentals of a given service, its place among other services and how it connects with them, and its general use cases. The beginner level is the one level where questions can solely focus on what the service is, whereas Intermediate and Advanced questions focus on how to best use the service(s) based on different business and technical objectives. Beginner level questions are useful for people with some computing experience, but who are new to a specific service or cloud computing.
Intermediate level questions gauge the prerequisite and fundamental knowledge of distributed computing and cloud service architectures, as well as the basic understanding of how a given service functions. Intermediate level questions focus on assessing the user's understanding of how to use the service to achieve basic tasks such as planning and designing cloud architecture, creating applications for the cloud, and maintaining a secure, stable and cost-effective cloud service. Intermediate level questions are useful for people who understand how cloud computing works, and have some familiarity with services, but are expanding their knowledge to new areas.
Advanced level questions assess knowledge that comes with years of experience with how a service or related service works, as well as how to use the service to achieve specific tasks. Advanced questions assess users on complex concepts and often provide scenarios with multiple (sometimes competing) variables that require the user to weigh tradeoffs and think critically to analyze a given situation.
Detailed reference knowledge is not required to correctly answer advanced level questions. It is not the goal of advanced questions to test encyclopedic knowledge of a given service. Rather, advanced questions are designed to gauge the complex model and critical thinking that correlates with the experience levels of expert-level practitioners in a given domain.