MOVING PAST THE VERB
Social Studies Levels of Depth of Knowledge for Social Studies
bbDepth-of-Knowledge Levels for Four Content Areas
Norman L. Webb
Interpreting and assigning depth-of-knowledge levels to both objectives within standards and assessment items is an essential requirement of alignment analysis. Four levels of depth of knowledge are used for this analysis.
Level 1 Recall of Information
Level 1 asks students to recall facts, terms, concepts, trends, generalizations and theories or to recognize or identify specific information contained in graphics. This level generally requires students to identify, list, or define. The items at this level usually ask the student to recall who, what, when and where. Items that require students to “describe” and “explain” could be classified at Level 1 or 2 depending on what is to be described and explained. A Level 1 “describe or explain” would recall, recite or reproduce information. Items that require students to recognize or identify specific information contained in maps, charts, tables, graphs or drawings are generally level 1.
Level 2 Basic Reasoning
Level 2 includes the engagement of some mental processing beyond recalling or reproducing a response. This level generally requires students to contrast or compare people, places, events and concepts; convert information from one form to another; give an example; classify or sort items into meaningful categories; describe, interpret or explain issues and problems, patterns, reasons, cause and effect, significance or impact, relationships, points of view or processes. A Level 2 “describe or explain” would require students to go beyond a description or explanation of recalled information to describe or explain a result or “how” or “why.”
Level 3 Complex Reasoning
Level 3 requires reasoning, using evidence, and a higher level of thinking than the previous two levels. Students would go beyond explaining or describing “how and why” to justifying the “how and why” through application and evidence. The cognitive demands at Level 3 are more complex and more abstract than Levels 1 or 2. Items at Level 3 include drawing conclusions; citing evidence; applying concepts to new situations; using concepts to solve problems; analyzing similarities and differences in issues and problems; proposing and evaluating solutions to problems; recognizing and explaining misconceptions or making connections across time and place to explain a concept or big idea.
Level 4 requires the complex reasoning of Level 3 with the addition of planning, investigating, or developing that will most likely require an extended period of time. The extended time period is not a distinguishing factor if the required work is only repetitive and does not require applying significant conceptual understanding and higher-order thinking. At this level the cognitive demands should be high and the work should be very complex. Students should be required to connect and relate ideas and concepts within the content area or among content areas in order to be at this highest level. The distinguishing factor for Level 4 would be evidence through a task or product that the cognitive demands have been met. A Level 4 performance will require students to analyze and synthesize information from multiple sources, examine and explain alternative perspectives across a variety of sources and/or describe and illustrate how common themes and concepts are found across time and place. In some Level 4 performance students will make predictions with evidence as support, develop a logical argument, or plan and develop solutions to problems.
Many on-demand assessment instruments will not include assessment activities that could be classified as Level 4. However, standards, goals, and objectives can be stated so as to expect students to perform thinking at this level. On-demand assessments that do include tasks, products, or extended responses would be classified as Level 4 when the task or response requires evidence that the cognitive requirements have been met.
Source of Challenge Criterion
The Source of Challenge criterion is only used to identify items where the major cognitive demand is inadvertently placed and is other than the targeted social studies content, concept, skill and application. Excessive reading demands, cultural bias, or specialized knowledge could be reasons for an item to have a source of challenge problem. Such item characteristics may cause some students to not answer an assessment item or answer an assessment item incorrectly even though they have the social studies content knowledge, understanding and skills being assessed. Items with an appropriate source of challenge level will differentiate between those students who have the social studies knowledge and understanding the assessment item intends to measure from those students who do not have this knowledge.