![]()
This section highlights the research done in 2010 by our SILC Members in connection with our Spatial Intelligence and Learning Center project.
View our current SILC Showcase
January '10 |February '10 |March '10 | April '10 | May '10 | June '10 | July '10 | August '10 | September '10 | October '10 | November '10 | December '10
Have you ever seen a car that has been in an accident and tried to imagine what happened? Often it is possible to work backwards from the current shape of an object to deduce what happened to it, e.g., a head on collision with a tree. This reasoning requires a spatial cognitive skill - a mental transformation of an object. Mental transformation refers to the ability to alter an internal representation of an object in order to imagine what that object used to look like before some event or what it might look like in the future.
We are studying how people develop this skill. One avenue of our research has been to study mental transformation in experts. Strong mental transformation skills are essential in the field of geology. Geology is a historical science that takes what is observable and tries to deduce what has happened over time to result in the current state of affairs. In particular, geologists use the present spatial relations to figure out what transformations have occurred. This mental reasoning may take place at many scales, from tectonic to microscopic. For example, field geologists study the deformational history of rocks and regions by studying the spatial configuration of geological features in an outcrop and how they fit with other observations in a surrounding area. Just as the bent and rent metal of a car tells a story, so too the geological history is revealed by the bends and breaks, folds and faults, in rocks. (see fig. 1).
.jpg)
Fig. 1a
.jpg)
Fig. 1b
The current line of research aims to understand how expert geologists reason about mental transformations. Geologists self-report that they look at an outcrop and play back in their mind the sequence of transformations, mentally animating the transformations from the present spatial configurations back to horizontal sedimentary layers. An initial study examined if geologists are objectively able to make such mental transformations, and, if they are, is the skill domain specific or domain general. Previous studies of chess expertise (Chase & Simon, 1973) suggest that expert reasoning is domain specific, in which case geologists should only be able to perform mental transformations on objects that have been altered in geologically relevant ways. In contrast, if geologists are able to perform mental transformations on any object independent of the type of alteration it suggests they have a domain general skill.
Geologists (n=16) were compared to two control groups from other academic fields. All groups had the same level of education (Ph.D.). One control group came from another science that requires spatial reasoning (Chemists, n=14) and one that requires verbal reasoning (English Professors, n=10). The participants were presented with words that were transformed in one of three ways, and asked to identify the word. To make the task more demanding additional characters were added in between each letter of the word (see fig. 2). Words were broken up into pieces along diagonal lines. These pieces were translated as if faulted (see fig. 3) or were randomly displaced (see fig. 4).
.jpg)
Fig. 2
.jpg)
Fig. 3
.jpg)
Fig. 4
Geologists were significantly better than both control groups suggesting the geologists have a domain general ability to make mental transformations that is superior to novices (Shipley et al, 2009). One explanation for this skill is that geologists are particularly good at disembedding - finding and attending to specific structures within a complex array. We tested this with another set of words where the transformation separated all of the pieces making it easier to see which pieces belonged together and thus mentally undo the transformation (see fig. 5).
.jpg)
Fig. 5
All three groups performed better on these words, however Geologists still outperformed both control groups. This finding suggests that while disembedding is helpful for this task, it is not the sole explanation for the Geologist’s skill.
Geologists report that students often have trouble mentally transforming spatial structures. By characterizing this skill, we should be able to help educators provide students with strategies for visualizing such transformations. However, it is not yet clear what about geoscience education produces this skill. Future studies will examine how mental transformation skills develop, and study its importance for student retention and achievement.
Children’s early shape concepts represent the building blocks for later mathematical knowledge (Clements & Sarama, 2007). As preschoolers begin labeling shapes in their environment, they must distinguish features and patterns and create abstract categories of each shape. Yet young children find this very difficult! Preschool children start out categorizing shapes by visual similarity and orientation irrespective of geometric properties (Burger & Shaughnessy, 1986). These concepts are global and holistic in nature, in which the most salient shape properties bind together to form an overall feature or a ‘gestalt view’ of each shape (Ganel & Goodale, 2003; Keil, 1989; Smith, 1989; Tada & Stiles, 1996). For instance, the angle on top of a typical triangle is the most distinguishing feature and thus defines the overall concept for the child (e.g., triangles have a point on top and wide horizontal ‘bottoms’). If children see a triangle that is turned on its side or has irregular angles (e.g., obtuse, scalene triangles), they will say it is not a true triangle. Only later do they shift to rule-based classification systems that rely on the number of sides or angles for shape identification (Clements, Swaminathan, Hannibal, & Sarama, 1999; Keil, 1989).
In a series of studies we explore how different learning experiences influence children’s developing shape concepts. In one such study, we examine how dialogic inquiry (i.e., questions that pose a dilemma/prompt curiosity) and physical exploration influence preschool children’s shape learning.
Preschool children were randomly assigned to one of three groups. In guided play, the experimenter helped children ‘discover’ each shape’s features by asking questions and prompting physical exploration of circles, triangles, rectangles, and pentagons (+dialogic inquiry, + physical exploration). In direct instruction, children were taught rule-based classifications for shapes in a passive learning style (- dialogic inquiry, -physical exploration). In the control condition, children participated in a dialogic reading activity for approximately the same amount of time as the shape lessons. To assess shape knowledge, groups were asked to complete a shape sorting task (Satlow & Newcombe, 1998). Children were shown 10 novel instances of typical, atypical, and nonvalid forms of each shape (40 total) and asked to place ‘real’ instances of each shape in a special box and the ‘fake’ shapes in a trashcan.
To determine the extent children’s category decisions were guided by rule-based classification systems versus visual similarities, rates of rejection were calculated across typical, atypical, and nonvalid shapes. As hypothesized, children in the control condition appeared to rely on visual similarity when sorting shapes, signified by small rejection rates of typical shapes and larger rejection rates for atypical and nonvalid shapes (see Figure 1). Conversely, children in both experimental conditions used rule-based classification systems to sort shapes, indicated by small rejection rates for typical and atypical shapes. Also, guided play showed a slight advantage over direct instruction. In Figure 2, guided play and direct instruction appear equal in learning outcomes for simple, familiar shapes (e.g., circles), yet children in the guided play condition showed significantly superior geometric knowledge for a novel, highly complex shape (pentagon).
These results suggest both direct instruction and playful learning approaches promote rule-based shape concepts; however, guided play may be more advantageous for complex concepts. Future research should explore how guided play may facilitate knowledge acquisition and concept formation for complex concepts in other domains. Additional research should explore the differential impact of dialogic inquiry and active exploration on the learning process.



Recent research shows that the spatial language parents use when talking to their children predicts their child's spatial language development (Pruden & Levine, in preparation). But parent spatial talk does not fully account for child spatial language. This study investigates whether the gestures parents produce along with spatial language have added value in predicting children's acquisition of spatial language, over and above spatial language alone.
There are several reasons to expect that this may be the case. First, with respect to language acquisition in general, children are sensitive to the gestures of others in both conversational and pedagogical situations (Goldin-Meadow, 2003). At home, parents' gestures predict children's gestures and, in turn, their vocabulary size (Rowe & Goldin-Meadow, 2009). In instructional situations, children learn more from spoken instruction if it is accompanied by gesture than if it is not (Church, Ayman-Nolley, & Mahootian, 2004; Valenzeno, Alibali, & Klatzky, 2003). Moreover, children can learn from gesture even when it conveys information that is not conveyed in speech (Singer & Goldin-Meadow, 2005). Second, gesture may be particularly good at conveying spatial information as it itself is highly spatial and thus has the potential to highlight and enhance the spatial information encoded in speech. That is, gesture may be particularly well suited to helping the child acquire spatial language because, unlike language, it easily captures the continuous nature of spatial information. For example, when talking about a "tall building," it is possible to provide cues to the meaning of the word "tall" by producing an over-the-head gesture, or by pointing to the top of the building. Finally, parents routinely produce gestures along with their spatial talk, providing children with the opportunity to learn from gesture (Levine, Ratliff, Huttenlocher, & Cannon, under review).
Using data from 52 parent-child dyads, we examined parent spatial talk, and the gestures that accompanied this talk, produced during naturalistic interactions at home recorded at 8 time points from 14-42 months of age. We focused our analysis on deictic and iconic gestures as they had the greatest potential to represent space or indicate spatial features of the environment. We also examined the child's use of spatial language during these interactions. For both parents and children, we focused on three categories of spatial talk: dimensional adjectives (e.g., big, little, tall, short), shape terms (e.g., circle, square), and spatial features (e.g., straight, curved, bent, flat). We addressed two specific questions: (1) Do parents differ in the amount of gesture used during spatial language? (2) If so, do differences in how often parents use spatial language with gesture, compared to how often they use it without gesture, provide added value in predicting children's spatial language production?
Parents varied widely in how often they produced gestures along with their spatial utterances. On average, parents gestured with 16% of their spatial utterances, but some parents never gestured and one gestured 44% of the time. Using a multiple linear regression, we found that the number of spatial utterances parents produce accompanied by gesture significantly predicted children's spatial word types, controlling for parent spatial utterances without gesture and parent non-spatial utterances (Β = .65, p < .01).
Using a multiple linear regression analysis, we found that parent spatial utterances with gesture, parent spatial utterances without gesture, and parent non-spatial utterances as predictors of children's spatial types. Model 1 showed that the total number of parent spatial utterances that were accompanied by gesture significantly predicted children’s spatial types from 14 to 42 months and accounted for over 34% of the variance in children’s spatial types (Β = .60, p < .001). Models 2 and 3 show that parent spatial utterances with gesture remained a significant predictor of child spatial types even after we controlled for parent spatial utterances without gesture and parent non-spatial utterances.
Gesture may be even more helpful in the context of spatial words than in other contexts. Unlike spoken language, gesture is well suited to capturing the continuous information of the spatial world. For example, gesture has the potential to play a targeted role in the acquisition of spatial language by illustrating the spatial notions reflected in speech—producing a curved gesture while saying that the puzzle piece is curved could help the child figure out what the word curved means.
Our findings demonstrate that parent gesture produced in the context of spatial talk is related to children's spatial language. However, this relationship is correlational: the findings do not show that parent gesture produced along with spatial talk plays a causal role in fostering child spatial language. Our current research attempts to explore the causal role between these variables by manipulating the type of input children receive in a spatial context—puzzle play— to better identify the respective contributions of spatial language and gesture in children's acquisition of spatial language.
Cross-sectioning, also referred to as “penetrative” thinking (Kali & Orion, 1996), is a particular spatial visualization skill that involves inferring a 2D representation of a 3D structure, and vice versa (Cohen & Hegarty, 2007). This imaginary slicing of a 3D object to a 2D plane is an essential skill for many of the sciences, ranging from anatomical cross-sections in biology and neuroscience to cross-sections of landforms in geology (Cohen & Hegarty, 2008). However, the development of cross-sectioning ability has not been uniquely identified in relation to other measures of spatial ability (e.g., mental rotation), in part because of a lack of adequate measures and the unknown age at which this ability emerges. Thus, we do not know the developmental trajectory of cross-sectioning skills and how this skill relates to spatial ability more broadly.
In our current study, we created a new method for assessing cross-sectioning skills in young children by using brightly colored foam shapes as the stimuli (see Figure 1 for the sample item). We also measured children’s performance on a mental rotation task and the water-level task. Finally, we contrasted cross-sectioning performance using the real 3D objects with a 2D method using photographs of the actual shapes. Thus, we aim to successfully measure children’s cross-sectioning skills to determine a) how cross-sectioning skills develop between the ages of 3 and 9 years, b) the association between cross-sectioning skills and other spatial reasoning tasks, and c) how the method of assessment impacts performance.
Children successfully completed the cross-sectioning task using both the 3D and 2D methods. This suggests that children do reason about cross-sections and this ability can be assessed. Further, this ability develops over time as evidenced by a significant increase in performance with age. Difficulty of test items generally represented two categories: congruent items were easier in that the cross-section resulted in a similar shape to the overall object (e.g., cone cut vertically to result in a triangle cross-section), whereas incongruent items were harder due to the cross-section resulting in a different shape than the overall object (e.g., pyramid cut horizontally to result in a square cross-section).
Positive correlations between the mental rotation and cross-sectioning tasks were present across the 5 to 8 year age range. However, when controlling for age, mental rotation was not a significant predictor of cross-sectioning performance, which suggests these tasks are not measuring the same skills, particularly in children younger than 8 years old. Further, there was no significant correlation between performance on the cross-sectioning and water-level tasks. Thus, cross-sectioning ability is somewhat independent of both spatial perception and mental rotation. Additionally, there was a benefit of using the 3D task but only for 5-, 6-, and 7-year-olds. The 3- to 4-year-olds and 8- to 9-year-olds performed equally well using both versions of the task. We are currently examining if preschool children rely on a simple shape matching strategy rather than a spatial visualization process, and whether cross-sectioning is related to a more general spatial visualization skill by comparing cross-sectioning performance to performance on a version of a paper folding task that is appropriate for young children.
Pencil and paper worksheets are a staple of education. But drawings are hard to grade, and pencil and paper worksheets cannot provide feedback based on what a student is doing. A new technology developed by SILC researchers, sketch worksheets, uses artificial intelligence software to provide immediate feedback to students and help instructors with grading. For the first time Fall quarter, sketch worksheets were used as part of student work in a real course. This pilot experiment is a first step towards making sketch worksheets broadly available in education.
Why make sketch worksheets? Results from artificial intelligence in education research indicate that software tutors can provide significant benefits for students, in part by providing immediate feedback. Unfortunately, intelligent educational software has rarely been built for spatial domains. A major barrier is that the software needs to be able to see a student’s sketch the way a teacher would. SILC research is tackling this problem head-on, by creating CogSketch, a new kind of sketch understanding system. CogSketch incorporates models of human visual processing and spatial reasoning, based on cognitive science research in AI, cognitive psychology, and vision science. (For an example of CogSketch's visual processing abilities in action, please see the April 2009 showcase.)
Understanding the sketch is half of the problem. The other half is providing feedback to students, and assessment information to instructors. Sketch worksheets incorporate a hidden sketch, made by an instructor, providing a kind of “answer key” for the worksheet. This sketch is compared against the student’s work. The similarities and differences between them provide the basis for feedback. The comparison process itself is based on a cognitive model of human analogical matching, also developed by SILC researchers. Worksheet authors can specify what feedback CogSketch should provide to students based on this comparison, as well as provide grading rubrics for assessment.
To refine the software, the CogSketch team worked with Prof. Brad Sageman, Professor of Earth and Planetary Sciences of Northwestern University, to create sketch worksheets for his Physical Geology course. The first assignment was for extra credit, involving worksheets where students identified faults and their properties in photographs of geological sections, and reconstructed a sequence of geological processes based on a diagram. The first assignment went sufficiently well that a second assignment, this time required, was developed, where students sketched the reservoirs and flows of the carbon cycle, annotating it with the magnitudes of the flows. Students were able to use sketch worksheets with only minimal training, and the CogSketch team got valuable feedback that has helped them refine the software to make it better for future users.
.jpg)
Fault Worksheet Sketch
This is the first step on a long journey: Many further studies will be required to improve the software and the cognitive models it relies on, to find out how we can best improve student learning. We hope that this journey leads to sketch-based educational software that helps students learn spatially.
To find out more:
CogSketch is publicly available from SILC’s web site (www.spatiallearning.org). The download contains sample worksheets and the full worksheet authoring environment.
A paper on sketch worksheets will be presented at the Innovative Applications of Artificial Intelligence conference in July.
When was the last time you got lost? Have you ever travelled to a new place without a map only to find that minutes later you were wandering around desperately looking for a familiar landmark or a person who can orient you? Have you ever taken the subway to a different part of town and exited to the street level only find yourself completely disoriented? Why is it that we all have that friend who is constantly getting lost sometimes even in his/her hometown? At the same time, why is it that some of us are just not only naturally good at navigating but actually enjoy the thrill of exploring and learning about our environment? The project detailed below touches on some of these questions by investigating how individuals differ in their acquisition and development of spatial knowledge.
Classical frameworks on the acquisition and development of spatial knowledge (Shemyakin, 1962; Siegel and White, 1975) suggest that individuals first learn landmarks followed by the routes that connect them, eventually integrating these into a more holistic and metric survey level representation. During the last decade, it has been proposed that spatial microgenesis does not always follow a strict stage-like development but rather proceeds in a more continuous or quantitative fashion (Montello, 1998). The continuous framework proposes that some individuals are capable of integrating complex spatial information that allows them to perform accurate metric calculations with minimal exposure in the environment.
We have been working on a project investigating the behavioral and neural correlates of the acquisition and development of spatial knowledge of an unfamiliar university campus (Ambler campus of Temple University) over a period of three weeks, with particular emphasis on individual differences. In their first visit to the campus, subjects learned two routes located at different areas of the campus and were asked to remember the name and position of several buildings on each route. During the following weeks, subjects learned these routes for a second and third time together with a connecting route. At each stage, their integrated configurational knowledge was probed by asking them to complete a variety of online and offline tasks including direction estimation, distance estimation and sketch mapping (see figure 1). A subset of subjects also participated in an fMRI experiment where a recognition task was used to probe the subject's memory for buildings around the campus.
Behavioral results revealed large individual differences in the initial acquisition of spatial knowledge, suggesting that spatial microgenesis does not necessarily follow a stage-like development (as proposed by classical frameworks) but proceeds in a continuous fashion. This was particularly true during initial acquisition (first session) where several subjects showed evidence of metric knowledge and developed accurate representations of the environment with minimal exposure. Data from the fMRI experiment further complemented these results. A whole brain analysis that looked at performance-related activations revealed an exclusive activation of the retrosplenial cortex (RSC) among the top performers. It seems that while both top and bottom performers were able to accurately recall buildings from the Ambler campus (recognition accuracy was above 85% for both groups) the top performers were not only identifying these buildings but possibly situating them within their mental representation of the campus. This is consistent with the role of the RSC in supporting mechanisms that allow for situating a scene within the broader spatial environment (Epstein, 2008; Wolbers & Wolbers & Büchel, 2005) by integrating egocentric spatial information into a survey-level representation during navigation.
Perhaps one of the main drawbacks of the real-world study was that the testing procedure was too long (9 hours distributed over 3 weeks) and required a certain amount of commitment from the participants. In an effort to collect more data from different samples of the population, we created a virtual model of the Ambler campus (see figure 2). The model was created using Google Sketchup1 and later exported to the gaming engine Unity 3D2 allowing subjects to actively navigate around the virtual campus. We are now currently working in developing web-based application which will structure the virtual world and the different spatial tasks together in an immersive videogame-like experience. Although subjects tested in the desktop virtual reality environment will not benefit from proprioception, pre-pilot testing suggests that the previous three-week testing procedure can be reduced to a 90 minute session. Having the real-world data as a basis for comparison, we hope that Virtual Ambler will allow us to test a larger sample of the population and answer specific questions regarding individual differences in spatial ability and knowledge transfer.
1http://sketchup.google.com/
2http://unity3d.com/
.jpg)
Figure 1 - The Ambler Campus: The Ambler campus with the two main routes and the two connection routes. The table on the top left corner details the testing procedure over the three week period.
.jpg)
Figure 2 - Virtual Ambler: Snapshots from the two routes of the virtual Ambler campus
How do we remember locations and find our way back to them? After all, we regularly find our way, even, like our ancestors, without a GPS. Avoiding getting lost matters, as does finding your car in the middle of the night after getting off the airport shuttle, jet-lagged and weighted down with baggage. In addition to being able to represent locations spatially, we can also talk about them, using language like prepositions, which tell us about the relationship between things. For example, in the real world, you could walk to or point to the car's location in Figure 1, and also describe its position as under the tree beside the flowers and in front of the house. Does spatial language bear any relationship to our non-spatial representations of where things are? How do these systems (verbal and non-verbal) develop in relationship to each other?

Figure 1
There are different ways people can remember locations and navigate to them. One is ego-centric (related to ourselves), and another is truly spatial. You can remember that something is on the left of you (egocentric), and you can also remember that it is north (spatial). If you walk out the door of our infant lab, for example, the parking lot is on your left, and also to the west. No matter where you face, the parking lot will always be west of the lab, but if you turn 180 degrees to face the door, the parking lot will now be on your right. Place learning, the interest of this study, is the ability to calculate spatial locations using distances and directional information from distant features, regardless of egocentric information (Newcombe, Huttenlocher, Drummey & Wiley, 1998; Sluzenski, Newcombe, & Satlow, 2004).
In young children, there is long developmental trajectory of spatial skill development. Initially, infants develop an awareness of their own movements, (Landau & Spelke, 1988; Lepecq & Lafaite, 1989; Rieser & Heiman, 1982; Tyler & McKenzie, 1990), and this egocentric information gradually is supplemented with spatial coding. In the second year of life, place learning emerges between 20-24 months (Newcombe et al., 1998; Sluzenski et al., 2004). For example, when children are faced with the task of finding a hidden object after a position change, only children older than 22 months can use external features (the skill involved in place learning) to increase the accuracy of their searches (Newcombe et al., 1998).
Developmentally, there are different theories of how language and spatial concepts emerge. The specificity hypothesis (Gopnik & Meltzoff, 1986; 1987) suggests that during the single word acquisition period of language development (15-24 months) there is a relationship between the emergence of linguistic skills and non-linguistic skills that rely on shared foundational knowledge (e.g. spatial navigation and spatial language skills). Prepositions, specifically, have been discussed as emerging from and capturing infants' perceptions of spatial relations, such as the locations of objects, as well as the path component of action events. For example, actions that involve going in or moving out will be captured as the prepositions "in" and "out" (Mandler, 2006). By these accounts, similar domains in cognition and language would be expected to show a relationship to each other during development.
The purpose of this experiment was to explore the relationship between prepositions and place learning at an age when both are emerging, looking at how children are able to begin to remember locations, and whether or not this spatial awareness can be seen in their first words. Children were tested using a spatial task adapted from the Morris water maze (Morris, 1984), and the MacArthur Communicative Development Inventory. In the place learning task, children were placed in a round enclosure and a puzzle was hidden under the floor at one location. Before each trial, children were spun, to disorient them, and placed down at a different starting position, and asked to find the hidden puzzle. Their search types and success at finding the puzzle were coded.

Figure 2: The place learning task apparatus. Note that during the task the puzzle was hidden under the pool’s floor.
What we found was that older children had significantly larger expressive vocabularies than younger. In addition, they had significantly stronger spatial skills, as shown by searching in the correct area of the pool more often than younger children, as well as pinpointing the goal location (place learning) (see Figure 3). Although language and place learning both correlated with age, once age was partialled, there was no correlation between them. The crucial exception was prepositions, the acquisition of which was correlated with place learning. The finding of a spatial- specific language linkage, as both language and place learning undergo rapid change, suggests an intriguing story about the interaction between various cognitive systems, beginning as early in development as when the systems themselves emerge.

Figure 3
Read our latest updates and incoming news below or for SILC in the press go to our Press Room (click on PRESS ROOM icon above).
Read about past SILC News in our Archive.