When is Consciousness Learned?

Consciousness-learned

Continuing with the theme of innateness and durability from my last post, consider the question: are humans born with consciousness? In a ground-breaking (and highly contested) work, the psychologist Julian Jaynes argued that if only humans have consciousness, it must have emerged at some point in our human history. In other words, consciousness is a socially and culturally acquired skill (Williams 2011).

To summarize his argument: until as recently as the Bronze age (the third millennium BCE) he purports that humans were not, strictly speaking conscious. Rather, humans experienced life in a proto-conscious state he refers to as “bicameralism.” Roughly around the “Axial Age” (cf Mullins et al. 2018), bicameral humans declined and conscious, “unicameral” humans emerged.

One piece of evidence he deploys in support of his thesis is that the content of the Homeric poem the Iliad is substantially different than the later Odyssey. The former, he argues, is devoid of references to introspection, while the latter does have introspection. Jaynes argues a similar pattern emerges between earlier and later books of the Christian Bible. In a recent attempt  (see also Raskovsky et al. 2010) to test this specific hypothesis quantitatively,  Diuk et al. (2012), use Latent Semantic Analysis to calculate the semantic distances between the reference word “introspection” and all other words in a text. Remarkably, their findings are consistent with Jaynes’ argument  (see also: http://www.julianjaynes.org/evidence_summary.php).

Screenshot from 2018-12-19 17-47-55.png
From Diuk et al. (2012): “Introspection in the cultural record of the Judeo-Christian tradition. The New Testament as a single document shows a significant increase over the Old Testament, while the writings of St. Augustine of Hippo are even more introspective. Inset: regardless of the actual dating, both the Old and New Testaments show a marked structure along the canonical organization of the books, and a significant positive increase in introspection.”

Is Consciousness Learned in Childhood?

If consciousness, as Jaynes argued, is a product of social and cultural development, does this also mean that we each must “learn” to be conscious? Some contemporary research suggests something like this might be the case.

To begin we need a simple definition: consciousness is our “awareness of our awareness” (sometimes called metacognition). A problem with considering the extent of our conscious awareness is the normative baggage associated with “not being conscious.” For the folk, it is somewhat insulting to say people are “mindlessly” doing something, and we tend to value “self-reflection.” Certainly this is a generalization, but let’s bracket the notion that non-conscious experience is somehow less good than being conscious. The bulk of what the brain does is below the level of our awareness. For starters, when we are asleep, under general anesthesia, or even in a coma, the brain continues to be quite active. Moving to our waking lives, the kinds of skills and habits that Giddens (1979) confusingly calls the “practical consciousness” is deployed at a speed that outstrips our ability to be aware it is happening until after the fact. The kind of skillful execution associated with athletes and artists, for instance, is often associated with Csikszentmihalyi’s “flow” precisely because there is a “letting go” and letting the situation take over. All this is to say we are conscious far less than we probably think. Indeed asking us when we are not conscious  (Jaynes 1976:23):

…is like asking a flashlight in a dark room to search around for something that does not have any light shining upon it. The flashlight, since there is light in whatever direction it turns, would have to conclude that there is light everywhere. And so consciousness can seem to pervade all mentality when actually it does not.

A second major confusion is the assumption that consciousness is how humans learn ideas or form concepts. As we discuss elsewhere (Lizardo et al. 2016), memory systems are multiple, and while we learn via conscious processes, the bulk of what we learn is via non-conscious processes in “nondeclarative” memory systems (Lizardo 2017). This is especially the case for the most basic concepts we learn from infancy onward. In fact, Durkheim’s argument that it is through ritual—embodied experience—that so-called “primitive” groups learned the “basic categories of the understanding” more or less pre-figures this point (Rawls 2001).

Rather than the experience-near associated with everyday life, consciousness involves introspection and “time traveling” associated both with reconstructing our own biographies from memory and imagining possible (and impossible) futures. A recent school of thought in cognitive science—referred to as “enactivism”—takes a rather radical approach in arguing that the vast majority of human cognition is not, strictly speaking, contentful (Hutto and Myin 2012, 2017). Indeed, a lot of “remembering” does “not require representing any specific past happening or happenings… remembering is a matter of reenactment that does not involve representation” (Hutto and Myin 2017:205). But, what about autobiographical remembering involved in introspection and self-reflection which we might consider the hallmark of consciousness?

To answer this — within the broader enactivist project — they draw on group of scholars who argue that autobiographical memory is “a product of innumerable social experiences in cultural space that provide for the developmental differentiation of the sense of a unique self from that of undifferentiated personal experience” (Nelson and Fivush 2004:507). These scholars find that “a specific kind of memory emerges at the end of pre-school period”  (Nelson 2009:185). Such a theory offers a plausible explanation for “infantile amnesia” — the inability to recall events prior to about three or four — an explanation much less ridiculous than Freud’s contention that these memories were repressed so as to “screen from each one the beginnings of one’s own sex life.”

These theorists go on to argue that “a new form of social skill” associated with this “new type of memory” (Hoerl 2007:630). This skill is “narrating” one’s experience. Parent’s reminiscing with children play a central role in the acquisition of this skill (Nelson and Fivush 2004:500):

…parental narratives make an important contribution to the young child’s concept of the personal past. Talking about experienced events with parents who incorporate the child’s fragments into narratives of the past not only provides a way of organizing memory for future recall but also provides the scaffold for understanding the order and specific locations of personal time, the essential basis for autobiographical memory.

Returning to Jaynes, we find a remarkably analogous description of the emergence of consciousness as  the “development on the basis of linguistic metaphors of an operation of space in which an ‘I’ could narratize out alternative actions to their consequences” (Jaynes 1976:236). That is, we could assert, consciousness is this social skill emerging from the (embodied and social) practice of reminiscing with parents and classmates (or the like) when we are around three years old.

REFERENCES

Diuk, Carlos G., D. Fernandez Slezak, I. Raskovsky, M. Sigman, and G. A. Cecchi. 2012. “A Quantitative Philology of Introspection.” Frontiers in Integrative Neuroscience 6:80.

Giddens, A. (1979). Central problems in social theory. Berkeley: University of California press.

Hoerl, C. 2007. “Episodic Memory, Autobiographical Memory, Narrative: On Three Key Notions in Current Approaches to Memory Development.” Philosophical Psychology.

Hutto, Daniel D. and Erik Myin. 2012. Radicalizing Enactivism: Basic Minds without Content. MIT Press.

Hutto, Daniel D. and Erik Myin. 2017. Evolving Enactivism: Basic Minds Meet Content. MIT Press.

Jaynes, Julian. 1976. The Origin of Consciousness in the Breakdown of the Bicameral Mind.

Lizardo, Omar. 2017. “Improving Cultural Analysis Considering Personal Culture in Its Declarative and Nondeclarative Modes.” American Sociological Review 0003122416675175.

Lizardo, Omar, Robert Mowry, Brandon Sepulvado, Dustin S. Stoltz, Marshall A. Taylor, Justin Van Ness, and Michael Wood. 2016. “What Are Dual Process Models? Implications for Cultural Analysis in Sociology.” Sociological Theory 34(4):287–310.

Mullins, Daniel Austin, Daniel Hoyer, Christina Collins, Thomas Currie, Kevin Feeney, Pieter François, Patrick E. Savage, Harvey Whitehouse, and Peter Turchin. 2018. “A Systematic Assessment of ‘Axial Age’ Proposals Using Global Comparative Historical Evidence.” American Sociological Review 83(3):596–626.

Nelson, Katherine. 2009. Young Minds in Social Worlds: Experience, Meaning, and Memory. Harvard University Press.

Nelson, Katherine and Robyn Fivush. 2004. “The Emergence of Autobiographical Memory: A Social Cultural Developmental Theory.” Psychological Review 111(2):486–511.

Raskovsky, I., D. Fernández Slezak, C. G. Diuk, and G. A. Cecchi. 2010. “The Emergence of the Modern Concept of Introspection: A Quantitative Linguistic Analysis.” Pp. 68–75 in Proceedings of the NAACL HLT 2010 Young Investigators Workshop on Computational Approaches to Languages of the Americas, YIWCALA ’10. Stroudsburg, PA, USA: Association for Computational Linguistics.

Rawls, A. W. (2001). Durkheim’s treatment of practice: concrete practice vs representations as the foundation of reason. Journal of Classical Sociology, 1(1), 33-68.

Williams, Gary. 2011. “What Is It like to Be Nonconscious? A Defense of Julian Jaynes.” Phenomenology and the Cognitive Sciences 10(2):217–39.

“Learning By Nodes”: Dendritic Learning and What It Means (Or Not) for Cultural Sociology

In a paper published earlier this year in Scientific Reports and further discussed in a later ACS Chemical Neuroscience article, a group of researchers argues that learning might not function like we previously thought. The researchers (Sardi et al. 2018a, 2018b) explain that the dominant conceptualization in cognitive neuroscience of how learning works—synaptic learning, or “Hebbian learning” (Hebb 1949)—is wrong. Instead, using a series of computational models and experiments with synaptic blockers and neuronal cultures  (see Sardi et al. 2018a:4-7), the authors find evidence for a different type of learning—what they refer to as “dendritic learning.” Just as “Copernicus was the first to articulate loudly that the earth revolves around the sun and not vice versa, even though all the accumulated astronomical evidence at that time fit the old postulation,” the researchers proclaim, as are they the first to “[swim] against conventional wisdom” of Hebbian learning theory (2018b:1231).

Of what consequence is this newfound process of dendritic learning for cultural sociology? Should we care at all? I’ll try to briefly describe some of the potential consequences of dendritic learning for cultural sociology; but, spoiler alert, I am not sure one way or the other if these consequences amount to being consequential for how we do sociology. But perhaps taking a peek at what dendritic learning is and how it is different from conventional understandings of how learning works is a nice place to start.

copernican-universe
Figure 1. Are We Witnessing a “Revolution of the Cognitive Spheres”?
Note: Image from Copernicus’ On the Revolutions of the Heavenly Spheres (Palca 2011).

LINKS VS. NODES

Going on 70 years, the prevailing explanation for how learning works has been synaptic learning. Building from Hebb’s (1949) The Organization of Behavior, the idea behind synaptic learning is that if there is an activity that stimulates a neuron which in turn stimulates another neuron, and if that activity is repeated over time, then the first neuron becomes a more efficient stimulator of the second neuron and the two become more strongly connected in the brain.

Neuron-neuron stimulation occurs through synapses, the chemical (usually) or electrical (less frequently) structural gaps between neurons transmitting information across them. Synaptic learning, then, is a type of “activity-dependent synaptic plasticity” (Choe 2015:1305). Repeated practices or exposures to a certain stimulus modifies the synaptic strength between the two neurons: when the practice/exposure is repeated, the two neurons become more tightly associated in the brain, and when the practice/exposure is not repeated, the association weakens. This process occurs relatively slowly.

Synaptic learning is the inspiration behind the old adage that “neurons that fire together wire together.” Until very recently, this was the way we assumed new neural coalitions formed in biological neural networks. Consider an example from Luke Muehlhauser over on the Less Wrong blog (Muehlhauser 2011). Think back to Pavlov’s experiment on classical conditioning (Pavlov 1910):  a dog is given food when the researcher rings a bell, and the timing between the bell ringing and the presentation of food is manipulated. At first, there is no association between the neurons stimulated by bell ringing and the neurons that trigger salivation; they are, ostensibly, mutually exclusive actions. However, if the researcher rings the bell and the food is presented to the dog at the same time (or in close enough time intervals), the neurons that fire when food is present and the neurons that fire with bell ringing are activated together. Over repeated trials, the synapses between “bell ringing” and “salivation” neurons become stronger and, eventually, simply ringing the bell induces salivation without the presentation of food (see Figure 2).

Screen Shot 2018-10-16 at 6.56.46 PM
Figure 2. Synaptic Learning with Pavlov’s Experiment
Note: Reprinted from Less Wrong blog (Muehlhauser 2011).

Sardi and colleagues refer to synaptic learning as “learning by links” (Sardi et al. 2018a:1), since learning occurs through the synapses that link the neurons together. Their research, however, suggests a different type of learning—dendritic learning, also known as “learning by nodes” (Sardi et al. 2018a:2). In short, with this mode of learning, the workhorse of the neuron for learning purposes is not the synapses, but instead the dendrites. In a neuron cell, dendrites are the long, treelike extensions that connect the cell body (the soma, which contains the cell nucleus) to the synapses that themselves “connect” the neuron to other neurons.

Take a look at Figure 3, a neuron cell’s anatomy. The dendrites are responsible for taking in information from other neurons and passing it along into the soma, while the axon is responsible for passing the information on to other neurons via the axon terminals—which are themselves connected to the next neuron’s dendrites through synapses, thus propagating information transmission across the neural network. Without dendrites, information cannot be transmitted into the body of the neuron: e.g., damaged or abnormal dendrites are linked to brain under-connectivity issues associated with autism (Martínez-Cerdeño, Maezawa, and Jin 2016). Trying to construct new neural networks without dendrites is like trying to have group deliberation with all talk and no listening.

Screen Shot 2018-10-16 at 8.44.31 PM
Figure 3. A Neuron’s Anatomy
Note: Reprinted from OpenStax (2018), redirected from Khan Academy (2018).

So, how does dendritic learning differ functionally from synaptic learning? While synaptic learning is based on the idea of synaptic plasticity, dendritic learning revolves around the notion of (you guessed it) a sort of dendritic plasticity: given increasing or decreasing levels of exposure to a neuron-activating stimulus, the extent of the neuron’s “dendritic excitability” can grow or diminish while the strength of the synapses remain relatively constant (Neuroskeptic 2018).

Consider Figure 4. Across both panels, the teardrop object at the bottom represents the neuron cell body, which is where the firing happens if the input signals from the dendrites are strong enough for an outgoing signal to be pushed from the cell body down through the axon and into the dendrites of the next neuron. The long treelike branches are the dendrites, and the tips are the synapses that connect the neuron’s dendrites to the axon terminals of other (not shown) neurons. The left panel illustrates conventional synaptic learning, where the synapses themselves are weighted (indicated by the red valves at the tips of the branches) upward or downward depending on the extent of stimulus exposure. The right panel shows dendritic learning: it is the extent to which a neuron’s dendrites are in a high state of stimulation, and not the strength of the synapses linking the neuron to other neurons, that determines the strength of the input signal and therefore whether or not the neuron fires. In dendritic learning, then, there are far fewer “learning parameters,” since the dendrites are responsible for the learning and not the synapses (see the right panel of Figure 4) (ScienceDaily 2018).

Screen Shot 2018-10-16 at 9.34.34 PM
Figure 4. Synaptic Learning (left) vs. Dendritic Learning (right)
Note: Reprinted from ScienceDaily (2018).

IMPLICATIONS (?) FOR CULTURAL SOCIOLOGY

The “Neuroskeptic” over at Discover Magazine reviewed the evidence from the Sardi et al. papers and suggests that “[a]t best they have shown that dendritic learning also happens [in addition to synaptic learning],” and that “[they] don’t think Copernicus has returned to earth just yet” (Neuroskeptic 2018). I agree with Neuroskeptic in terms of what this means for neuroscience, largely because they are the neuroscientist and I am not. That said, there does seem to be the potential for some implications for how we do cultural sociology. But the potential may be greater for some subfields than for others.

I’m Not Sure What this Adds for How Sociologists Study Learning

The existence of dendritic learning has at least two major implications for cognitive neuroscience. First, learning may happen at much faster timescales than previously thought. Second, weak synapses matter a lot. In terms of timescale, it seems that the brain isn’t that bad at quick adaptation—at least relative to traditional Hebbian learning. As Sardi and colleagues note, “[t]his dynamic brain activity leads to the capability that when we think about an issue several times we may find different solutions” (Shrourou 2018). For the importance of weak synapses, the researchers point out that dendritic strengths are “self-oscillating” (2018b:1231), where weak synapses effectively “temper” the dendritic weights and prevent them from taking on extreme values. In other words, “dendritic learning enables stabilization around intermediate [dendritic strength] values” (Sardi et al. 2018a:4). These implications are pretty important for neuroscientists and medical researchers studying various diseases of the brain (Sardi et al. 2018b:1231-32).

What does all this mean for cultural sociologists? It might be too early to tell. Dendritic learning might be faster than synaptic learning, but the time scales in the experiments are in much smaller intervals (minutes) than the learning processes of interest to sociologists. The researchers note that future studies should “investigate . . . [dendritic learning] efficiency and available learning time scales in more realistic scenarios” (2018b:1231), so it’s an empirical question whether or not the learning speed differentials between synaptic and dendritic learning are a wash with longer timescales. So, in terms of theoretical leverage, dendritic learning may or may not offer much over and above how we already talk about learning in culture and cognition studies (see Lizardo et al. 2016:293-95). At the end of the day, for cultural sociologists it may all look like GOFILT—Good Old Fashioned Implicit Learning Theory—in which case the difference between synaptic and dendritic learning can be taken as ontologically true but analytically inconsequential. Only time (pun) will tell.

The Payoff May Come Sooner for Computational Social Science

In addition to understanding the learning processes behind biological neural networks and brain disorders, Sardi and colleagues also note that this “paradigm shift” matters for developing machine learning algorithms built to mimic human learning (2018b:1231). In natural language processing, for instance, if synaptic learning isn’t the baseline model of human learning (itself an empirical question), then perhaps analytical strategies that build associations between terms or documents based on term frequencies and co-occurrences aren’t based on the best cognitive model for machine learning.

But at face value I’m skeptical of this last proposition—I like word count methods for analyzing meaning, others do too (Nelson 2014; Underwood 2013), and I’ve read enough papers that make defensible claims using them to sell me on their continued use. That said, we have not seen dendritic learning rules implemented into machine learning algorithms yet (but see Sardi et al. 2018a:2-3 for an example of dendritic learning rules in a series of perceptron models), and it might prove particularly consequential in deep learning tasks and artificial neural network models. These sort of machine learning algorithms have not gained much traction in sociology, though, so, for now, it seems that the utility of distinguishing between synaptic and dendritic learning for culture and cognition studies is truly a waiting game.

I can continue all of my work without making these distinctions, and I suspect that most of the people reading this post are in the same position.

REFERENCES

Choe, Yoonsuck. 2015. “Hebbian Learning.” Pp. 1305-09 in Encyclopedia of Computational Neuroscience, edited by D. Jaeger and R. Jung. New York: Springer.

Hebb, Donald O. 1949. The Organization of Behavior: An Neuropsychological Theory. New York: Wiley.

Khan Academy. 2018. “Overview of Neuron Structure and Function.” Khan Academy. Retrieved October 16, 2018 (https://www.khanacademy.org/science/biology/human-biology/neuron-nervous-system/a/overview-of-neuron-structure-and-function).

Lizardo, Omar, Robert Mowry, Brandon Sepulvado, Dustin S. Stoltz, Marshall A. Taylor, Justin Van Ness, and Michael Wood. 2016. “What Are Dual Process Models? Implications for Cultural Analysis in Sociology.” Sociological Theory 34(4):287-310.

Martínez-Cerdeño, Verónica, Izumi Maezawa, and Lee-Way Jin. 2016. “Dendrites in Autism Spectrum Disorders.” Pp. 525-43 in Dendrites: Development and Disease, edited by K. Emoto, R. Wong, E. Huang, and C. Hoogenraad. Tokyo: Springer.

Muehlhauser, Luke. 2011. “A Crash Course in the Neuroscience of Human Motivation.” Less Wrong. Retrieved October 16, 2018 (https://www.lesswrong.com/posts/hN2aRnu798yas5b2k/a-crash-course-in-the-neuroscience-of-human-motivation).

Nelson, Laura K. 2014. “Computer-Assisted Content Analysis and Sociology: What You Should Know.” Bad Hessian. Retrieved October 17, 2018 (http://badhessian.org/2014/01/computer-assisted-content-analysis-and-sociology-what-you-should-know/).

Neuroskeptic. 2018. “Is ‘Dendritic Learning’ How the Brain Works?” Discover Magazine. Retrieved October 16, 2018 (http://blogs.discovermagazine.com/neuroskeptic/2018/05/11/dendritic-learning/#.W8aX4P5KjdT).

OpenStax. 2018. “Neurons and Glial Cells.” OpenStax CNX. Retrieved October 16, 2018 (https://cnx.org/contents/GFy_h8cu@9.87:c9j4p0aj@3/Neurons-and-Glial-Cells).

Palca, Joe. 2011. “For Copernicus, A ‘Perfect Heaven’ Put Sun At Center.” NPR: Morning Edition. Retrieved October 16, 2018 (https://www.npr.org/2011/11/08/141931239/for-copernicus-a-perfect-heaven-put-sun-at-center).

Pavlov, Ivan. 1910. The Work of the Digestive Glands. London: C. Griffin & Company.

Sardi, Shira, Roni Vardi, Amir Goldental, Anton Sheinin, Herut Uzan, and Ido Kanter. 2018a. “Adaptive Nodes Enrich Nonlinear Cooperative Learning Beyond Traditional Adaptation By Links.” Scientific Reports 8(1):5100.

Sardi, Shira, Roni Vardi, Amir Goldental, Yael Tugendhaft, Herut Uzan, and Ido Kanter. 2018b. “Dendritic Learning as a Paradigm Shift in Brain Learning.” ACS Chemical Neuroscience 9:1230-32.

ScienceDaily. 2018. “The Brain Learns Completely Differently than We’ve Assumed Since the 20th Century.” ScienceDaily. Retrieved October 16, 2018 (https://www.sciencedaily.com/releases/2018/03/180323084818.htm).

Shrourou, Alina. 2018. “Dendritic Learning Occurs Much Faster and In Closer Proximity to Neurons, Shows Study.” News Medical: Life Sciences. Retrieved October 16, 2018 (https://www.news-medical.net/news/20180830/Dendritic-learning-occurs-much-faster-and-in-closer-proximity-to-neurons-shows-study.aspx).

Underwood, Ted. 2013. “Wordcounts Are Amazing.” The Stone and the Shell. Retrieved October 17, 2018 (https://tedunderwood.com/2013/02/20/wordcounts-are-amazing/).