Perceptual Control Theory

William T Powers

Perceptual control theory (PCT) is a model of behavior based on the principles of negative feedback (when the output of a system acts to oppose changes to the input of a system, acting to stabilize it). It differs in a number of respects from standard engineering control theory, which deals with the behavior of dynamical systems like feedback loops. From the PCT perspective, an organism controls neither its own behavior, nor external environmental variables, but rather its own perceptions.

According to the standard catch-phrase of the field, ‘behavior is the control of perception.’ While the adoption of PCT in the scientific community has not been widespread, it has been applied to a number of areas, and has led to a method of psychotherapy called the Method of Levels.

A tradition from Aristotle through William James recognizes that behavior is purposeful rather than merely reactive. However, the only evidence for intentions was subjective. Behaviorists following Wundt, Thorndyke, Watson, and others rejected introspective reports as data for an objective science of psychology. Only observable behavior could be admitted as data. There follows from this stance the assumption that environmental events (stimuli) cause behavioral actions (responses). This assumption persists in cognitive psychology, which interposes cognitive maps and other postulated information processing between stimulus and response, but otherwise retains the assumption of linear causation from environment to behavior.

Another, more specific reason for psychologists’ rejecting notions of purpose or intention was that they could not see how a goal (a state that did not yet exist) could cause the behavior that led to it. PCT resolves these philosophical arguments about teleology (a philosophical idea that things have goals or causes) because it provides a model of the functioning of organisms in which purpose has objective status without recourse to introspection, and in which causation is circular around feedback loops.

The principal datum in PCT methodology is the controlled variable. The fundamental step of PCT research, the Test for controlled variables, is the slow and gentle application of disturbing influences to the state of a variable in the environment which the researcher surmises is already under control by the observed organism. It is essential not to overwhelm the organism’s ability to control, since that is what is being investigated. If the organism changes its actions just so as to prevent the disturbing influence from having the expected effect on that variable, that is strong evidence that the experimental action disturbed a controlled variable. It is crucially important to distinguish the perceptions and point of view of the observer from those of the observed organism. It may take a number of variations of the Test to isolate just which aspect of the environmental situation is under control, as perceived by the observed organism.

The controlled variable as measured by the observer corresponds to a reference value for a perception that the organism is controlling. The controlled variable is thus an objective index of the purpose or intention of those particular behavioral actions by the organism—the goal which those actions consistently work to attain despite disturbances. Data for individuals are not aggregated for statistical analysis; instead, a generative model is built which replicates the data observed for individuals with very high fidelity. With two variables specified, the controlled input and the reference (a variable ′setpoint′), a properly designed control system, simulated on a digital computer, produces outputs that almost precisely oppose unpredictable disturbances to the controlled input. Further, the variance from perfect control (which would result in zero effect of the disturbance) accords well with that observed for living organisms.

Unaffiliated scientist William T. Powers recognized that to be purposeful implies control, and that the concepts and methods of engineered control systems could be applied to biological control systems. Powers recognized further that in any control system the variable that is controlled is not the output of the system (the behavioral actions), but its input, that is, a sensed and transformed function of some state of the environment that could be affected by the control system’s output. Because some of these sensed and transformed inputs appear as consciously perceived aspects of the environment, Powers labelled the controlled variable ‘perception.’ The theory came to be known as ‘Perceptual Control Theory’ or PCT rather than ‘Control Theory Applied to Psychology’ because control theorists often assert or assume that it is the system’s output that is controlled. In PCT it is the internal representation of the state of some variable in the environment—a ‘perception’ in everyday language—that is controlled. The basic principles of PCT were first published by Powers, Clark, and MacFarland as a ‘general feedback theory of behavior’ in 1960, with credits to cybernetic authors Wiener and Ashby, and has been systematically developed since then in the research community that has gathered around it. Initially, it received little general recognition, but is now better known.

A simple negative feedback control system is a cruise control system for a car. A cruise control system has a sensor which ‘perceives’ speed as the rate of spin of the drive shaft directly connected to the wheels. It also has a driver-adjustable ‘goal’ specifying a particular speed. The sensed speed is continuously compared against the specified speed by a device (called a ‘comparator’) which subtracts the currently-sensed input value from the stored goal value. The difference (the error signal) determines the throttle setting (the accelerator depression), so that the engine output is continuously varied to counter variations in the speed of the car. This type of classical negative feedback control was worked out by engineers in the 1930s and 1940s.

If the speed of the car starts to drop below the goal-speed, for example when climbing a hill, the small increase in the error signal, amplified, causes engine output to increase, which keeps the error very nearly at zero. If the speed exceeds the goal, e.g. when going down a hill, the engine is throttled back so as to act as a brake, so again the speed is kept from departing more than a barely-detectable amount from the goal speed (brakes are needed only if the hill is too steep). The result is that the cruise control system maintains a speed close to the goal as the car goes up and down hills, and as other disturbances such as wind affect the car’s speed. This is all done without any planning of specific actions, and without any blind reactions to stimuli.

The same principles of negative feedback control (including the ability to nullify effects of unpredictable external or internal disturbances) apply to living control systems. The thesis of PCT is that animals and people do not control their behavior; rather, they vary their behavior as their means for controlling their perceptions, with or without external disturbances. This directly contradicts the historical and still widespread assumption that behavior is the final result of stimulus inputs or cognitive plans.

Perceptions, in PCT, are constructed and controlled in a hierarchy of levels. For example, visual perception of an object is constructed from differences in light intensity or differences in sensations such as color at its edges. Controlling the shape or location of the object requires altering the perceptions of sensations or intensities (which are controlled by lower-level systems). This organizing principle is applied at all levels, up to the most abstract philosophical and theoretical constructs.

Russian physiologist Nicolas Bernstein independently came to the same conclusion that behavior has to be multiordinal—organized hierarchically, in layers. A simple problem led to this conclusion at about the same time both in PCT and in Bernstein’s work. The spinal reflexes act to stabilize limbs against disturbances. Why do they not prevent centers higher in the brain from using those limbs to carry out behavior? Since the brain obviously does use the spinal systems in producing behavior, there must be a principle that allows the higher systems to operate by incorporating the reflexes, not just by overcoming them or turning them off. The answer is that the reference value (setpoint) for a spinal reflex is not static; rather, it is varied by higher-level systems as their means of moving the limbs. This principle applies to higher feedback loops, as each loop presents the same problem to subsystems above it.

Whereas an engineered control system has a reference value or setpoint adjusted by some external agency, the reference value for a biological control system cannot be set in this way. The setpoint must come from some internal process. If there is a way for behavior to affect it, any perception may be brought to the state momentarily specified by higher levels and then be maintained in that state against unpredictable disturbances. In a hierarchy of control systems, higher levels adjust the goals of lower levels as their means of approaching their own goals set by still-higher systems. This has important consequences for any proposed external control of an autonomous living control system (organism). At the highest level, reference values (goals) are set by heredity or adaptive processes.

If an organism controls inappropriate perceptions or controls some perceptions to inappropriate values, it is less likely to bring progeny to maturity, and may die. Consequently, by Natural Selection successive generations of organisms evolve so that they control those perceptions that, when controlled with appropriate setpoints, tend to maintain critical internal variables at optimal levels, or at least within non-lethal limits. Powers called these critical internal variables ‘intrinsic variables’ (Ashby’s ‘essential variables’).

The mechanism that influences the development of structures of perceptions to be controlled is termed ‘reorganization,’ a process within the individual organism that is subject to natural selection just as is the evolved structure of individuals within a species. This ‘reorganization system’ is proposed to be part of the inherited structure of the organism. It changes the underlying parameters and connectivity of the control hierarchy in a random-walk manner. There is a basic continuous rate of change in intrinsic variables which proceeds at a speed set by the total error (and stops at zero error), punctuated by random changes in direction in a hyperspace with as many dimensions as there are critical variables. This is a more or less direct adaptation of Ashby’s ‘homeostat,’ first adopted into PCT in the 1960 paper and then changed to use a bacterium’s (E. coli) method of navigating up gradients of nutrients, as described by Daniel Koshland in 1980. Reorganization may occur at any level when loss of control at that level causes intrinsic (essential) variables to deviate from genetically-determined set points. This is the basic mechanism that is involved in trial-and-error learning, which leads to the acquisition of more systematic kinds of learning processes.

In a hierarchy of interacting control systems, different systems at one level can send conflicting goals to one lower system. When two systems are specifying different goals for the same lower-level variable, they are in conflict. Protracted conflict is experienced by human beings as many forms of psychological distress such as anxiety, obsession, depression, confusion, and vacillation. Severe conflict prevents the affected systems from being able to control, effectively destroying their function for the organism. Higher level control systems often are able to use known strategies (which are themselves acquired through prior reorganizations) to seek perceptions that don’t produce the conflict. Normally, this takes place without notice. If the conflict persists and systematic ‘problem solving’ by higher systems fails, the reorganization system may modify existing systems until they bypass the conflict or until they produce new reference signals (goals) that are not in conflict at lower levels.

When reorganization results in an arrangement that reduces or eliminates the error that is driving it, the process of reorganization slows or stops with the new organization in place. (This replaces the concept of reinforcement learning.) New means of controlling the perceptions involved, and indeed new perceptual constructs subject to control, may also result from reorganization. In simplest terms, the reorganization process varies things until something works, at which point we say that the organism has learned. When done in the right way, this method can be surprisingly efficient in simulations.

Currently, no one theory has been agreed upon to explain the synaptic, neuronal or systemic basis of learning. Prominent since 1973, however, is the idea that long-term potentiation (LTP) of populations of synapses induces learning through both pre- and postsynaptic mechanisms. LTP is a form of Hebbian learning, which proposed that high-frequency, tonic activation of a circuit of neurones increases the efficacy with which they are activated and the size of their response to a given stimulus as compared to the standard neurone. These mechanisms are the principles behind Hebb’s famously simple explanation in 1949: ‘Those that fire together, wire together.’

LTP has received much support since it was first observed by Terje Lømo in 1966 and is still the subject of many modern studies and clinical research. However, there are possible alternative mechanisms underlying LTP, as presented by an article in ‘Neuron’ in 2009 which firstly proposed that LTP occurs in individual synapses, and this plasticity is graded (as opposed to in a binary mode) and bidirectional. Secondly, the researchers suggested that the synaptic changes are expressed solely presynaptically, via changes in the probability of transmitter release. Finally, the team predicted that the occurrence of LTP could be age-dependent, as the plasticity of a neonatal brain would be higher than that of a mature one. Therefore the theories differ, as one proposes an on/off occurrence of LTP by pre- and postsynaptic mechanisms and the other proposes only presynaptic changes, graded ability, and age-dependence.

These theories do agree on one element of LTP, namely, that it must occur through physical changes to the synaptic membrane/s, i.e. synaptic plasticity. Perceptual Control Theory encompasses both of these views. It proposes the mechanism of ‘ reorganization’ as the basis of learning. Reorganization occurs within the inherent control system of a human or animal by restructuring the inter- and intraconnections of its hierarchical organization, akin to the neuroscientific phenomenon of neural plasticity. This reorganization initially allows the trial-and-error form of learning, which is seen in babies, and then progresses to more structured learning through association, apparent in infants, and finally to systematic learning, covering the adult ability to learn from both internally and externally- generated stimuli and events. In this way, PCT provides a valid model for learning that combines the biological mechanisms of LTP with an explanation of the progression and change of mechanisms associated with developmental ability.

William T. Powers produced a simulation of arm co-ordination in 2008. He suggested that in order to move your arm, fourteen control systems that control fourteen joint angles are involved, and they reorganize simultaneously and independently. It was found that for optimum performance, the output functions must be organized in a way so as each control system’s output only affects the one environmental variable it is perceiving. In this simulation, the reorganizing process is working as it should, and just as Powers suggests that it works in humans, reducing outputs that cause error and increasing those that reduce error. Initially, the disturbances have large effects on the angles of the joints, but over time the joint angles match the reference signals more closely due to the system being reorganized. Powers suggests that in order to achieve coordination of joint angles to produce desired movements, instead of calculating how multiple joint angles must change to produce this movement the brain uses negative feedback systems to generate the joint angles that are required. A single reference signal that is varied in a higher-order system can generate a movement that requires several joint angles to change at the same time.

In 2008, Matthew M. Botvinick at Princeton proposed that one of the founding insights of the cognitive revolution was the recognition of hierarchical structure in human behavior. Despite decades of research, however, the computational mechanisms underlying hierarchically organized behavior are still not fully understood. The fundamental goal in cognitive neuroscience is to characterize the functional organization of the frontal cortex that supports the control of action. Recent neuroimaging data has supported the hypothesis that the frontal lobes are organized hierarchically, such that control is supported in progressively caudal regions as control moves to more concrete specification of action. However, it is still not clear whether lower-order control processors are differentially affected by impairments in higher-order control when between-level interactions are required to complete a task, or whether there are feedback influences of lower-level on higher-level control.

Botvinik found that all existing models of hierarchically structured behavior share at least one general assumption – that the hierarchical, part–whole organization of human action is mirrored in the internal or neural representations underlying it. Specifically, the assumption is that there exist representations not only of low-level motor behaviors, but also separable representations of higher-level behavioral units. The latest crop of models provides new insights, but also poses new or refined questions for empirical research, including how abstract action representations emerge through learning, how they interact with different modes of action control, and how they sort out within the prefrontal cortex (PFC).

Perceptual Control theory (PCT) can provide an explanatory model of neural organization that deals with the current issues. PCT describes the hierarchical character of behavior as being determined by control of hierarchically organized perception. Control systems in the body and in the internal environment of billions of interconnected neurons within the brain are responsible for keeping perceptual signals within survivable limits in the unpredictably variable environment from which those perceptions are derived. PCT does not propose that there is an internal model within which the brain simulates behavior before issuing commands to execute that behavior. Instead, one of its characteristic features is the principled lack of cerebral organization of behavior. Rather, behavior is the organism’s variable means to reduce the discrepancy between perceptions and reference values which are based on various external and internal inputs. Behavior must constantly adapt and change for an organism to maintain its perceptual goals. In this way, PCT can provide an explanation of abstract learning through spontaneous reorganization of the hierarchy. PCT proposes that conflict occurs between disparate reference values for a given perception rather than between different responses, and that learning is implemented as trial-and-error changes of the properties of control systems, rather than any specific response being ‘reinforced.’ In this way, behavior remains adaptive to the environment as it unfolds, rather than relying on learned action patterns that may not fit.

Hierarchies of perceptual control have been simulated in computer models and have been shown to provide a close match to behavioral data. In 1986, Richard S. Marken conducted an experiment comparing the behavior of a perceptual control hierarchy computer model with that of six healthy volunteers in three experiments. The participants were required to keep the distance between a left line and a center line equal to that of the center line and a right line. They were also instructed to keep both distances equal to 2cm. They had 2 paddles in their hands, one controlling the left line and one controlling the middle line. They had to react to random disturbances applied to the positions of the lines. As the participants achieved control, they managed to nullify the expected effect of the disturbances by moving their paddles. The correlation between the behavior of subjects and the model in all the experiments approached .99. It is proposed that the organization of models of hierarchical control systems such as this informs us about the organization of the human subjects whose behavior it so closely reproduces.

Perceptual control theory currently proposes a hierarchy of 11 levels of perceptions controlled by systems in the human mind and neural architecture. These are: intensity, sensation, configuration, transition, event, relationship, category, sequence, program, principle, and system concept. Diverse perceptual signals at a lower level (e.g. visual perceptions of intensities) are combined in an input function to construct a single perception at the higher level (e.g. visual perception of a color sensation). The perceptions that are constructed and controlled at the lower levels are passed along as the perceptual inputs at the higher levels. The higher levels in turn control by telling the lower levels what to perceive: that is, they adjust the reference levels (goals) of the lower levels. While many computer demonstrations of principles have been developed, the proposed higher levels are difficult to model because too little is known about how the brain works at these levels. Isolated higher-level control processes can be investigated, but models of an extensive hierarchy of control are still only conceptual, or at best rudimentary.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s