Thoughts on reading cybernetics
Well, first of all if the foreword is to be believed, Norbert was a traumatised child prodigy, who nevertheless managed to have pretty good opinions for his time: Not working with army or factory automators, and heavily criticising environment exploitation.
Reviewers of Ex-Prodigy remarked that, despite his many successes, Wiener’s life story seemed imbued with sadness. His writings reveal a deep skepticism about human nature. Earlier, I mentioned Wiener’s comment that he used his outsider status to fuel his creative drive. Steve Heims noted a similar sentiment in a journal article Wiener cowrote, criticizing Rudyard Kipling for his “fear-based conformity.” In a comment that could easily have reflected Wiener’s view of himself, the piece added, “The marginal man is always relatively the more civilized human being.”
Strong echoes of Frankenstein’s monster there.
Interestingly, the book came out the same year as Shannon’s first big paper opresenting his information theory - the contrast between their “chaotic interconnected systems” vs “clean abstracted actors” is quite stark. We did learn about Shannon’s work in uni as well, though not Wiener’s.
The description of this process is rather simple. In addition to the black box which represents an as yet unanalyzed non-linear system, I have certain bodies of known structure which I shall call white boxes representing the various terms in the expansion desired. I put the same random noise into the black box and into a given white box. The coefficient of the white box in the development of the black box is given as an average of the product of their outputs. While this average is taken over the entire ensemble of shot-effect inputs, there is a theorem which allows us to replace this average in all but a set of cases of probability by an average taken over time. To obtain this average, we need to have at our disposal a multiplying instrument by which we can get the product of the outputs of the black and the white box, as well as an averaging instrument, which we can base on the fact that the potential across a condenser is proportional to the quantity of electricity held in the condenser and hence to the time integral of the current flowing through it. Not only is it possible to determine the coefficients of each white box constituting an additive part of the equivalent representation of the black box one by one, but it is also possible to determine these quantities simultaneously. It is even possible by the use of appropriate feedback devices to make each one of the white boxes automatically adjust itself to the level corresponding to its coefficient in the development of the black box. In this manner we are able to construct a multiple white box which, when it is properly connected to a black box and is subjected to the same random input, will automatically form itself into an operational equivalent of the black box even though its internal structure may be vastly different.
This is still just the intro and his description of a low-cost way to simulate inputs and outputs in a black box system has me kinda hooked already
Here it has been found cut that unless some such learning device is employed, the programming of a rigidly patterned machine is itself a very difficult task and that there is an urgent need for devices to program this programming.
I don’t know how please he would be with the vision of non-deterministic machines doing this programming though lol
For many years Dr. Rosenblueth and I had shared the conviction that the most fruitful areas for the growth of the sciences were those which had been neglected as a no-man’s land between the various established fields.
A thought I wholeheartedly share, though have mostly practiced in business spaces
On the communication engineering plane, it had already become clear to Mr. Bigelow and myself that the problems of control engineering and of communication engineering were inseparable, and that they centered not around the technique of electrical engineering but around the much more fundamental notion of the message, whether this should be transmitted by electrical, mechanical, or nervous means. The message is a discrete or continuous sequence of measurable events distributed in time—precisely what is called a time series by the statisticians
I guess it sounds simple in hindsight, but I enjoy reading the process of how they deconstructed problems down to messages and information theory - a field that wasn’t really developed yet
To cover this aspect of communication engineering, we had to develop a statistical theory of the amount of information, in which the unit amount of information was that transmitted as a single decision between equally probable alternatives. This idea occurred at about the same time to several writers, among them the statistician R. A. Fisher, Dr. Shannon of the Bell Telephone Laboratories, and the author. Fisher’s motive in studying this subject is to be found in classical statistical theory; that of Shannon in the problem of coding information; and that of the author in the problem of noise and message in electrical filters.
Norbert contextualizes himself and his work here - I can imagine Shannon’s research was taking up a lot of the attention in that space. Random aside here from Shannon’s wiki page:
Shannon also invented flame-throwing trumpets, rocket-powered frisbees, and plastic foam shoes for navigating a lake, by wearing which it would appear to an observer as if Shannon were walking on water.
Not an easy guy to compete with, by any means, even for a prodigy like Wiener!
 The transmission of information is impossible save as a transmission of alternatives. If only one contingency is to be transmitted, then it may be sent most efficiently and with the least trouble by sending no message at all.
He woulda loved leaving people on read.
If I were to choose a patron saint for cybernetics out of the history of science, I should have to choose Leibniz.
Yeah bro because if you chose Boole like Shannon did, that’d be awkward
The idea has been to get together a group of modest size, not exceeding some twenty in number, of workers in various related fields, and to hold them together for two successive days in all-day series of informal papers, discussions, and meals together, until they had had the opportunity to thresh out their differences and to make progress in thinking along the same lines.
I wonder if this is still done?
Okay I’m not gonna quote it but they did some pretty unspeakable things to cats in order to determine their feedback loops
From the beginning, we have anticipated that the problem of the perception of Gestalt, or of the perceptual formation of universals, would prove to be of this nature. What is the mechanism by which we recognize a square as a square, irrespective of its position, its size, and its orientation?
That’s such a fascinating question tho
It is certainly true that the social system is an organization like the individual, that it is bound together by a system of communication, and that it has a dynamics in which circular processes of a feedback nature play an important part.
After reading tons of thetheory on systems this feels like a fairly basic assertion, but I think it’s worth highlighting nevertheless
On this basis, Drs. Gregory Bateson and Margaret Mead have urged me, in view of the intensely pressing nature of the sociological and economic problems of the present age of confusion, to devote a large part
So, he gets asked: Can your new approach work in fixing our society? And he’s like: No, the statistics are gonna be super messy because nothing is ever done under the exact same conditions, and whoever interprets that data is gonna be hella fucking subjective so I hope we’ll get an expert… right?
the main quantities affecting society are not only statistical, but the runs of statistics on which they are based are excessively short… Moreover, in the absence of reasonably safe routine numerical techniques, the element of the judgment of the expert in determining the estimates to be made of sociological, anthropological, and economic quantities is so great that it is no field for a newcomer who has not yet had the bulk of experience which goes to make up the expert… does not inspire me with any confidence unless it is applied by a statistician by whom the main elements of the dynamics of the situation are either explicitly known or implicitly felt.
That is… actually a humble and realistic take, I’m positively surprised
Let me now come to another point which I believe to merit attention. It has long been clear to me that the modern ultra-rapid computing machine was in principle an ideal central nervous system to an apparatus for automatic control; and that its input and output need not be in the form of numbers or diagrams but might very well be, respectively, the readings of artificial sense organs, such as photoelectric cells or thermometers, and the performance of motors or solenoids … Long before Nagasaki and the public awareness of the atomic bomb, it had occurred to me that we were here in the presence of another social potentiality of unheard-of importance for good and for evil. The automatic factory and the assembly line without human agents are only so far ahead of us as is limited by our willingness to put such a degree of effort into their engineering … It gives the human race a new and most effective collection of mechanical slaves to perform its labor. Such mechanical labor has most of the economic properties of slave labor, although, unlike slave labor, it does not involve the direct demoralizing effects of human cruelty. However, any labor that accepts the conditions of competition with slave labor accepts the conditions of slave labor, and is essentially slave labor. … It cannot be good for these new potentialities to be assessed in the terms of the market, of the money they save;
I had heard that the guy had good ethical foresight, but shit this is good! So he sees all these potential futures now enabled, and he evaluates them not on market price or an idealistic future, but by how they will impact everyday humans. He does not shy away from calling slavery an unacceptable cruelty either. So what’s his next step, after he realizes this?
 I thus felt it my duty to pass on my information and understanding of the position to those who have an active interest in the conditions and the future of labor, that is, to the labor unions.
Yep, but they were not equipped to listen
Those of us who have contributed to the new science of cybernetics thus stand in a moral position which is, to say the least, not very comfortable. We have contributed to the initiation of a new science which, as I have said, embraces technical developments with great possibilities for good and for evil. We can only hand it over into the world that exists about us, and this is the world of Belsen and Hiroshima. We do not even have the choice of suppressing these new technical developments. They belong to the age, and the most any of us can do by suppression is to put the development of the subject into the hands of the most irresponsible and most venal of our engineers. The best we can do is to see that a large public understands the trend and the bearing of the present work, and to confine our personal efforts to those fields, such as physiology and psychology, most remote from war and exploitation. As we have seen, there are those who hope that the good of a better understanding of man and society which is offered by this new field of work may anticipate and outweigh the incidental contribution we are making to the concentration of power (which is always concentrated, by its very conditions of existence, in the hands of the most unscrupulous). I write in 1947, and I am compelled to say that it is a very slight hope.
This might as well have been written in 2026 about LLMs
Chapter 1: Newtonian and Bergsonian Time
Thus if we were to take a motion picture of the planets, speeded up to show a perceptible picture of activity, and were to run the film backward, it would still be a possible picture of planets conforming to the Newtonian mechanics. On the other hand, if we were to take a motion-picture photograph of the turbulence of the clouds in a thunderhead and reverse it, it would look altogether wrong. We should see downdrafts where we expect updrafts, turbulence growing coarser in texture, lightning preceding instead of following the changes of cloud which usually precede it, and so on indefinitely.
What is the difference between the astronomical and the meteorological situation which brings about all these differences, and in particular the difference between the apparent reversibility of astronomical time and the apparent irreversibility of meteorological time?
Indeed, it is a very interesting intellectual experiment to make the fantasy of an intelligent being whose time should run the other way to our own. To such a being, all communication with us would be impossible. Any signal he might send would reach us with a logical stream of consequents from his point of view, antecedents from ours. These antecedents would already be in our experience, and would have served to us as the natural explanation of his signal, without presupposing an intelligent being to have sent it. If he drew us a square, we should see the remains of his figure as its precursors, and it would seem to be the curious crystallization—always perfectly explainable—of these remains. Its meaning would seem to be as fortuitous as the faces we read into mountains and cliffs. The drawing of the square would appear to us as a catastrophe—sudden indeed, but explainable by natural laws—by which that square would cease to exist. Our counterpart would have exactly similar ideas concerning us. Within any world with which we can communicate, the direction of time is uniform.
Loving these thoughts on time direction
Overall this mostly felt like an abbreviated history of phases of science, and how statistical models describing group dynamics evolve to take over the root of most scientific theories at the time. Which makes tons of sense heading into…
Chapter 2: Groups and Statistical Mechanics
In this chapter, Wiener wishes to educate us on the math we’ll be needing shortly.
Probabilities one and zero are notions which include complete certainty and complete impossibility but include much more as well. If I shoot at a target with a bullet of the dimensions of a point, the chance that I hit any specific point on the target will generally be zero, although it is not impossible that I hit it; and indeed, in each specific case I must actually hit some specific point, which is an event of probability zero. Thus an event of probability one, that of my hitting some point, may be made up of an assemblage of instances of probability zero
He sounds like the type of guy to get a Pascal Mugging
The essence of an effective rule for a game or a useful law of physics is that it be statable in advance, and that it apply to more than one case. Ideally, it should represent a property of the system discussed which remains the same under the flux of particular circumstances. In the simplest case, it is a property which is invariant to a set of transformations to which the system is subject. We are thus led to the notions of transformation, transformation group, and invariant.
He proceeds to explain a bunch of things about the math of group mechanics, but I didn’t get much of a conclusion out of those. He does have an interesting take on Maxwell’s daemon though:
The demon can only act on information received, and this information, as we shall see in the next chapter, represents a negative entropy. The information must be carried by some physical process, say some form of radiation. It may very well be that this information is carried at a very low energy level, and that the transfer of energy between particle and demon is for a considerable time far less significant than the transfer of information. However, under the quantum mechanics, it is impossible to obtain any information giving the position or the momentum of a particle, much less the two together, without a positive effect on the energy of the particle examined, exceeding a minimum dependent on the frequency of the light used for examination. Thus all coupling is strictly a coupling involving energy, and a system in statistical equilibrium is in equilibrium both in matters concerning entropy and those concerning energy.
So basically, he’s saying information is part of the energy of the system, and the thought experiment only works because we handwave a bunch of constraints on the demon away.
Chapter 3: Time Series, Information, and Communication
So, our boy starts the chapter by giving a definition for the mathematical formula of information:
We may conceive this in the following way: we know a priori that a variable lies between 0 and 1, and a posteriori that it lies on the interval (a, b) inside (0, 1). Then the amount of information we have from our a posteriori knowledge is:

(The -log2 part comes from an earlier estimate for a uniformly distributed error probability).
Okay, a bunch of math follows to explain how to use the math formulas of communication in practice, skipping it here.
The quantity we here define as amount of information is the negative of the quantity usually defined as entropy in similar situations.
Which makes some sense, a system with maximum entropy has no information to be gained.
No operation on a message can gain information on the average. Here we have a precise application of the second law of thermodynamics in communication engineering.
(More math here) He does explain how a system is in statistical equilibrium (a term I could not find in Wikipedia) when
the statistics of distribution of f(t, γ) are the same as the statistics of f(t + _t_1, γ)
And a bunch of math later we get to…
Just don’t ask me to explain this
This is precisely the result which the author and Shannon have already obtained for the rate of transmission of information in this case. As will be seen, it depends not only on the width of the frequency band available for transmitting the message but also on the noise level.
Yep, we got the long awaited main definition of info. It’s followed by some discussion of adapting our information theory formulas into discrete vs continuous time series, and a brief flirt with quantum theories. Enough with this math though, for it is time for…
Chapter 4: Feedback and Oscillation
This is where we draw the connection between the information gained and action taken… right?
We thus see that for effective action on the outer world it is not only essential that we possess good effectors, but that the performance of these effectors be properly monitored back to the central nervous system, and that the readings of these monitors be properly combined with the other information coming in from the sense organs to produce a properly proportioned output to the effectors.
Yep. We accept that there is a desired state, and an actual state, and that we have systems which can solely focus on reconciling the two.
There are, however, feedback chains in which no human element intervenes. The ordinary thermostat by which we regulate the heating of a house is one of these. There is a setting for the desired room temperature; and if the actual temperature of the house is below this, an apparatus is actuated which opens the damper, or increases the flow of fuel oil, and brings the temperature of the house up to the desired level.
K8s controllers before it was cool!
There are also negative feedbacks to stabilize position, as in the case of the steering engines of a ship, which are actuated by the angular difference between the position of the wheel and the position of the rudder, and always act so as to bring the position of the rudder into accord with that of the wheel.
Yaaaas, K8s shoutout!
In this book, we have avoided mathematical symbolism and mathematical technique as far as possible, although we have been forced to compromise with them in various places, and in particular in the previous chapter.
HA! He proceeds to ask permission to do some more math and promises it will be the last major ones.
Some of the math shows that if the system feedback mechanisms correct course by amplifying the output, you will end up with an infinite oscillation.
More importantly he goes on to show how different feedback mechanisms may stabilize or fail to stabilize a system, and that you may often be unable to do so with a single, or even 2 feedback mechanisms, such as in the case of boat steering. As another example:
In the human body, the motion of a hand or a finger involves a system with a large number of joints. The output is an additive vectorial combination of the outputs of all these joints. We have seen that, in general, a complex additive system like this cannot be stabilized by a single feedback.
He goes on to describe how some motor diseases may be due to faulty human feedback loops, versus others effecting the effectors (e.g Parkinsons)
When feedback is possible and stable, its advantage, as we have already said, is to make performance less dependent on the load… Thus feedback serves to diminish the dependence of the system on the characteristic of the motor, and serves to stabilize it
A feedback system in other words makes a system more stable, and more adaptable to load conditions
A great group of cases in which some sort of feedback is not only exemplified in physiological phenomena but is absolutely essential for the continuation of life is found in what is known as homeostasis. The conditions under which life, especially healthy life, can continue in the higher animals are quite narrow.
He’s like you thought this was complex shit? Wait till you hear about this!
5. Computing Machines and the Nervous System
Baby this is what I came for
Computing machines are essentially machines for recording numbers, operating with numbers, and giving the result in numerical form. A very considerable part of their cost, both in money and in the effort of construction, goes to the simple problem of recording numbers clearly and accurately.
Okay, a spectacular drop in expectations of audience comprehension here but I’m not complaining
We see that for highly accurate work, at any rate, the numerical machines are preferable, and above all, those numerical machines constructed on the binary scale, in which the number of alternatives presented at each choice is two… It is thus advantageous, as far as possible, to remove the human element from any elaborate chain of computation and to introduce it only where it is absolutely unavoidable, at the very beginning and the very end.
I can kinda see why he went to the unions
While there are many algorithms which might be used for combining contingencies, the simplest of these is known as the algebra of logic par excellence, or the Boolean algebra.
Bro proceeds to outline binary operations performed in an ordered series by machines using vacuum tubes and like, good foresight brother, I think you’re onto something. Moving on…
It is a noteworthy fact that the human and animal nervous systems, which are known to be capable of the work of a computation system, contain elements which are ideally suited to act as relays. These elements are the so-called neurons or nerve cells. While they show rather complicated properties under the influence of electrical currents, in their ordinary physiological action they conform very nearly to the “all-or-none” principle; that is, they are either at rest, or when they “fire” they go through a series of changes almost independent of the nature and intensity of the stimulus
Leaving aside those neurons which accept their messages from free endings or sensory end organs, each neuron has its message fed into it by other neurons at points of contact known as synapses. For a given outgoing neuron, these vary in number from a very few to many hundred. It is the state of the incoming impulses at the various synapses, combined with the antecedent state of the outgoing neuron itself, which determines whether it will fire or not… This is perhaps an oversimplification of the picture: the “threshold” may not depend simply on the number of synapses but on their “weight” and their geometrical relations to one another with respect to the neuron into which they feed; and there is very convincing evidence that there exist synapses of a different nature, the so-called “inhibitory synapses,” which either completely prevent the firing of the outgoing neuron or at any rate raise its threshold with respect to stimulation at the ordinary synapses.
It feels almost like a network… of neurons…
There is first the memory which is necessary for the carrying out of a current process, such as a multiplication, in which the intermediate results are of no value once the process is completed, and in which the operating apparatus should then be released for further use. Such a memory should record quickly, be read quickly, and be erased quickly. On the other hand, there is the memory which is intended to be part of the files, the permanent record, of the machine or the brain, and to contribute to the basis of all its future behavior, at least during a single run of the machine. Let it be remarked parenthetically that an important difference between the way in which we use the brain and the machine is that the machine is intended for many successive runs, either with no reference to each other, or with a minimal, limited reference, and that it can be cleared between such runs; while the brain, in the course of nature, never even approximately clears out its past records. Thus the brain, under normal circumstances, is not the complete analogue of the computing machine but rather the analogue of a single run on such a machine.
We are onto memory, and I definitely appreciate the valid callout on why human brains are not quite analogous to computing machines
Photography is indeed ideal for the permanence and detail of its records, ideal again from the point of view of the shortness of exposure needed to record an observation. It suffers from two grave disadvantages: the time needed for development, which has been reduced to a few seconds, but is still not small enough to make photography available for a short-time memory; and (at present [1947]) the fact that a photographic record is not subject to rapid erasure and the rapid implanting of a new record.
He expected perhaps a bit more from what photography was able to provide in the end as a storage mediums.
We have already spoken of the computing machine, and consequently the brain, as a logical machine. It is by no means trivial to consider the light cast on logic by such machines, both natural and artificial. Here the chief work is that of Turing. We have said before that the machina ratiocinatrix is nothing but the calculus ratiocinator of Leibniz with an engine in it; and just as modern mathematical logic begins with this calculus, so it is inevitable that its present engineering development should cast a new light on logic. The science of today is operational; that is, it considers every statement as essentially concerned with possible experiments or observable processes. According to this, the study of logic must reduce to the study of the logical machine, whether nervous or mechanical, with all its non-removable limitations and imperfections.
This is true in the sense that many psychological states and sequences of thought do not conform to the canons of logic. Psychology contains much that is foreign to logic, but—and this is the important fact—any logic which means anything to us can contain nothing which the human mind—and hence the human nervous system—is unable to encompass.Â
Much which is foreign to logic is a kind wording
All logic is limited by the limitations of the human mind when it is engaged in that activity known as logical thinking.
Banger tweet material
Alright so he goes from logic to psychology, takes a trip through Pavlov and continues through this thing he calls affective tone, basically a feedback mechanism:
Thus there enters into the conditioned reflex something that we may call affective tone. We need not associate this with our own sensations of pleasure and pain, nor need we in the abstract associate it with the advantage of the animal. The essential thing is this: that affective tone is arranged on some sort of scale from negative “pain” to positive “pleasure”; that for a considerable time, or permanently, an increase in affective tone favors all processes in the nervous system that are under way at the time and gives them a secondary power to increase affective tone; and that a decrease in affective tone tends to inhibit all processes under way at the time and gives them a secondary ability to decrease affective tone.
This feels very close to what Donella Meadows leverage points number 2 is about, “The goals of the system”
He proceeds to diagram it out like this:

Basically the totalitizer is a control center aggregating the individual feedback mechanisms. He does point out this isn’t necessarily a separate thing though, it may just be the result of different things working in harmony.
As a final remark, let me point out that a large computing machine, whether in the form of mechanical or electric apparatus or in the form of the brain itself, uses up a considerable amount of power, all of which is wasted and dissipated in heat. The blood leaving the brain is a fraction of a degree warmer than that entering it. No other computing machine approaches the economy of energy of the brain.
Yeah, getem!
The mechanical brain does not secrete thought “as the liver does bile,” as the earlier materialists claimed, nor does it put it out in the form of energy, as the muscle puts out its activity.
Something something bitcoin and proof of work
6. Gestalt and Universals
Oh this is one of my favorite concepts so far, let’s see what we have to learn
How do we recognize the identity of the features of a man, whether we see him in profile, in three-quarters face, or in full face? How do we recognize a circle as a circle, whether it is large or small, near or far; whether, in fact, it is in a plane perpendicular to a line from the eye meeting it in the middle, and is seen as a circle, or has some other orientation, and is seen as an ellipse?
Without going through all the intermediate stages, let us come at once to the eye-muscle feedbacks in man… All these processes can be summed up in one sentence: we tend to bring any object that attracts our attention into a standard position and orientation, so that the visual image which we form of it varies within as small a range as possible.
One of the most remarkable phenomena of vision is our ability to recognize an outline drawing. Clearly, an outline drawing of, say, the face of a man, has very little resemblance to the face itself in color, or in the massing of light and shade, yet it may be a most recognizable portrait of its subject.
He then proposes an algorithm that applies a series of transforms to an image, like reverses, resizes etc, and at each step comparing it to the target image in order to extract similarity. It’s definitely an automatable process, but I don’t quite yet see how that matches even the models he is describing exist in the human eye.
In recent years, there has been a good deal of attention to the problem of the prosthesis of one lost sense by another. The most dramatic of the attempts to accomplish this has been the design of reading devices for the blind, to work by the use of photoelectric cells… It has been suggested that this be done by the use of several photoelectric cells placed in a vertical sequence, each attached to a sound-making apparatus of a different pitch. This can be done with the black of the letters registering either as silence or as sound. Let us assume the latter case, and let us assume three photocell receptors above one another. Let them record as the three notes of a chord, let us say, with the highest note on top and the lowest note below.
Oh boy, if you treat this shit as discrete values you get access to overlapping notes! Fuck, I didn’t think of that in my Metrics audio project!
This was the device, to which we have referred in the introduction, designed by McCulloch for the purpose of adjusting to the height of the type face. In the first design, the selection between dotted line and dotted line was manual.

This was the figure which, when shown to Dr. von Bonin, suggested the fourth layer of the visual cortex
Ahhh, now I get it, they hypothesized that the human eye is doing something similar to the previously mentioned transformation sequences.
This then was the device suggested by McCulloch as that actually used in the brain in the detection of visual Gestalt.
But like, do we have evidence for this?
While we do not know all the details of the performance of the machinery, it is not at all difficult to conjecture a possible machine conforming to the anatomy.
Unconvinced so far
Lastly, the scanning apparatus should have a certain intrinsic period of operation which should be identifiable in the performance of the brain.
Yep, FPS
While this cyclical process then might be a locally determined one, there is evidence that there is a widespread synchronism in different parts of the cortex, suggesting that it is driven from some clocking center. In fact, it has the order of frequency appropriate for the alpha rhythm of the brain, as shown in electroencephalograms
Ah, not quite FPS, this is more akin to CPU clock speed
A blinded man, as distinguished perhaps from one congenitally blind, not only retains visual memories earlier in date than his accident but is even able to store tactile and auditory impressions in a visual form. He may feel his way around a room, and yet have an image of how it ought to look. Thus, part of his normal visual mechanism is accessible to him. On the other hand, he has lost more than his eyes: he has also lost the use of that part of his visual cortex which may be regarded as a fixed assembly for organizing the impressions of sight. It is necessary to equip him not only with artificial visual receptors but with an artificial visual cortex, which will translate the light impressions on his new receptors into a form so related to the normal output of his visual cortex that objects which ordinarily look alike will now sound alike.
Wait oh ahit, that makes a lot of sense
Thus the criterion of the possibility of such a replacement of sight by hearing is at least in part a comparison between the number of recognizably different visual patterns and recognizably different auditory patterns at the cortical level. This is a comparison of amounts of information.
How much is that difference?
In view of the somewhat similar organization of the different parts of the sensory cortex, it will probably not differ very much from a comparison between the areas of the two parts of the cortex. This is about 100:1 as between sight and sound. If all the auditory cortex were used for vision, we might expect to get a quantity of reception of information about 1 per cent of that coming in through the eye.
Woah, that explains why metrics audio was so ineffective, even though it worked
In the other direction, the picture is even more favorable. The eye can detect all of the nuances of the ear with the use of only 1 per cent of its facilities, and still leave a vision of about 95/100, which is substantially perfect.
Holy fuck, eyes are good yo
7. Cybernetics and Psychopathology
Okay this is starting to sound very Night City
Nevertheless, the realization that the brain and the computing machine have much in common may suggest new and valid approaches to psychopathology and even to psychiatries. These begin with perhaps the simplest question of all: how the brain avoids gross blunders, gross miscarriages of activity, due to the malfunction of individual components.
Except when it goes goblin mode lol
Furthermore, if the machine is made to keep all intermediate records of its performance, its complication and bulk will be increased to an intolerable point, by a factor which is likely to be enormously greater than 2 or 3.
LOG_LEVEL=DEBUG
A much better method of checking, and in fact the one generally used in practice, is to refer every operation simultaneously to two or three separate mechanisms… It is conceivable and not implausible that at least two of the elements of this process are also represented in the nervous system. We can hardly expect that any important message is entrusted for transmission to a single neuron, nor that any important operation is entrusted to a single neuronal mechanism.
Well, this still sounds like a guess, but it confirms my priors so it must be true. It’s kinda reasonable from a perspective of reliability: redundant systems
There is therefore nothing surprising in considering the functional mental disorders as fundamentally diseases of memory, of the circulating information kept by the brain in the active state, and of the long-time permeability of synapses.
Okay, so he separates logical bugs from technical (or material as he calls them) bugs. Logical bugs must live in-memory, he argues
Now there is no normal process except death which completely clears the brain from all past impressions; and after death, it is impossible to set it going again.
He almost laments we cannot reboot grandpa
The principal type of surgical intervention which has been practiced is known as prefrontal lobotomy, and consists in the removal or isolation of a portion of the prefrontal lobe of the cortex. It has recently been having a certain vogue, probably not unconnected with the fact that it makes the custodial care of many patients easier. Let me remark in passing that killing them makes their custodial care still easier.
Fucking getem Norbert
If the calls go through n distinct stages of switching, and probability of failure is independent and equal for each stage, in order to get a probability of total success equal to p, the probability of success at each stage must be p1/n. Thus to obtain a 75 per cent chance of the completion of the call after five stages, we must have about 95 per cent chance of success per stage. To obtain a 90 per cent performance, we must have 98 per cent chance of success at each stage.
My boy is legit bringing out the 9s over here, wait till he learns about Github dropping under a single 9 of availability
Thus a switching service involving many stages and designed for a certain level of failure shows no obvious signs of failure until the traffic comes up to the edge of the critical point, when it goes completely to pieces, and we have a catastrophic traffic jam. Man, with the best-developed nervous system of all the animals, with behavior that probably depends on the longest chains of effectively operated neuronic chains, is then likely to perform a complicated type of behavior efficiently very close to the edge of an overload, when he will give way in a serious and catastrophic way.
What are your 9s bro?
In all these cases, a point will come—quite suddenly—when the normal traffic will not have space enough allotted to it, and we shall have a form of mental breakdown, very possibly amounting to insanity.
Cyberpsychoooo
The human brain may be as far along on its road to this destructive specialization as the great nose horns of the last of the titanotheres.
Bro even predicted brainrot
Information, Language, and Society
scarcely more than a philosophical anticipation of the cell theory, according to which most of the animals and plants of moderate size and all of those of large dimensions are made up of units, cells, which have many if not all the attributes of independent living organisms. The multicellular organisms may themselves be the building bricks of organisms of a higher stage
It is very different with man and the other social animals—with the herds of baboons or cattle, the beaver colonies, the hives of bees, the nests of wasps or ants. The degree of integration of the life of the community may very well approach the level shown in the conduct of a single individual, yet the individual will probably have a fixed nervous system, with permanent topographic relations between the elements and permanent connections, while the community consists of individuals with shifting relations in space and time and no permanent, unbreakable physical connections. All the nervous tissue of the beehive is the nervous tissue of some single bee. How then does the beehive act in unison, and at that in a very variable, adapted, organized unison? Obviously, the secret is in the intercommunication of its members.
The odors perceived by the ant seem to lead to a highly standardized course of conduct; but the value of a simple stimulus, such as an odor, for conveying information depends not only on the information conveyed by the stimulus itself but on the whole nervous constitution of the sender and the receiver of the stimulus as well. Suppose I find myself in the woods with an intelligent savage who cannot speak my language and whose language I cannot speak. Even without any code of sign language common to the two of us, I can learn a great deal from him. All I need to do is to be alert to those moments when he shows the signs of emotion or interest. I then cast my eyes around, perhaps paying special attention to the direction of his glance, and fix in my memory what I see or hear. It will not be long before I discover the things which seem important to him, not because he has communicated them to me by language, but because I myself have observed them. In other words, a signal without an intrinsic content may acquire meaning in his mind by what he observes at the time, and may acquire meaning in my mind by what I observe at the time. The ability that he has to pick out the moments of my special, active attention is in itself a language as varied in possibilities as the range of impressions that the two of us are able to encompass. Thus social animals may have an active, intelligent, flexible means of communication long before the development of language.
Is this a Chomsky dig?
Properly speaking, the community extends only so far as there extends an effectual transmission of information. It is possible to give a sort of measure to this by comparing the number of decisions entering a group from outside with the number of decisions made in the group. We can thus measure the autonomy of the group. A measure of the effective size of a group is given by the size which it must have to have achieved a certain stated degree of autonomy.
Taking a short walk into sociology
As in the case of the individual, not all the information which is available to the race at one time is accessible without special effort. There is a well-known tendency of libraries to become clogged by their own volume; of the sciences to develop such a degree of specialization that the expert is often illiterate outside his own minute specialty
There is a belief, current in many countries, which has been elevated to the rank of an official article of faith in the United States, that free competition is itself a homeostatic process: that in a free market the individual selfishness of the bargainers, each seeking to sell as high and buy as low as possible, will result in the end in a stable dynamics of prices, and with redound to the greatest common good… Unfortunately, the evidence, such as it is, is against this simple-minded theory. The market is a game, which has indeed received a simulacrum in the family game of Monopoly… The individual players are compelled by their own cupidity to form coalitions; but these coalitions do not generally establish themselves in any single, determinate way, and usually terminate in a welter of betrayal, turncoatism, and deception, which is only too true a picture of the higher business life, or the closely related lives of politics, diplomacy, and war. In the long run, even the most brilliant and unprincipled huckster must expect ruin; but let the hucksters become tired of this and agree to live in peace with one another, and the great rewards are reserved for the one who watches for an opportune time to break his agreement and betray his companions. There is no homeostasis whatever. We are involved in the business cycles of boom and failure, in the successions of dictatorship and revolution, in the wars which everyone loses, which are so real a feature of modern times.
Not having a good time whatsoever
Naturally, von Neumann’s picture of the player as a completely intelligent, completely ruthless person is an abstraction and a perversion of the facts. It is rare to find a large number of thoroughly clever and unprincipled persons playing a game together.
You’re gonna need to wait until 1991 for MTG
It is only in the large community, where the Lords of Things as They Are protect themselves from hunger by wealth, from public opinion by privacy and anonymity, from private criticism by the laws of libel and the possession of the means of communication, that ruthlessness can reach its most sublime levels. Of all of these anti-homeostatic factors in society, the control of the means of communication is the most effective and most important.
Flows of information, as Donella points out as well
One of the lessons of the present book is that any organism is held together in this action by the possession of means for the acquisition, use, retention, and transmission of information. In a society too large for the direct contact of its members, these means are the press, both as it concerns books and as it concerns newspapers, the radio, the telephone system, the telegraph, the posts, the theater, the movies, the schools, and the church.
I’m gonna end up quoting almost this entire chapter aren’t I?
Thus on all sides we have a triple constriction of the means of communication: the elimination of the less profitable means in favor of the more profitable; the fact that these means are in the hands of the very limited class of wealthy men, and thus naturally express the opinions of that class; and the further fact that, as one of the chief avenues to political and personal power, they attract above all those ambitious for such power.
It’s depressing to see how topical this is
Undoubtedly it would be very pleasant for us mice if the predatory cats of this world were to be belled, but—who is going to do it? Who is to assure us that ruthless power will not find its way back into the hands of those most avid for it?
If not us, then who?
I mention this matter because of the considerable, and I think false, hopes which some of my friends have built for the social efficacy of whatever new ways of thinking this book may contain.
Not a bragging man, Norbert
In other words, in the social sciences we have to deal with short statistical runs, nor can we be sure that a considerable part of what we observe is not an artifact of our own creation. An investigation of the stock market is likely to upset the stock market. We are too much in tune with the objects of our investigation to be good probes.
There’s a note here, and I think our guy is describing a minMax chess AI:
At the stage where the machine is to play twice and the opponent twice, the valuation of a play by the machine is the minimum with respect to the opponent’s first play of the maximum valuation of the plays by the machine at the stage when there is only one play of the opponent and one by the machine to follow.
Learning and Self-Reproducing Machines
This is the first of the extra chapters in the 1961 revised edition
Two of the phenomena which we consider to be characteristic of living systems are the power to learn and the power to reproduce themselves… The result is a certain sort of racial or phylogenetic learning, as contrasted with the ontogenetic learning of the individual. Both ontogenetic and phylogenetic learning are modes by which the animal can adjust itself to its environment.
It has been pointed out by Julian Huxley in his fundamental paper on the mind of birds that birds have a small capacity for ontogenetic learning.
Okay, it’s tempting to go “hurr durr birds are dum” from this but his main point is that most of their education seems phylogenetic, not ontogenetic
Onwards, he devotes a couple pages to discussing chess-playing computers. He proposes a mixed strategy which uses basic algorithms to evaluate moves, with some kind of memory/introspection to improve itself over time.
The idea of a first-order programming, which may be linear in certain cases, combined with a second-order programming, which uses a much more extensive segment of the past for the determination of the policy to be carried out in the first-order programming, has been mentioned earlier in this book in connection with the problem of prediction. The predictor uses the immediate past of the flight of the airplane as a tool for the prediction of the future by means of a linear operation; but the determination of the correct linear operation is a statistical problem in which the long past of the flight and the past of many similar flights are used to give the basis of the statistics.
There is no reason to suppose that the individual motions of the mongoose are faster or more accurate than those of the cobra. Yet the mongoose almost invariably kills the cobra and comes out of the contest unscathed. How is it able to do this? I am here giving an account which appears valid to me, from having seen such a fight, as well as motion pictures of other such fights.
Bro WHAT
To this extent the mongoose acts like a learning machine, and the real deadliness of its attack is dependent on a much more highly organized nervous system.
WHAT?
As a Walt Disney movie of several years ago showed, something very similar happens when one of our western birds, the road runner, attacks a rattlesnake.
Bro where are you even GOING
There is nothing more dangerous to contemplate than World War III.
So let us spend some time there then
Again and again I have heard the statement that learning machines cannot subject us to any new dangers, because we can turn them off when we feel like it. But can we? To turn a machine off effectively, we must be in possession of information as to whether the danger point has come.
The new and real agencies of the learning machine are also literal-minded. If we program a machine for winning a war, we must think well what we mean by winning. A learning machine must be programmed by experience. The only experience of a nuclear war which is not immediately catastrophic is the experience of a war game. If we are to use this experience as a guide for our procedure in a real emergency, the values of winning which we have employed in the programming games must be the same values which we hold at heart in the actual outcome of a war. We can fail in this only at our immediate, utter, and irretrievable peril.
The idea of non-human devices of great power and great ability to carry through a policy, and of their dangers, is nothing new. All that is new is that now we possess effective devices of this kind. In the past, similar possibilities were postulated for the techniques of magic, which forms the theme for so many legends and folk tales. These tales have thoroughly explored the moral situation of the magician.
Clearly the man sees some of the ways in which these thinking machines may escape our grasp, without getting lost in doomsday scenarios.
What we have succeeded in doing is to make a white box which can potentially assume the characteristics of any non-linear transducer whatever, and then to draw it into the similitude of a given black-box transducer by subjecting the two to the same random input and connecting the outputs of the structures in the proper manner, so as to arrive at the suitable combination without any intervention on our part.
He’s reproducing an earlier thought here about replicating systems using a white box set of connections and a training process