4.1 Information Concept in Cybernetics

The information concept in cybernetics refers to the specific way that Norbert Wiener and the cybernetic tradition understood and deployed the concept of information—not merely as a synonym for "data" or "knowledge," but as a technical concept tied to uncertainty, pattern, and the regulation of purposive behavior. Wiener's treatment of information was closely parallel to but conceptually distinct from Claude Shannon's simultaneous mathematical theory, and the relationship between these two information concepts—both foundational to cybernetic communication theory—is nuanced and important to understand.

Wiener's Formulation: Information as Patterned Difference

Wiener's famous statement, "information is information, not matter or energy," encapsulates one of cybernetics' key claims: information is a category in its own right, not reducible to physical substance or physical energy. Information is what distinguishes organized from disorganized states—it is the measure of pattern, structure, and organization in a system.

This formulation positions information as the opposite of entropy: if entropy measures the degree of disorder, randomness, and uniformity in a system, information measures the degree of order, pattern, and organized complexity. A crystal has less information than an organism because its pattern is highly repetitive and predictable; an organism has more information because its organized complexity is far less predictable from simple principles.

In cybernetic terms, information is what allows a system to distinguish between alternative states and to respond differentially to those alternatives. A thermostat uses temperature information to distinguish "too cold" from "too warm" and to activate heating or cooling accordingly. An organism uses sensory information to distinguish "prey" from "predator," "food" from "poison," "safe" from "dangerous," and to respond with appropriate behavior. A human communicator uses linguistic information to distinguish "a request" from "an assertion," "irony" from "sincerity," "emergency" from "routine."

The Negentropy Connection

Wiener identified information with negative entropy (negentropy)—the quantity that is the opposite of thermodynamic entropy. This identification was not merely metaphorical: both Shannon's information-theoretic entropy and Boltzmann's thermodynamic entropy are measured by the same mathematical formula:

The difference is in interpretation: thermodynamic entropy measures the number of possible microscopic arrangements consistent with a system's macroscopic properties (the more arrangements, the higher the entropy, the more disordered the system); information-theoretic entropy measures the average uncertainty about which symbol a source will produce (the more equally probable the alternatives, the higher the entropy, the more information each symbol carries).

The formal identity of the two formulas suggests a deep connection between information and physical organization. Living systems maintain their organized complexity—maintain negative entropy—by continuously importing information from their environments. Communication is the process through which this negentropic resource flows: messages carry information that enables receiving systems to distinguish states, reduce uncertainty, and regulate their behavior more precisely.

Information in the Feedback Loop

The cybernetic concept of information acquires its full significance in the context of feedback-regulated behavior. In the basic cybernetic feedback loop, information flows in two essential circuits:

Forward information flow: information about the environment (the position of the target, the current temperature, the content of a communication partner's message) flows from the sensor to the controller, enabling the controller to form a model of the current state.

Error information flow: information about the discrepancy between the current state and the reference state (the desired position, the desired temperature, the desired understanding) flows from the comparator to the effector, enabling the effector to generate corrective action.

Without this information, purposive behavior is impossible: a missile without target information cannot guide itself; a thermostat without temperature information cannot regulate heating; a communicator without feedback information about how their message was received cannot adjust their communication to achieve better understanding.

Information in the cybernetic sense is therefore intrinsically purposive: its significance is always relative to a system's goals and reference states. Information that matters for one system's purposes may be irrelevant to another's—what constitutes significant information depends on what the system is trying to achieve.

Wiener vs. Shannon: Parallel Developments, Different Emphases

Wiener and Shannon arrived at essentially the same mathematical formalism for measuring information through parallel but independent developments. The mathematical structure was recognized as identical; the conceptual emphasis differed:

Shannon's emphasis: Shannon was primarily concerned with the engineering problem of efficient and reliable signal transmission. His information theory asked: given a source with a certain statistical structure, and a channel with certain capacity limitations and noise properties, what is the maximum rate at which information can be transmitted reliably? Shannon's concept of information was explicitly syntactic: it measured statistical uncertainty without reference to meaning.

Wiener's emphasis: Wiener was primarily concerned with the role of information in purposive, goal-directed behavior in biological and social systems. His cybernetic concept of information emphasized its role in enabling feedback-based regulation: information is what allows a controller to correct errors and maintain goal states against disturbance. Wiener's concept of information was pragmatic: it was understood in terms of its function in adaptive, purposive systems.

These different emphases produced different applications. Shannon's approach led to the engineering of communication systems—channel coding, data compression, error correction—where the content of messages is irrelevant and only their statistical properties matter. Wiener's approach led to the analysis of regulatory systems—servo-mechanisms, homeostatic biological systems, social control processes—where information's role in maintaining organized behavior is central.

The Meaning Gap and Cybernetic Information

Both Wiener and Shannon recognized that their technical concept of information did not capture meaning—the semantic content of messages that communicators actually care about. Shannon was explicit: his theory addressed only the technical problem of signal transmission and "has nothing to do with meaning." Wiener was equally clear that the formal measure of information quantity did not determine the significance of the information for regulatory purposes.

This creates the "meaning gap" in cybernetic information theory: the formal theory measures how much information is present (in the uncertainty-reduction sense) but cannot specify what the information is about, whether it is true, or why it matters.

Attempts to extend cybernetic information concepts to meaning include:

Semantic information: the approach developed by Bar-Hillel and Carnap, which attempts to measure the semantic content of statements by analyzing the logical space of possible worlds they rule out. A statement carries more semantic information the more possible worlds it excludes.

Purposive information: defining information by its functional significance for the receiving system's goals rather than by its statistical properties. Information that enables more precise goal-directed action has more information (in the purposive sense) than information that does not, regardless of its statistical uncertainty.

Contextual information: recognizing that the same signal carries different information depending on the context in which it is received—including the receiving system's current state, its prior knowledge, its goals, and its interpretive frameworks. Context-dependent information concepts are inherently relational: information is not a property of the signal alone but of the signal-in-context.

Information and Communication Quality

Cybernetics' information concept provides a framework for thinking about communication quality beyond mere accuracy of transmission:

Information richness: the quantity of information conveyed per unit of communication. High-information communication is novel, surprising, and uncertainty-reducing; low-information communication is repetitive, expected, and redundant. Communication quality requires calibrating information richness to the receiver's needs: too little information fails to inform; too much overwhelms processing capacity.

Information relevance: the degree to which the information conveyed is relevant to the receiver's goals and decision-making. Relevant information enables better goal-directed action; irrelevant information, however accurate and surprising, does not contribute to purposive functioning.

Information timing: the timeliness of information for its intended use. Information that arrives too late to influence the relevant decision or response has zero practical value regardless of its accuracy and relevance.

Information fidelity: the accuracy with which the received information matches the transmitted information. Noise degrades fidelity; redundancy and error correction restore it.

Information integration: the degree to which new information can be connected with existing knowledge to form coherent, actionable models. Information that cannot be integrated—because it conflicts with existing beliefs, requires unavailable context, or exceeds the receiver's interpretive frameworks—cannot be used regardless of its formal information content.

These dimensions of communication quality extend the cybernetic information concept from the narrowly technical to the broadly functional, providing a richer framework for analyzing and improving communication across the range of contexts in which cybernetic communication theory is applied.