# Design principles of cell circuits with paradoxical components

See allHide authors and affiliations

Edited by Daniel S. Fisher, Stanford University, Stanford, CA, and accepted by the Editorial Board March 23, 2012 (received for review November 5, 2011)

## Abstract

Biological systems display complex networks of interactions both at the level of molecules inside the cell and at the level of interactions between cells. Networks of interacting molecules, such as transcription networks, have been shown to be composed of recurring circuits called network motifs, each with specific dynamical functions. Much less is known about the possibility of such circuit analysis in networks made of communicating cells. Here, we study models of circuits in which a few cell types interact by means of signaling molecules. We consider circuits of cells with architectures that seem to recur in immunology. An intriguing feature of these circuits is their use of signaling molecules with a pleiotropic or paradoxical role, such as cytokines that increase both cell growth and cell death. We find that pleiotropic signaling molecules can provide cell circuits with systems-level functions. These functions include for different circuits maintenance of homeostatic cell concentrations, robust regulation of differentiation processes, and robust pulses of cells or cytokines.

Gene regulation networks are composed of a handful of recurring circuit elements, called network motifs (1). Theory and experiments have shown that each network motif can carry out specific dynamical functions in an autonomous way, such as filtering noisy signals, generating output pulses, and speeding responses (1).

Here, we ask whether one can apply this approach to the level of circuits made of interacting cells. For this purpose, we consider cells that communicate by means of secreted molecules. These secreted molecules affect cell behaviors such as rate of proliferation and cell death. Previous studies on such cell systems attempted to include many cell types and interactions in a model involving numerous biochemical parameters and variables (2⇓⇓–5). Other works focused on the effects of a single cell type responding, for example, to a ligand that it secretes itself; these works showed the interplay between cell to cell variability and positive feedback, leading to bistability (selection), formation of thresholds for immune response, and memory (6, 7).

Here, we study simple models of circuits made of a few communicating cell types. Because many of the interactions in cell circuits are poorly characterized at present, we seek models in which the exact functional form of the interactions does not affect the conclusions; therefore, models have a degree of generality. We also scan all possible topologies with a given set of components to obtain the widest class of circuits that can perform a given function.

We consider circuit designs that seem to recur in immunology. An intriguing feature of these systems is the fact that many secreted signaling molecules (cytokines) are pleiotropic: they have multiple effects, sometimes antagonistic or paradoxical, such as increasing both proliferation and death of a certain cell type. We find that pleiotropic signals, in the configurations suggested by immune circuits, can provide circuits with specific dynamical functions. We discuss several such functions—homeostatic cell concentrations, robust regulation of differentiation processes, and robust pulses of cells or cytokines—and the corresponding immune circuit examples. The predicted functions can be readily tested experimentally.

## Results

### Fundamental Features of Cell Circuits.

We consider models of cells that interact using chemical signals, such as cytokines, which we will denote generally as ligands. Cells can divide to form new cells of the same type, differentiate to new cell types, secrete ligands, and take up ligands from the medium. Cells are removed by cell death, migration, or differentiation. We define cell circuits as collections of interacting cells that perform specific dynamical functions.

To understand cell circuits, it is useful to study simple models of their dynamics. In this section, we introduce notation and equations as a basis for the following sections. The dynamics of the concentration of cells of type *X* can be described using a first-order differential equation (Eq. **1**):

where α is the cell removal rate, and β is its proliferation rate. The rate of new cell production, β*X*, is proportional to *X*, because all cells arise from existing cells by cell division. Eq. **1** results in a sensitive situation: if β < α, *X* tends to zero, whereas if β > α, *X* tends to infinity (Fig. 1*A*).

Note that nonlinear terms can be added to Eq. **1** to prevent cell concentrations from diverging to infinity. For example, a nonlinear proliferation rate that decreases as cells approach a limiting concentration [e.g., β*X*(1 − *X*/*X _{max}*)] limits the population at the maximal carrying capacity

*X*, in which available volume or other limiting factor runs out. In the present study, we seek mechanisms that can stabilize cell concentrations at values much smaller than the carrying capacity of the body or organ in question.

_{max}Eq. **1** stands in contrast to the typical equation of molecular circuits, where molecule *m* is produced at rate β and removed at rate α (1, 8, 9). The difference is that the production rate of molecules is usually zero order (β rather than β*m*). Thus (Eq. **2**),

which has a nonzero stable steady state *m*_{st} = β/α without need for additional regulation (Fig. 1*B*). Specific molecular circuits can show bistability (1, 8, 9), but these circuits require a special design, such as positive feedback or autocatalysis such that β = β(*m*) is a function of *m* over some range.

The intrinsic instability of Eq. **1** raises the need for regulation of cell proliferation and removal rates. One mode of regulation involves the response of cells to a ligand, with concentration that is denoted by *c*. When ligand is produced by cells *X* and acts on proliferation and removal rates β and α in Eq. **1**, feedback mechanisms can arise. Below, we discuss simple cell circuits that can carry out such feedback.

An additional fundamental process is differentiation, where cell type *X*_{0} gives rise to a different cell type *X*_{1}, and therefore (Eq. **3**),

This simple situation results in dynamics of *X*_{1} that depend on the initial concentration of precursor cells *X*_{0} (Fig. 1*C*). One may expect that concentrations of precursors vary from individual to individual and in the same individual over time, raising the challenge of making the response of the system insensitive to such fluctuations (10⇓⇓–13).

For the sake of simplicity, in the following analysis, we consider only the average cell dynamics, and therefore, no spatial component (7, 14) or stochastic components (6, 15) of the diversity between cells are included. Such factors can be readily added in future studies.

### Homeostatic Cell Concentration with an OFF State by Ligand Enhancement of both Proliferation and Removal Rates.

As mentioned above, achieving a specified cell concentration requires control of proliferation and/or removal rates. We now discuss ways in which such regulation can be achieved.

Consider a cell type *X* that produces ligand *c* that affects the cell's proliferation rate β(*c*) and its removal rate α(*c*). The production–removal equation is (Eq. **4**)

where *c* is produced by *X* (Eq. **5**):

Eqs. **4** and **5** have a form known as integral feedback (16, 17). They allow a nonzero steady state only at a special ligand level *c**, at which proliferation rate equals removal rate β(*c**) = α(*c**).

The way in which β(*c*) and α(*c*) depend on *c* is important for the behavior of the circuit. We consider here the situation found in CD4^{+} T-cell proliferation, where the cytokine *c* = IL-2 produced by these cells is a pleiotropic signal for both their proliferation and death (18, 19). In this system, both β and α increase with *c* (Fig. 2 *A* and *B*).

When β and α both increase as a function of *c* and cross each other with appropriate slopes, a stable steady-state solution is found, *c**, as shown graphically in Fig. 2*D*. Furthermore, when ligand is not present (*c* = 0), the cell population goes to a second fixed point (an OFF state) with no cells, *X* = 0 (because *X* derivative in time equals zero for *X* = 0; Eq. **4**).

Because *X* produces the ligand *c*, Eq. **5** implies that steady state occurs at a unique value of the cell concentration (Eq. **6**):

This steady-state cell concentration *X** (and ligand concentration *c**) is independent of the initial number of cells *X*(*t* = 0) for a wide range of *X*(*t* = 0) values in the basin of attraction of the ON state (Fig. 2*C*). Thus, a stable nonzero steady state is achieved, which contrasts the simple circuit designs with no regulation described above (Fig. 1*A*). At very low initial cell levels, the cell number decays to zero—the OFF state (Fig. 2*C*). The stable OFF state ensures that small fluctuations do not cause a full response.

Other possibilities, such as one rate decreasing with *c* and one rate increasing with *c* levels, abolish either the stability of the OFF state or the stability of the ON state (Fig. 2 *E* and *F*, respectively). These considerations constrain the possible dependence of β and α on *c*.

These predictions can be readily tested experimentally by using different initial levels of T_{h}-effector cells and following their proliferation curves over time (similar to Fig. 2*C*) to test whether differentiated cell levels are insensitive to precursor levels. Indeed, several studies have shown, using adoptive transfer experiments, that precursor amounts are weakly correlated with final levels of differentiated cells (10⇓⇓–13) (*SI Appendix*). For example, Badovinac et al. (10) found that, over a four order of magnitude change of precursor amounts, the change in total effector CD8^{+} T cells is less than one-half an order of magnitude. Recent theoretical explanations rely on negative feedback mechanisms, which can provide partial compensation for precursor levels (20, 21) (additional discussion in *SI Appendix*).

### Analysis of All Circuit Topologies with One Cell Type and One Ligand Shows a Small Class of Mechanisms for Stable Cell Concentrations with an OFF State.

To test the generality of the above mechanism, we studied all possible circuits with one cell type *X* and one ligand *c*. In each circuit topology, cells *X* proliferate and are removed and they can uptake and/or secrete *c*. The ligand *c* affects cell proliferation and/or death rates, and it can be produced by *X* and/or an external source. Models that include all of these effects are (Eq. **7**)

and (Eq. **8**)

where β_{3} is the external *c* source, β_{2}*X* is *c* secretion rate by *X*, the term with α_{0} is the rate of uptake of *c* by *X*, and γ(*c*) is the rate of *c* degradation. Note the use of general functional forms that are assumed only to be smooth and monotonic.

One can omit some of the processes in Eqs. **7** and **8**, resulting in different circuit topologies. Each circuit topology is defined by which of the six terms in Eqs. **7** and **8** is present, yielding a total of 24 topologies that are connected in the sense that *c* affects *X* and *X* affects *c* in some way (Fig. 3*A*). We find that 15 of 24 topologies can yield a stable steady-state solution in which *X* equals *X** > 0 (*SI Appendix*, Fig. S1). Stability conditions can be derived analytically (*Methods*), resulting in inequalities to be satisfied by the various functions in Eqs. **7** and **8**. This analysis shows that the circuits are stable for a wide range of functional forms and parameters. The origin of the stable fixed point in all of these circuits is an effective negative feedback loop (1, 8, 9), in which increase in cell numbers leads to a change in *c* that reduces cell numbers.

We also asked which of the circuits can show both a stable ON state and a stable OFF state. We find that this feature requires that ligand *c* affects both proliferation and death, which occurs in 4 of the 24 circuits (marked in Fig. 3*A*). To have both states, assuming that *X* and *c* positively correlate, β(*c*) − α(*c*) needs to have negative values for low and high *c* levels, while being positive for midvalues of *c*. This situation occurs, for example, when both β(*c*) and α(*c*) are increasing functions of *c* and cross each other, like in the functions α(*c*) = *c* and used in Fig. 2*C*. In other words, the ligand should be paradoxically pleiotropic, increasing both proliferation and removal of cells (*SI Appendix* has a general analysis of the fixed points and their stability). In these circuits, the cell concentration at the ON state, X*, can be tuned by changing the external source of the ligand, β_{3}. The origin of the stable OFF state is an effective positive feedback loop on top of the negative loop required for the stable ON state (8, 9). These two loops are enabled by the paradoxical nature of the ligand.

An analysis of the phase plane dynamics of these circuits is presented in *SI Appendix*, showing that some of them can show a pulse of *c* production, whereas others have monotonic *c* dynamics (*SI Appendix*, Fig. S1).

To summarize, 4 of 24 possible circuit topologies can show a stable steady-state cell level with both ON and OFF states. One of these circuit topologies seems to appear in the CD4^{+} T-cell system (Fig. 2*B*). All four topologies use a paradoxically pleiotropic ligand.

### Differentiated Cell Concentration That Is Robust to the Precursor Cell Concentration.

Next, we consider a situation in which cell type *X*_{1} is continuously produced from precursor cells *X*_{0}. The aim is a circuit that can make the concentration of *X*_{1} independent of the concentration of precursor cells *X*_{0} and yet responsive to an input ligand *c*. Such a circuit can make *X*_{1} insensitive to naturally occurring fluctuations in the level of the precursor cell population.

We begin with a simple circuit based on an immunological system. Then, we analyze all circuit topologies with a precursor cell type and a differentiated cell type that interact with one ligand.

Consider a circuit (inspired by an immunological example described below) in which the ligand *c* increases the rate at which the precursor cell *X*_{0} differentiates to cell type *X*_{1} (Eq. **9**):

Here, *f*(*c*) is an increasing function of *c* that describes signaling that occurs when *c* binds its receptors on *X*_{0} cells, stimulating differentiation. The precursor cells *X*_{0} in this circuit have a second role: they inhibit the ligand by taking it up (by endocytosis). Thus, the ligand removal rate depends on *X*_{0}. Because endocytosis of a ligand or cytokine typically involves its binding to the same receptors that it uses for signaling (22, 23), one can make the important assumption that the uptake rate per cell is proportional to the signaling rate per cell (Eq. **10**)

Note that the same function *f*(*c*) appears in both Eqs. **9** and **10** because of the linked biological mechanisms of signaling and endocytosis (23).

As a result, at steady state, Eq. **10** shows that the ligand reaches a level *c** such that *f*(*c**) is inversely proportional to *X*_{0}, . Plugging this result into Eq. **9** shows that the steady-state concentration of *X*_{1} is independent of *X*_{0}:

This behavior stands in contrast to simpler designs, in which the differentiated cell levels increase with precursor cell levels (Fig. 1*C*). Intuitively, is independent of precursor concentration because the precursors *X*_{0} have two antagonistic roles: they are both the source of *X*_{1} and at the same time, the inhibitor of the stimulatory ligand *c* (Fig. 4). These two effects cancel out the dependence of *X*_{1} on *X*_{0}: more *X*_{0} means a proportional increase in both production of *X*_{1} and inhibition of *c*.

This principle may apply to the differentiation of CD4^{+} T cells (*X*_{0}) into effector cells such as T_{h}2 cells (*X*_{1}) in response to the input ligand *c* = IL-2. In the initial stages of differentiation relevant for the present discussion, IL-2 is found in low but stimulatory levels. The cytokine IL-2 communicates an immune challenge and results in increased levels of helper T cells. At the same time, there exists a second population, regulatory T cells (Tregs). This cell population is roughly proportional to the concentration of CD4^{+} T cells (ranging between 5% and 10% of the CD4^{+} T cells) (24). Tregs complete the circuit by taking up IL-2 by endocytosis using the same IL-2 receptors that bind IL-2 to stimulate differentiation of CD4^{+} T-cells (6, 7, 25). This system was recently modeled by Busse et al. (7), including its spatial organization, showing that Tregs compete for IL-2; thus, their levels set a threshold for the immune response. In the present context, we find that this circuit (Fig. 4) leads to a steady-state level of helper T cells that is independent of the amount of precursors but responsive to the level of input signal through the parameter β_{3}. This result can be readily tested experimentally by varying precursor CD4^{+} T-cell concentration and monitoring the helper T-cell response to a given stimulus (Fig. 4*C*).

### Only a Small Number of Circuit Topologies with a Differentiation Process and One Ligand Show Robust Differentiated Cell Levels.

To test the generality of the above mechanism, we considered all circuit topologies with two cell types: a precursor *X*_{0} that differentiates into cell type *X*_{1} and one ligand. The ligand can be secreted and endocytosed by either or both cell types and/or externally produced or degraded. The ligand affects *X*_{0} differentiation rate, *X*_{1} proliferation, and/or death rate. In all circuits, we assume that endocytosis rate is proportional to the signaling rate by the ligand as discussed above.

In total, there are 280 such connected topologies (19 of which are shown in Fig. 3*B*). Of these, we find that only four topologies show a stable steady-state concentration of differentiated cells *X*_{1}, which is independent on *X*_{0} concentration (*SI Appendix*, Fig. S2). These topologies are highlighted in Fig. 3*B*. The circuit topology of the previous section is one of these four topologies. The other three topologies differ in the absence or presence of *X*_{1} proliferation and in the source of *c*, allowing for production of *c* by *X*_{1}.

These four circuit topologies show that the two antagonistic roles of the precursor cells—creating *X*_{1} cells and at the same time, inhibiting the ligand—are essential for achieving homeostasis of differentiated cells in the present class of models.

The mathematical reason for the independence of *X*_{1} on *X*_{0} in these mechanisms, discussed in *SI Appendix*, is that a variable composed of a combination of *X*_{1} and *c* shows integral feedback. *SI Appendix* also discusses additional topologies that have *X*_{1} independent of *X*_{0} but require specific functional forms for the interactions (such as linear forms).

### Cell Circuits That Can Provide Pulse-Like Dynamics of Cells or Cytokines.

We conclude with two examples of circuits that can produce pulse-like dynamics. The function of these circuits depends on specific mathematical forms for some of the interactions. The first circuit, based on the incoherent feedforward loop (IFFL) design (1), produces a pulse of cells in response to a step-like stimulus rather than a prolonged response. In this sense, it shows sensory adaptation (8, 26). Furthermore, in a certain parameter range, this circuit can sense fold changes (relative changes) in input ligand rather than absolute changes (27⇓–29) (Fig. 5*C*).

A possible example of such a circuit occurs in the context of T_{h}17 cell differentiation (Fig. 5*B*). The paradoxical pleiotropy here is that TGF_{β} induces differentiation to two cell types with opposing effects (T_{h}17 and iTregs) (30, 31).

Finally, we consider a cell circuit that can produce a pulse of secreted cytokine (the output) in response to an input cytokine. The special feature of this circuit is that the output pulse depends on the presence of the input, but its shape (including amplitude and decay time) are independent on the amount of the input cytokine. In the circuit, the input cytokine *c*_{1} causes precursor cells *X*_{0} to differentiate into *X*_{1} cells. *X*_{1} cells produce the output cytokine *c*_{2}, which increases their own proliferation rate. The input cytokine *c*_{1} is pleiotropic in that it inhibits the production of *c*_{2} by *X*_{1}. The equations in Fig. 5 describe the circuit using first-order terms for *c*_{1} and *c*_{2}. Note that this architecture differs from the IFFL, which is also a pulse-generating circuit (1, 32), because it includes a feedback loop (*X*_{1} produces *c*_{2}, which enhances *X*_{1} proliferation).

The dynamics of the output *c*_{2} are pulse-like in response to addition of *c*_{1} (Fig. 5*F* and extended analysis in *SI Appendix*). The elements of this circuit are found in the IL-27–dependent differentiation of T_{h}1 cells (Fig. 5*E*). The paradoxical role of IL-27 was initially discovered when knockout of the IL-27 receptor in T_{h}1 cells caused an unexpected T-cell hyperactivity (33).

## Discussion

This study explored circuits made of communicating cells that display specific dynamical functions. These functions include formation of stable homeostatic cell concentrations with an OFF state, differentiated cell levels that are independent on precursor cell concentration, and circuits that generate pulses of cells or cytokines. The function carried out by each circuit depends on the specific architecture of its interactions and especially on components which have paradoxical or opposing effects. The models in many of the cases do not depend on the exact functional form of the interactions. We also provided examples from the immune system that seem to have the elements of each circuit type.

The biological functions discussed here might be useful in the immune system and also in other contexts, such as development. Homeostatic amounts of differentiated cells (Figs. 2–4) allow for a response that resists fluctuations in precursor cell amounts and initial cell amounts. This mechanism provides a precise steady-state cell concentration, which can also be tuned by ligand signals. In the immune system, this mechanism can help overcome variations in the number of lymphocytes responding to a given antigen, variations in sizes of lymph nodes, or variations in the amounts of predifferentiated cells. In the context of development, such circuits might help maintain a desired concentration of a cell type in a growing organ, independent of the precursor cell population.

Fold-change detection mechanisms (Fig. 5) can provide cell circuits with features analogous to well-studied sensory systems ranging from the visual and auditory system to bacterial chemotaxis (26, 27). Responding to fold changes rather than absolute change allows for detecting signals above noisy backgrounds and filtering out variations that multiply the input by a constant, such as variations in cell numbers and other parameters (27).

The last mechanism considered here for creating a robust, stereotyped pulse response (Fig. 5) can allow a precise dose of output cytokine, despite fluctuations between individuals (such as different lymph node volumes). Because cytokines are potent regulators of cell functions, their secretion must be carefully regulated. The present mechanism allows a sizable response, with amplitude that is not too large or too small, avoiding the deleterious effects of immune hyperactivity. Such stereotyped pulse-like doses seem to occur in the context of pulsing transcription factors (34, 35) such as p53 in response to DNA double-stranded breaks, where pulse amplitude and shape are independent on signal level (36). A similar situation may also occur in hormone pulses (26) and might also be relevant for neurotransmitter production.

The present study provides a functional explanation of why many cytokines have paradoxically opposite effects on different processes. We find that such paradoxical components can provide cell circuits with useful biological functions: homeostasis (robustness) and pulse generation.

A principle that emerges is that paradoxical components may have one of two general effects depending on whether the functions carried out by the component act at the same time or at a delay (Fig. 5*G*). When there is no delay, antagonistic pleiotropy helps maintain homeostasis (Figs. 2 and 4). When there is a delay, it produces a robust pulse output (Fig. 5). This principle applies also to molecular circuits: bifunctional enzymes can lead to homeostasis by carrying out antagonistic functions at the same time (37⇓–39), and IFFLs lead to pulses by carrying out antagonistic functions at a delay.

The present analysis includes the simplest considerations of population averages without taking space into account. Additional work can examine the effects of cell–cell variability (e.g., in receptor numbers), stochastic effects in sensing, and the effects of the spatial distribution of cells and ligands (7, 14). Spatial organization can be important, because the combined effect of ligand diffusion and uptake creates a microenvironment of limited extent in which a given cell can affect its neighbors (7, 14). The present models make specific predictions for experiments, in which certain dynamics are expected to be insensitive to varying cell or cytokine concentrations.

More generally, it would be interesting to map additional principles from the level of molecular circuits to the level of circuits of interacting cells. Cell circuits may provide building blocks to understand complex cellular networks.

## Methods

To analyze the fixed point stability of Eqs. **7** and **8**, we calculated the Jacobian (J) and asked when the determinant and trace obey Det(J) > 0 and Tr(J) < 0. The following inequalities should hold for the different fixed points to be stable. The point *X* = 0, is stable when β(*c*_{0}) < α(*c*_{0}). When β_{3} = 0, then *c*_{0} = 0, and the condition sets proliferation to be lower than removal rate at zero ligand concentration, making the OFF state stable. The ON state fixed point *X* = *X**, *c* = *c** is stable when −(β′(*c**)) − α′(*c**))(β_{2} − α_{0} *f*(*c**)) > 0, which means that either β′(*c**) > α′(*c**) and β_{2} < α_{0} *f*(*c**) or β′(*c**) < α′(*c**) and β_{2} > α_{0} *f*(*c**) (*SI Appendix*).

## Acknowledgments

U.A. is the incumbent of the Abisch-Frenkel Professorial Chair. U.A. thanks the European Research Council (FP7) and the Israel Science Foundation for support. N.F. is the incumbent of the Pauline Recanati Career Development Chair of Immunology. N.F.'s research was supported by the International Human Frontier Science Program Organization.

## Footnotes

- ↵
^{1}To whom correspondence should be addressed. E-mail: urialon{at}weizmann.ac.il.

Author contributions: Y.H., Y.E.A., A.E.M., N.F., and U.A. designed research, performed research, analyzed data, and wrote the paper.

The authors declare no conflict of interest.

This article is a PNAS Direct Submission. D.S.F. is a guest editor invited by the Editorial Board.

This article contains supporting information online at www.pnas.org/lookup/suppl/doi:10.1073/pnas.1117475109/-/DCSupplemental.

## References

- ↵
- ↵
- ↵
- Zheng H,
- et al.

- ↵
- ↵
- ↵
- ↵
- Busse D,
- et al.

- ↵
- ↵
- ↵
- ↵
- Hataye J,
- Moon JJ,
- Khoruts A,
- Reilly C,
- Jenkins MK

- ↵
- Whitmire JK,
- Benning N,
- Whitton JL

- ↵
- Quiel J,
- et al.

- ↵
- ↵
- Deenick EK,
- Gett AV,
- Hodgkin PD

- ↵
- ↵
- Yi T-M,
- Huang Y,
- Simon MI,
- Doyle J

- ↵
- ↵
- ↵
- Bocharov G,
- et al.

- ↵
- ↵
- ↵
- ↵
- ↵
- ↵
- Keener JP,
- Sneyd J

- ↵
- Shoval O,
- et al.

- ↵
- ↵
- ↵
- ↵
- ↵
- Basu S,
- Mehreja R,
- Thiberge S,
- Chen M-T,
- Weiss R

- ↵
- ↵
- ↵
- ↵
- ↵
- Batchelor E,
- Goulian M

- ↵
- Shinar G,
- Milo R,
- Martínez MR,
- Alon U

- ↵

## Citation Manager Formats

## Article Classifications

- Biological Sciences
- Systems Biology