01

A grid, before the network

Five buses. Five connections. One question: what can each node learn from its neighbors?

Keep the relations in view

Suppose five buses in a small power-grid sketch each carry a feature. You want a model that can combine a bus's own information with information from connected buses. A table can store the features, but the table's row order does not say who is connected to whom. The graph supplies that missing relation.

We will use the shape of a grid to make message passing inspectable. The values are invented, dimensionless features. They are not voltage, power, fault probabilities, or calibrated stress readings. No electrical equation runs underneath the picture.

FIG-GRIDConnectivity is the input relation; position only arranges the drawing.
Five-node message graphUndirected toy graph: AB, AC, BC, CD gate 1, DE. A state 2.000; B state 0.000; C state 1.000; D state 3.000; E state 0.000. Layout is not geography; values are dimensionless.C–D: 1 gateA2.000B0.000C1.000D3.000E0.000

TOY INPUT · initial features

Five nodes, five undirected edges
NodeNeighborsCount
AB, C2
BA, C2
CA, B, D3
DC, E2
ED1

The triangle meets a two-edge branch at C. E can reach A through D and C, but has no direct edge to A.

A graph is a set of nodes and a set of edges. Here the nodes are A, B, C, D and E. The five undirected edges are AB, AC, BC, CD and DE. Undirected means that our model permits messages in both directions along each listed connection. It says nothing about the direction of electrical flow.

A's neighbors are B and C. C's neighbors are A, B and D. E has only D. Move the circles around on the page and those neighbor sets stay the same: a graph's drawn position is different from its connectivity.

CL-001 · Gilmer et al., §2: attributed graph inputs

A number attached to a node

A feature is a recorded input attached to an entity. Write the input at node ii as xix_i. In A–E order, our input is:

x=[2,  0,  1,  3,  0]⊤x=[2,\;0,\;1,\;3,\;0]^\top

The superscript ⊤\top indicates a column: five rows, one feature per node. A richer input could give each node a vector—an ordered list of several features. We start with a scalar, one number, so every operation fits on paper.

A hidden state is the representation carried between layers. We write it as hi(ℓ)h_i^{(\ell)}, where ℓ\ell counts layers. At the start, set hi(0)=xih_i^{(0)}=x_i. The network will change states while the input remains the original record.

Edges can also carry features. We assign each edge a synthetic gate eij=1e_{ij}=1. Later we will halve the C–D gate. This multiplier scales a model message; it is not a measured property of an electrical line.

CL-007 · Toy assumption: all five values, edge gates and the graph itself were chosen for this lesson.

A representation is a starting point

So far, we have a graph and features. We have not specified what to predict, what counts as a good prediction, or how to learn parameters. Those are separate modeling choices.

The immediate task is smaller: compute a new state for every node using the same local rule. If you can explain what C receives, you can reconstruct the main mechanism of a message-passing layer. Then we can ask how far a local change travels.

CL-014 · Model boundary: topology chooses communication paths. This toy contains no physical power-balance or conservation equation.