The three commonly considered pathways for hot Jupiter formation are in situ formation, runaway accretion in the outer disk followed by disk migration, and tidal migration (occurring after the disk has dissipated). None of these explains the entire observed sample of hot Jupiters, suggesting that different selections of systems form via different pathways. The way forward is to use observational data to constrain the migration pathways of particular classes of systems, and subsequently assemble these results into a coherent picture of hot Jupiter formation. We present constraints on the migratory pathway for one particular type of system: hot Jupiters orbiting cool stars (T< 6200 K). Using the full observational sample, we find that the orbits of most wide planetary companions to hot Jupiters around these cool stars must be well aligned with the orbits of the hot Jupiters and the spins of the host stars. The population of systems containing both a hot Jupiter and an exterior companion around a cool star thus generally exist in roughly coplanar configurations, consistent with the idea that disk-driven migratory mechanisms have assembled most of these systems.