The Interstellar Boundary Explorer (IBEX) observes enhanced Energetic Neutral Atoms (ENAs) emission in the keV energy range from a narrow (~20° wide) "ribbon" in the sky that appears to be centered on the direction of the local interstellar (LIS) magnetic field. The Milagro collaboration, the Asγ collaboration and the IceCube observatory have recently made global maps of cosmic ray fluxes in the TeV energy range, revealing anisotropic structures ordered in part by the local interstellar magnetic field and the interstellar flow. This paper following from a recent publication in Science makes the link between these disparate observations by developing a simple model of the magnetic structure surrounding the heliosphere in the Local Interstellar Medium (LISM) that is consistent with both IBEX ENA fluxes and TeV cosmic ray anisotropies. The model also employs the revised velocity direction of the LIC derived from neutral He observations by IBEX. By modeling the propagation of cosmic rays through this magnetic field structure, we specifically show that (1) the large-scale TeV anisotropy provides a roughly consistent orientation for the local interstellar magnetic field at the center of the IBEX Ribbon and corroborates the ~ 3 μG magnitude of the local interstellar magnetic field derived from IBEX observations of the global heliosphere; (2) and small-scale structures in cosmic rays (over < 30° angular scales) are influenced by the interstellar field interaction with the heliosphere at energies < 10 TeV. Thus, we provide a link between IBEX ENA observations, IBEX neutral observations of interstellar He, and TeV cosmic ray anisotropies, which are strongly influenced by the interactions between the local interstellar magnetic field, the flow of the local interstellar plasma, and the global heliosphere.