AbstractModern imaging systems can be enhanced in efficiency, compactness, and application through the introduction of multilayer nanopatterned structures for manipulation of light based on its fundamental properties. High transmission multispectral imaging is elusive due to the commonplace use of filter arrays which discard most of the incident light. Further, given the challenges of miniaturizing optical systems, most cameras do not leverage the wealth of information in polarization and spatial degrees of freedom. Optical metamaterials can respond to these electromagnetic properties but have been explored primarily in single-layer geometries, limiting their performance and multifunctional capacity. Here we use advanced two-photon lithography to realize multilayer scattering structures that achieve highly nontrivial optical transformations intended to process light just before it reaches a focal plane array. Computationally optimized multispectral and polarimetric sorting devices are fabricated with submicron feature sizes and experimentally validated in the mid-infrared. A final structure shown in simulation redirects light based on its angular momentum. These devices demonstrate that with precise 3-dimensional nanopatterning, one can directly modify the scattering properties of a sensor array to create advanced imaging systems.