Here we show a nanophotonic RNS arithmetic implementation by spatially shifting the input waveguides relative to a crossbar routers’ outputs, where the moduli are represented by the number of waveguides. This highly parallelizable in-the-network kernel processes information at 10’s of ps suitable for real-time computing.