Universal Linear Optics Revisited: New Perspectives for Neuromorphic Computing with Silicon Photonics