Here we introduce a novel amplitude-only Fourier-optical processor paradigm capable of processing large-scale ~(1,000 × 1,000) matrices in a single time-step and 100 microsecond-short latency. We exemplary realize a convolutional neural network (CNN) performing classification tasks on 2-Megapixel large matrices at 10 kHz rates, which latency-outperforms current GPU and phase-based display technology by one and two orders of magnitude, respectively. Training this optical convolutional layer on image classification tasks and utilizing it in a hybrid optical-electronic CNN, shows classification accuracy of 98% (MNIST) and 54% (CIFAR-10).
|