Graphene is an ideal detector material that offers absorption across a large spectral range. Yet, speed and high quantum efficiency are a challenge. In this review we discuss plasmonics as a solution to achieve bandwidths in excess of 100 GHz in combination with high responsivities.