Middle English. Probably partly (in early use) from Anglo-Norman ryflour, Middle French rifleur, riffleur robber, thief, and partly from rifle + -er. Compare post-classical Latin riflator, rifliator, riflerius (after 1341 in a British source).

Late 18th century. From rifle + -er.