Late 16th century; earliest use found in William Shakespeare (1564–1616), playwright and poet. From purse + taking.