I just assumed it was because Littlefinger rhymes with Middle Finger.