The Dark Elves came with Avalon. Avalon brought them over so that the economy of the Mainland could be restarted from the goods and such. Unless you had come before the demons had appeared, which will be, say, two years beforehand, then you'd have to come with Avalon.