That could work... :)

The dragons could have initially been from the mountains on the side before, whatever reason I make up, "migrating" a portion of their population.