Amen did specifically say that it's a goal he wants to work towards, indicating that he knows he can't outright ban slavery. He acknowledges its effects on the kingdom's economy. So maybe approach this matter with an economist mind set?

EDIT: Also, we still have that speech to worry about.