Looks like proccing him in a timely manner and having a good bard are going to be the two keys to that fight.
I assume they have some kind of resistance to full duration lullaby, or you should have been able to sleep them for longer than that. As a tip, you should be able to get another 40 seconds Lullaby duration by using Clarion Call with full JPs.
XI Wiki


