I didn't count Deadpool or the Wolverine Movies as the question was about X-Men movies yo-yoing back and forth. And I think Wolverine 2 was the only one to tie in directly with any x-men movies directly and that was an after credits scene to set up days of future past.