Elliott was listed as the #2 guy for fsociety. They believe Tyrell is the ring leader, plus he's a murder suspect, so Tyrell is the guy they're really after.
The FBI at this stage pretty much know everything about everything, they just lack evidence because Mr Robot has been 5 steps ahead.