no, it's nothing to worry about - this is normal.
Firstly, garbage collection (ie checking for expired sessions) happens about once a minute (actually not a round number.) So, yes, they are going to happen in "batches".
Secondly, the number of threads allowed to be used for deleting sessions is small, so as not to impact overall server performance. So if there are a large number of sessions then it can take several minutes to work through them all.
Incidentally, if you load the server, and there's a state file in play, then all of those sessions will likely have expired, and will need to be deleted soon after the server starts.
Cheers
Bruce