Union representatives said they don’t know how many people will be laid off at Kansas City’s IRS branch.