I dont really see the problem tbh. its not like you have fixed seats for lunch right? so basically they can sit wherever they want.
its a but impolite to sit without asking if the seat is free, but like I said, they arent fixed seats.
u might ask yourselves why they are sitting next to you...