Ferromagnetic antidot lattices are important systems for magnetic data storage and magnonic devices, and understanding their magnetization dynamics by varying their structural parameters is an important problems in magnetism. Here, we investigate the variation in spin wave spectrum in two-dimensional nanoscale Ni80Fe20 antidot lattices with lattice symmetry. By varying the bias magnetic field values in a broadband ferromagnetic resonance spectrometer, we observed a stark variation in the spin wave spectrum with the variation of lattice symmetry. The simulated mode profiles showed further difference in the spatial nature of the modes between different lattices. While for square and rectangular lattices extended modes are observed in addition to standing spin wave modes, all modes in the hexagonal, honeycomb, and octagonal lattices are either localized or standing waves. In addition, the honeycomb and octagonal lattices showed two different types of modes confined within the honeycomb (octagonal) units and between two such consecutive units. Simulated internal magnetic fields confirm the origin of such a wide variation in the frequency and spatial nature of the spin wave modes. The tunability of spin waves with the variation of lattice symmetry is important for the design of future magnetic data storage and magnonic devices.