And the lights on the network connectors do exactly what they are meant to do: show you the status of the interface.
Nothing connected->interface not in use->no lights.
Yes, it is the reset of the router driving the LEDs at startup until initialization of all the I/O ports.
A lot of routers/switches do that. Don't worry about it.