Building a Dyson Spherical Solar System

The Earth is certainly super tiny compared to the sun. It's conceptually possible to achieve a stage two civilization to get that same level of energy without building the Dyson sphere. You're developing some other way to extract energy from within the Earth. If you have solar panels around every star in a galaxy then you could harness all of the light that is coming out of a particular galaxy right? In principle if you didn't think building a Dyson sphere was a big enough construction project you could build one around every single star in the galaxy. I can't even say it without laughing it's such a ridiculous idea.