My last attempt at astrophotography looked like someone sprinkled salt on a black tablecloth. Stacking more frames than I can count is the only thing that ever helps me, honestly. Maybe my sensor just has a nervous disposition.
Could stacking just be hiding the real problem? Maybe your single exposures need work with better settings or less light pollution. Fixing that might beat just adding more frames forever.