I had to pop off the interior door panel to replace the driver's interior door handle.

Got 99% of the way done, but the top left of it just won't stay fit tight to the metal.

I put in a new pop rivet thing and it still won't hold. It's pushed out about 1/4" and really frustrating me.
The panel came off fine, and all went back together just fine, it's just this one area that won't sit flush and I can't figure the dang thing out.

thanks!