I had the same problem. Used a pneumatic nailer with small brads, worked fine.Be sure to hit the wood frame. If the cause is expansion from humidity you might have to remove the panel and cut 1/8 inch or so from the bottom and sides.
I also put molding on the sides for added strength.