Your papers are flying out between the frames…. the faster you go the more stuff happens between the frames so they find holes faster.
Solution:
In your Project settings (cmd or ctrl) D.
The Dynamics : expert tab you can change the Steps per frame try some higher settings.
With your animation now 10 works but if you change some settings you may need more.
As this project is you don’t need to change it, but sometimes you get a similar issue from using the wrong solver shape… on your rigid body tag Collision:Shape is set to Auto, generally Moving mesh is the answer.
/Randy