I have trouble reading small text and images, and I've experienced this as well. It's particularly bad when an article has an infographic that's clearly designed to be viewed on a desktop. Completely disregarding my "force enable zoom" browser setting, AMP won't let me make those images any bigger than the width of my phone. I always have to switch to the actual site, wasting my time loading two pages.