Pruning Apple Tree Results in Very Little Fruit?

We have an apple tree that every year sends out long thin branches from the end of each limb. We tried pruning them, but then had very few apples. What's the problem?

Hardiness Zone: 2a

By Alma Barkman from Winnipeg