I only have problems with the pinky when it's expected to do feats such as reach for the enter key or backspace.

The pinkies are paradoxical really. They're slow when it comes to digraphs and stretches, and yet they do a lot of odd jobs on the keyboard! As the previous posters say, they're quite okay for just pressing keys with, and only have problems with awkward stretches.

It does make sense that the outermost fingers on each hand aren't really 'pieces of crap', even if they're on the outward side of the hand.

I remember I used to make a lot of mistakes with i and o. Practising typing words like these helped me:

lotion station sirloin potion groin etc.

After a while it didn't seem to be a problem, at least for me.

It's not really a mistake, though. Hand structure basically dictates outside to inside hand rolls are faster than inside to outside. So your hands more naturally type oi than io, which is why you'll often "mistype" that combo. Considering IO happens about six times more often than OI, and that O occurs more often than I in the dictionary, I'm now of the opinion that O and I should be swapped on the Colemak keyboard.

on the other hand, typing "you" is very reliable for me.  Have no trouble doing a out-in roll to form the word without thinking.

Every time people start picking Colemak apart like this, I just get a better appreciation for what Shai did in balancing all the variables. 

Also to say "hand structure basically dictates outside to inside hand rolls are faster" without scientific literature citations is not convincing.  A roll for like "io" in "tion" is just as fast for me as "in" in "ting" .  and both common sequences take about the same time for me.

I hope nobody thinks I'm picking Colemak apart, I'm very happy I made the change.
And to stress what I said earlier I have the problem with "you" mainly on light keyboards, such as my Realforce 87U which has lower-force switches for the weaker fingers like the pinkie and ring fingers.

I really wish that the standard keyboard (not some prohibitively expensive variant) had a split Enter/Space bar instead of just the long Space bar.

Therefore, these days I hit CapsLock+Space for Enter, which actually feels easier to me than just the right-hand Enter. At first glance that makes no sense whatsoever since you're still using a pinky in addition to another key, but I feel it works since I don't have to leave my home position that way.

The single best thing you can do for your pinkies is have auto-capitalization on your OS like it does on my Droid.  Saves on shift usage a TON.

What's more - it's really nice (I think)!  :)

The 'extend' positions I use the most besides the Space -> Enter are:
- UNEI arrows, LY Home/End, JH PageUp/PageDown
- AST Alt/Shift/Ctrl (for use with the other extend keys, such as Ctrl-Shift-Arrows for selecting words)
- O; Backspace/Delete
- WR scroll wheel up/down
- FP Browser back/forward
- Q Esc (very nice)
- ZXCV GUI Undo/Cut/Copy/Paste
- 1 through = F# keys (especially A+4 for closing programs)
- F1-F12 multimedia keys (play/prev/next/stop, mute/vol-/vol+/player, Browser(Home)/Mail/Explore/Calc)

Heh, that's many of the keys accounted for there. Then there's GDBØKM for a click-mouse that's not good but helps moving the cursor out of harm's way when necessary. The ' key for Menu is quite neat too.

Using these also inspires me to use other shortcuts like Tab, Ctrl-W etc more extensively. They also facilitate left-hand-only functionality for some situations which is very handy because the right hand is busy mousing (but shouldn't have to mouse over to a tiny button to close a window for instance).