Your impatience will do a lot of things.

Looking forward to your further modifications.

sw sw sw sw sw sw.  I ain't worried.  Switch swoop swizzle swift swill swoon.  It just doesn't appear in that many words.  I'll move my keys where I like.  Today my speed was 23 wpm on typingtest.com.  Still slow but i'll keep you posted.  SWISH.

daily speed reports:

6/5/13 - 15 WPM
6/6/13 - 28 WPM
6/7/13 - 34 WPM
6/8/13 - 35 WPM
6/9/13 - 37 WPM
6/10/13 - 42 WPM

I swapped Y and J.

Further, I think 80-100 wpm with QWERTY was an overestimate.  I think 60 was closer to the truth and I really wish that I had tested my speed.  Now I am committed to cold turkey so I don't want to screw myself over by going back to test.

If you were touch typing for 20 years, your estimate was probably right.  It just feels unatainable right now.

You're making good progress anyway.  At least by the time you are typing at 40wpm, you cease to want to bash your head against the wall repeatedly.

You might not want to eschew Dreymar's words of wisdom, he's rather annoyingly normally on the money.

Colemak's J is where Dvorak places F - and Qwerty's Y.

I don't feel like I struggle that much with the above placement.  I do have to drift my hand though - otherwise it's a bit of a stretch.  It explains why Colemak has quite a different feel on the right hand.  That; and that it doesn't use Qwerty's P poistion for a letter and the other punctuation, lifts some of the burden from the right hand.

However I'm not the biggest fan of using my left hand for typing.  I have been trying alternate fingering on Dvorak's P/Qwerty's R/Colemak F - giving it the middle finger.

@Dreymar, do you use different fingering for the wide mods?

Giving the Colemak layout a cursory glance, If I'd swap anything, it would probably be the B and the J.

The odd thing for me is that when I do look at Colemak's layout, I notice that it's easier on the right hand, and expect it all to be lumped on the left, but then I notice that the left still has Z, X and Q on it and wonder if it really is that overloaded.  At which point, I can't quite figure out where some of the letters have gone!  The subtle changes between layouts can actually have quite a measured effect on the overall feel, so it's difficult to try and imagine these things practically.

Aha, I forgot you used the angle mod.  That would certainly help with the B (that was my introduction to Colemak due to a layout glitch under Debian, where someone had entered the anglemod version of Colemak into the repos!)

I find my right wrist is easy to keep straight, but not so with the left.  If I used an angle mod, and shifted some of my fingering on the top row I could straighten it up a little.  Might be a little hard for me to put into practice.

I'd have to rehome my pipe and backslash.  Perhaps to Qwerty's B position, which actually probably wouldn't be that bad.  It would have helped with vim too under Dvorak, as at first I struggled with the colons placement, and I still can contort my left hand a little because of it.  Weird standard keyboards...

You might consider a wide layout (similar to the one shown below) to move some of that pinkie cover to the right index finger:

That way, your pinkie would only be responsible for one bottom-row key, while the index finger reaches / ? pretty easily.  The main disadvantage is that, on US ASCII keyboards, the quotation key ' " would be displaced to the top row.

(I tried displacing it to Return at some point, but that didn't work out so well..)

Having both hands comfortably reach B is a waste of a spot.  The wide layout (pic above) puts the /? on the right hand's B position, trading away its former, bad pinkie spot.

In your case, if B instead went with the right hand, then /? would just go with the left-B position.

totally used to the new layout for some time.  Just gave the old typing test one try and got 65 wpm on the 2 minute test.