@ksm123

I switched to Colemak full-time when I reached over 30 wpm. The annoying factor will be reduced as you become more comfortable with Colemak.

Annoying is not so bad a state to be in, by the standards of changing keyboard layouts. You are, after all, doing something comparable to learning a new language. My transition to Dvorak from QWERTY was downright frustrating (as I'm a bit of a perfectionist). If you find yourself on the brink of sanity, or pushed up against a deadline for a paper you are writing, I recommend switching back to QWERTY momentarily so that you can go back to learning Colemak as soon as possible without failing to meet whatever is expected of you.

If you're mainaining code I suspect you do a lot of text navigation and such. I recommend looking into the Extend layer (see my signature topic) for a very useful add-on to Colemak itself! You didn't state your platform(s), but it's currently implemented well under Windows/PKL and reasonably well under Linux/XKB.

Yes, I saw you talk about ErgoDox. Oh well, at any rate you could use parts of the ErgoDox solution to modify mine; or reversely maybe let my solution inspire yours? :)

Typing test is just a simle translation of text into your muscle typing memory.

Typing what you think is another link from muscle typing memory to another thinking part of your brain. It is harder for two different parts of your brain to work together.

I'm facing a similar problem, despite that my typeracing is at the point I don't really have to think about most of my typing.  If I already know the next few words, it's fine (which I suppose makes sense, since that's rather like copying), but if I have to compose-type the words, I'm very error-prone.

23 April 2013, I've hit average of 47WPM. This point is important for me.

In September 2012 I've switched to mechanical keyboard and learned about not bottoming out my keys. This was the lowest my typing speed got when I was learning to type gently.

@dietsche: I've learned to type most common digraphs and trigraphs with quick rolls in first two weeks of layout switch. You are right it speeds up things a lot. I hope in next few days I'll start to type most common words this way.

Update:
30 April 2013, I've managed to type my way to 52WPM average on TypeRacer, but I still am not comfortable with typing in Colemak. I'm have to think about the letters I type to keep my accuracy above 98%. If I am composing, or let my mind wonder my accuracy, and as a result my speed plummets down.

Update:
10 May 2013, I'm stuck at around 50WPM average.

Update:
17 May 2013, I've managed to hit 55WPM average, my best race is still 58WPM, but my accuracy is getting much better.

Update:

01 June 2013, finally  after two months and a few days after the switch I'm as comfortable with this layout as I used to  be with QWERTY. My speed (57WPM average, 64WPM best) still is a little short of speeds I used to achieve back when I was typing on QWERTY, but I'm back to typing whole short words without thinking about letters there are composed of.

17 June 2013: I've built myself an ErgoDox keyboard. I've programmed it with Colemak layout "softwired" in  keyboard firmware. This way I lost access to international input methods, but now I can use my keyboard with any computer I choose, without worrying about layouts and drivers.
This keyboard seems to be very ergonomic (at a first glance), but its layout is different enough from "standard" staggered keyboard, that it requires some relearning.

25 June 2013: I've been using ErgoDox for about a week, I've given up Colemak mapping done in computer software, and use Colemak mapping in keyboard firmware with "Polish (programmer's)" layout on computer. It gives up access to all those additional symbols I never use, but all Polish diacrtitics are much easier to access. Today I've managed to bump my top Colemak performance to 72WPM its just 4wpm lower then my top performance before the switch.

29 November 2013: It's eight months since initial decision. My speed is still in around 60WPM. I've stopped doing typing tests. The problems with thinking about keys are long gone. Over all I'm happy with the switch.

09 December 2013: Just a quick test I've taken today: