It's been over a month since I've discovered DreymaR extended mode and started using it after modifying it slightly.
In fact I only uses a few keys (the one I modified) but it works really well. For peoples who don't know what the extended mod is, is just having custom mapping
by pressing the caps-lock key.
As a vim user I basically just need some qwerty back to their normal position.
What I've done is remap the cursor key to their vim equivalent so the first row becomes

    left down up right : backspace
      h     n    e   i      o  '   (colemak)
      h     j     k   u     ;   '  (qwerty)

I also added page up and page down to L and U (U and I in qwerty), but I never use them.

You could try it There. This is a fork from DreymaR big bag of tricks.
(It's a bit ugly, I just modified the normal extended file to my need instead of creating a new one). To try it, please read DreymaR documentation.