I decided to experiment.
The version of Colemak that I downloaded is the one without the caps lock and the backspace is the caps lock.
What if I go to qwerty(I don't use it anymore unless I have to) and leave the caps lock on and switch to Colemak what would happen?
Would Colemak accept the caps lock that is on even though there is no caps lock key?
I found out yes.
I know that Colemak wouldn't neglect the caps lock key and turn it off when switching.
But now I want to turn it off.
There's no caps lock key in Colemak so I'll have to go to qwerty.
So in Colemak there is no caps lock but I can enable the caps lock by going to a keyboard layout that uses the caps lock to get the caps lock but when I switch to Colemak the caps lock is permanent until I turn off the caps lock using another layout.

Let's try this.
Go to qwerty(I am not good at qwerty anymore; bad, it seems like I have like 30% accuracy).
Okay I can't type so I'll just turn it on without telling you(I am typing this in Colemak after switching to qwerty)
I WENT TO QWERTY AND PUT ON THE CAPS LOCK AT NOW I'M AT COLEMAK OH SAY I CAN'T TURN OFF THE CAPS LOCK SINCE THERE'S NO CAPS LOCK BUTTON. I'LL HAVE TO QWERTY AND TURN IT OFF.
QUESTION:
WHY DOES COLEMAK ACCEPT THE ACTIVE(ON) CAPS LOCK OF QWERTY)? I EXPECT COLEMAK TO GO LIKE THIS:
THE CAPS LOCK IS ON WHICH IS A FOREIGN KEY WHICH IS NOT AVAILABLE SO I'LL DISABLE THIS CAPS LOCK. NOW IT'S OFF.
QUESTION:
IF I REMOVE QWERTY AND NEVER GET IT BACK WOULD I ALWAYS BE HAVING CAPS LOCK ON WHEN ON QWERTY OR WOULD IT THIS:
COMPUTER SHUT DOWN
CAPS LOCK IS TURNED OFF
OPEN COMPUTER
NOW THE COMPUTER IS ON COLEMAK WITHOUT THE CAPS LOCK ON.

LET'S GO BACK TO QWERTY AND TURN OFF THIS CAPS LOCK.

Oh, I'm back to no caps lock with qwerty.