Keyboard-driven mouse

Focus on the mouse. Then use arrow keys to move it:

[demo src="solution"]

P.S. Don't put event handlers anywhere except the #mouse element. P.P.S. Don't modify HTML/CSS, the approach should be generic and work with any element.