We propose to use the spin-orbit interaction as a means to control electron spins in quantum dots, enabling both single-qubit and two-qubit operations. Very fast single-qubit operations may be achieved by temporarily displacing the electrons. For two-qubit operations the coupling mechanism is based on a combination of the spin-orbit coupling and the mutual long-ranged Coulomb interaction. Compared to existing schemes using the exchange coupling, the spin-orbit induced coupling is less sensitive to random electrical fluctuations in the electrodes defining the quantum dots.