Using a smaller rotor will give you a little less torque, slightly higher revs overall and weaker brakes. Depending on the type of motor it can make the difference between undriveably lairy and smooth and controlled.
What it will also do is make the motor less efficient and more prone to overheating. You might have to adjust gearing to compensate for the lower torque and the heat.
__________________
|