I think 5 is a good age to start racing at the right speed. And I think that the experienced drivers should marshall for them. It would be good to have an early heat at club meets for junior beginners, limit the cars to a little over walking pace and get them racing.
Does it mater if they crash? No it matters that they have fun.