It could be whitefly; they tend to lay eggs in the soil and you don't notice them until they're adults.

Did you use soil from your own garden, or was the soil provided? I'm always very wary of bags of compost and prefer to sterilise all composts and manure before use.