For very small dimples and such I use modelling filler from as tube, various makes, used to be known as "knifing filler" when bought from car shops. Fills very small blemishes, dries very quickly and is easy to sand.
However, filler/primer is easier and you will need to prime the surface anyway.
Ashley