That's exactly what the primer is for! You can block sand the primer if sandable. You could skim coat any areas with a sandable filler. Some guys use auto body fillers, and then block sand. Don't put it anywhere you can't sand.
You could also just weather the areas to look like rust has taken it's toll too. Depends on what era you want it to represent? As delivered or near end of service?