I just came around the problem with different pen barrel sizes.
As the best possible solution i suggest a pen holder that centers the pen. The original Axidraw pen holders do not center the pen, so every different pen will have a different offset. If you plan, like me, using half a dozen different pen sizes in a project, moving the paper wont work.