So its offset in reference to the the centerline of the swingarm, or front wheel? And not tilted/skewed? As long as there is no wobble, it should be fine.
Like someone else mentioned, you might notice it turns sharper in one direction, but it shouldn't be a huge issue.