You could sway sideways naturally when you walk. A pack will amplify any natural gait. I see a lot of people walking and viewed from the back, they sway. You may have to learn to walk without swaying. Trekking poles may also help you minimize a natural tendency to sway.