The "big three" on a bike are the wheelset, drivetrain and cockpit.

The first two are big bucks to change out and lighten up, so you might start with the latter - you can get a lighter seat and seatpost, lighter stem and handlebars, and those can be swapped out without too much trouble.

I say ride it for a while first and see how you like it!