Given that you shoot only primes and didn't like zooms, I think that you would be disappointed by not taking your DSLR. You might want to consider paring back a few of your primes to save on weight and crop in post.