So I decided to smock the lower panel of the top above the hem. I used my 'cheat's' shirring technique and it was finished in no time.
I think it's much more flattering now and the patterned fabric hides the slightly wonky lines of stitching! I did four lines of shirring. I probably could have done with a few more, but for now I'll enjoy my 'new' top :)