Using Gmail labels for IMAP is not really ideal if you assign multiple labels, because if you end up syncing to another provider all those virtual "subfolders" has duplicate messages. You're much better off using your email client's built in labels and just syncing the 'All Mail' folder.