I know this thread is old but I also had the same issue.
I found that the folder located /var/lib/plexmediaserver would remain after a uninstall. So i navigated to /var/lib/ and run the command sudo rmdir plexmediaserver and the try to reinstall the plex plug in. In my case this solved my issue but wanted to see if anyone else had the same luck.