I'll answer my own question - I'm a beginner and it took me a bit to figure this simple thing out. Once you setup 1 configuration...the rest start getting easier and easier
Ensure you installed the full netdata suite with all the plugins - if you didn't, you may need to manually copy in the plugins (I believe it would go in /usr/libexec/netdata/python.d/mysql.chart.py
Edit /etc/netdata/python.d/mysql.conf and add a new entry at the bottom.
mysql_docker:
name : 'docker'
user : 'youruser'
pass : 'yourpass'
host : '::1'
port : '3306'
Restart your netdata service after (may differ if you are not using ubuntu)
sudo service netdata restart
Repeat for other plugins/services