Beiträge von antman

antman · 25. Oktober 2015

-->continued

Code

antman@pluto:~$ docker ps
Get http:///var/run/docker.sock/v1.20/containers/json: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker ps
INFO[0840] GET /v1.20/containers/json
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
3d866d983b28 rabbitmq:latest "/docker-entrypoint.s" 3 minutes ago Up 3 minutes 4369/tcp, 5672/tcp, 25672/tcp rabbitmq
71faf233cc38 mysql:latest "/entrypoint.sh mysql" 4 minutes ago Up 4 minutes 3306/tcp mysql
antman@pluto:~$ docker run --name phantomjs -d binux/pyspider:latest phantomjs
Post http:///var/run/docker.sock/v1.20/containers/create?name=phantomjs: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker run --name phantomjs -d binux/pyspider:latest phantomjs
INFO[0854] POST /v1.20/containers/create?name=phantomjs
WARN[0854] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
WARNING: Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
4a14acb0d99d621eaa5fba9d60275eb97c2da871aa93e39f86f212c208a7325f
INFO[0854] POST /v1.20/containers/4a14acb0d99d621eaa5fba9d60275eb97c2da871aa93e39f86f212c208a7325f/start
WARN[0855] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ docker run --name result_worker -m 128m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest result_worker
Post http:///var/run/docker.sock/v1.20/containers/create?name=result_worker: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker run --name result_worker -m 128m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest result_worker
INFO[0866] POST /v1.20/containers/create?name=result_worker
WARN[0866] Your kernel does not support memory limit capabilities. Limitation discarded.
WARN[0866] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.


3a49b331227e3a4ac70f73a9c706f2d00d725d37e7b072a43c5c19044a93a1bd
INFO[0866] POST /v1.20/containers/3a49b331227e3a4ac70f73a9c706f2d00d725d37e7b072a43c5c19044a93a1bd/start
antman@pluto:~$ WARN[0867] Your kernel does not support OOM notifications: There is no path for "memory" in state


antman@pluto:~$ docker run --name processor -m 256m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest processor
Post http:///var/run/docker.sock/v1.20/containers/create?name=processor: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker run --name processor -m 256m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest processor
INFO[0911] POST /v1.20/containers/create?name=processor
WARN[0911] Your kernel does not support memory limit capabilities. Limitation discarded.
WARN[0911] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.


7bdfd66fbc3889dfbe008996a60356eaab84043c59d5d9a9e3fbfe058812db85
INFO[0912] POST /v1.20/containers/7bdfd66fbc3889dfbe008996a60356eaab84043c59d5d9a9e3fbfe058812db85/start
WARN[0912] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ sudo docker ps
INFO[0919] GET /v1.20/containers/json
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
7bdfd66fbc38 binux/pyspider:latest "pyspider processor" 8 seconds ago Up 7 seconds 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp processor
3a49b331227e binux/pyspider:latest "pyspider result_work" 53 seconds ago Up 52 seconds 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp result_worker
4a14acb0d99d binux/pyspider:latest "pyspider phantomjs" About a minute ago Up About a minute 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp phantomjs
3d866d983b28 rabbitmq:latest "/docker-entrypoint.s" 4 minutes ago Up 4 minutes 4369/tcp, 5672/tcp, 25672/tcp rabbitmq
71faf233cc38 mysql:latest "/entrypoint.sh mysql" 5 minutes ago Up 5 minutes 3306/tcp mysql
antman@pluto:~$ sudo docker run --name fetcher -m 256m -d --link phantomjs:phantomjs --link rabbitmq:rabbitmq binux/pyspider:latest fetcher --no-xmlrpc
INFO[0928] POST /v1.20/containers/create?name=fetcher
WARN[0928] Your kernel does not support memory limit capabilities. Limitation discarded.
WARN[0928] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.


cf1b75d3ee431c85015352fdf051863b335863ce9e48087b36b6bd34e97d21b8
INFO[0929] POST /v1.20/containers/cf1b75d3ee431c85015352fdf051863b335863ce9e48087b36b6bd34e97d21b8/start
antman@pluto:~$ WARN[0930] Your kernel does not support OOM notifications: There is no path for "memory" in state


antman@pluto:~$ sudo docker run --name scheduler -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest scheduler
INFO[0944] POST /v1.20/containers/create?name=scheduler
WARN[0944] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
WARNING: Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
dc2830d9021a2ab04389d8b15cabfb3a5cdba6ac5c8df058085a7cb487753573
INFO[0945] POST /v1.20/containers/dc2830d9021a2ab04389d8b15cabfb3a5cdba6ac5c8df058085a7cb487753573/start
WARN[0945] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ sudo docker run --name webui -m 256m -d -p 5000:5000 --link mysql:mysql --link rabbitmq:rabbitmq --link scheduler:scheduler --link phantomjs:phantomjs binux/pyspider:latest webui
INFO[0953] POST /v1.20/containers/create?name=webui
WARN[0953] Your kernel does not support memory limit capabilities. Limitation discarded.
WARN[0953] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.


b9b6737a163a8414d458cd3c44bc0085bdba6de9fe92a19379fb692606538063
INFO[0953] POST /v1.20/containers/b9b6737a163a8414d458cd3c44bc0085bdba6de9fe92a19379fb692606538063/start
WARN[0954] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ docker ps
Get http:///var/run/docker.sock/v1.20/containers/json: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker ps
INFO[1028] GET /v1.20/containers/json
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
b9b6737a163a binux/pyspider:latest "pyspider webui" About a minute ago Up About a minute 23333/tcp, 24444/tcp, 0.0.0.0:5000->5000/tcp, 25555/tcp webui
dc2830d9021a binux/pyspider:latest "pyspider scheduler" About a minute ago Up About a minute 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp scheduler
cf1b75d3ee43 binux/pyspider:latest "pyspider fetcher --n" About a minute ago Up About a minute 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp fetcher
7bdfd66fbc38 binux/pyspider:latest "pyspider processor" About a minute ago Up About a minute 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp processor
3a49b331227e binux/pyspider:latest "pyspider result_work" 2 minutes ago Up 2 minutes 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp result_worker
4a14acb0d99d binux/pyspider:latest "pyspider phantomjs" 2 minutes ago Up 2 minutes 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp phantomjs
3d866d983b28 rabbitmq:latest "/docker-entrypoint.s" 6 minutes ago Up 6 minutes 4369/tcp, 5672/tcp, 25672/tcp rabbitmq
71faf233cc38 mysql:latest "/entrypoint.sh mysql" 7 minutes ago Up 7 minutes 3306/tcp mysql

Alles anzeigen

antman · 25. Oktober 2015

--> continued due to char limit

Code

antman@pluto:~$ docker ps
Get http:///var/run/docker.sock/v1.20/containers/json: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker ps
INFO[0840] GET /v1.20/containers/json
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
3d866d983b28 rabbitmq:latest "/docker-entrypoint.s" 3 minutes ago Up 3 minutes 4369/tcp, 5672/tcp, 25672/tcp rabbitmq
71faf233cc38 mysql:latest "/entrypoint.sh mysql" 4 minutes ago Up 4 minutes 3306/tcp mysql
antman@pluto:~$ docker run --name phantomjs -d binux/pyspider:latest phantomjs
Post http:///var/run/docker.sock/v1.20/containers/create?name=phantomjs: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker run --name phantomjs -d binux/pyspider:latest phantomjs
INFO[0854] POST /v1.20/containers/create?name=phantomjs
WARN[0854] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
WARNING: Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
4a14acb0d99d621eaa5fba9d60275eb97c2da871aa93e39f86f212c208a7325f
INFO[0854] POST /v1.20/containers/4a14acb0d99d621eaa5fba9d60275eb97c2da871aa93e39f86f212c208a7325f/start
WARN[0855] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ docker run --name result_worker -m 128m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest result_worker
Post http:///var/run/docker.sock/v1.20/containers/create?name=result_worker: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker run --name result_worker -m 128m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest result_worker
INFO[0866] POST /v1.20/containers/create?name=result_worker
WARN[0866] Your kernel does not support memory limit capabilities. Limitation discarded.
WARN[0866] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.


3a49b331227e3a4ac70f73a9c706f2d00d725d37e7b072a43c5c19044a93a1bd
INFO[0866] POST /v1.20/containers/3a49b331227e3a4ac70f73a9c706f2d00d725d37e7b072a43c5c19044a93a1bd/start
antman@pluto:~$ WARN[0867] Your kernel does not support OOM notifications: There is no path for "memory" in state


antman@pluto:~$ docker run --name processor -m 256m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest processor
Post http:///var/run/docker.sock/v1.20/containers/create?name=processor: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker run --name processor -m 256m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest processor
INFO[0911] POST /v1.20/containers/create?name=processor
WARN[0911] Your kernel does not support memory limit capabilities. Limitation discarded.
WARN[0911] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.


7bdfd66fbc3889dfbe008996a60356eaab84043c59d5d9a9e3fbfe058812db85
INFO[0912] POST /v1.20/containers/7bdfd66fbc3889dfbe008996a60356eaab84043c59d5d9a9e3fbfe058812db85/start
WARN[0912] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ sudo docker ps
INFO[0919] GET /v1.20/containers/json
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
7bdfd66fbc38 binux/pyspider:latest "pyspider processor" 8 seconds ago Up 7 seconds 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp processor
3a49b331227e binux/pyspider:latest "pyspider result_work" 53 seconds ago Up 52 seconds 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp result_worker
4a14acb0d99d binux/pyspider:latest "pyspider phantomjs" About a minute ago Up About a minute 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp phantomjs
3d866d983b28 rabbitmq:latest "/docker-entrypoint.s" 4 minutes ago Up 4 minutes 4369/tcp, 5672/tcp, 25672/tcp rabbitmq
71faf233cc38 mysql:latest "/entrypoint.sh mysql" 5 minutes ago Up 5 minutes 3306/tcp mysql
antman@pluto:~$ sudo docker run --name fetcher -m 256m -d --link phantomjs:phantomjs --link rabbitmq:rabbitmq binux/pyspider:latest fetcher --no-xmlrpc
INFO[0928] POST /v1.20/containers/create?name=fetcher
WARN[0928] Your kernel does not support memory limit capabilities. Limitation discarded.
WARN[0928] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.


cf1b75d3ee431c85015352fdf051863b335863ce9e48087b36b6bd34e97d21b8
INFO[0929] POST /v1.20/containers/cf1b75d3ee431c85015352fdf051863b335863ce9e48087b36b6bd34e97d21b8/start
antman@pluto:~$ WARN[0930] Your kernel does not support OOM notifications: There is no path for "memory" in state


antman@pluto:~$ sudo docker run --name scheduler -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest scheduler
INFO[0944] POST /v1.20/containers/create?name=scheduler
WARN[0944] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
WARNING: Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
dc2830d9021a2ab04389d8b15cabfb3a5cdba6ac5c8df058085a7cb487753573
INFO[0945] POST /v1.20/containers/dc2830d9021a2ab04389d8b15cabfb3a5cdba6ac5c8df058085a7cb487753573/start
WARN[0945] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ sudo docker run --name webui -m 256m -d -p 5000:5000 --link mysql:mysql --link rabbitmq:rabbitmq --link scheduler:scheduler --link phantomjs:phantomjs binux/pyspider:latest webui
INFO[0953] POST /v1.20/containers/create?name=webui
WARN[0953] Your kernel does not support memory limit capabilities. Limitation discarded.
WARN[0953] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.


b9b6737a163a8414d458cd3c44bc0085bdba6de9fe92a19379fb692606538063
INFO[0953] POST /v1.20/containers/b9b6737a163a8414d458cd3c44bc0085bdba6de9fe92a19379fb692606538063/start
WARN[0954] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ docker ps
Get http:///var/run/docker.sock/v1.20/containers/json: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker ps
INFO[1028] GET /v1.20/containers/json
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
b9b6737a163a binux/pyspider:latest "pyspider webui" About a minute ago Up About a minute 23333/tcp, 24444/tcp, 0.0.0.0:5000->5000/tcp, 25555/tcp webui
dc2830d9021a binux/pyspider:latest "pyspider scheduler" About a minute ago Up About a minute 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp scheduler
cf1b75d3ee43 binux/pyspider:latest "pyspider fetcher --n" About a minute ago Up About a minute 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp fetcher
7bdfd66fbc38 binux/pyspider:latest "pyspider processor" About a minute ago Up About a minute 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp processor
3a49b331227e binux/pyspider:latest "pyspider result_work" 2 minutes ago Up 2 minutes 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp result_worker
4a14acb0d99d binux/pyspider:latest "pyspider phantomjs" 2 minutes ago Up 2 minutes 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp phantomjs
3d866d983b28 rabbitmq:latest "/docker-entrypoint.s" 6 minutes ago Up 6 minutes 4369/tcp, 5672/tcp, 25672/tcp rabbitmq
71faf233cc38 mysql:latest "/entrypoint.sh mysql" 7 minutes ago Up 7 minutes 3306/tcp mysql

Alles anzeigen

antman · 25. Oktober 2015

--> CONTINUED from previous due to char limit

Code

antman@pluto:~$ docker ps
Get http:///var/run/docker.sock/v1.20/containers/json: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker ps
INFO[0840] GET /v1.20/containers/json
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
3d866d983b28 rabbitmq:latest "/docker-entrypoint.s" 3 minutes ago Up 3 minutes 4369/tcp, 5672/tcp, 25672/tcp rabbitmq
71faf233cc38 mysql:latest "/entrypoint.sh mysql" 4 minutes ago Up 4 minutes 3306/tcp mysql
antman@pluto:~$ docker run --name phantomjs -d binux/pyspider:latest phantomjs
Post http:///var/run/docker.sock/v1.20/containers/create?name=phantomjs: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker run --name phantomjs -d binux/pyspider:latest phantomjs
INFO[0854] POST /v1.20/containers/create?name=phantomjs
WARN[0854] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
WARNING: Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
4a14acb0d99d621eaa5fba9d60275eb97c2da871aa93e39f86f212c208a7325f
INFO[0854] POST /v1.20/containers/4a14acb0d99d621eaa5fba9d60275eb97c2da871aa93e39f86f212c208a7325f/start
WARN[0855] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ docker run --name result_worker -m 128m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest result_worker
Post http:///var/run/docker.sock/v1.20/containers/create?name=result_worker: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker run --name result_worker -m 128m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest result_worker
INFO[0866] POST /v1.20/containers/create?name=result_worker
WARN[0866] Your kernel does not support memory limit capabilities. Limitation discarded.
WARN[0866] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.


3a49b331227e3a4ac70f73a9c706f2d00d725d37e7b072a43c5c19044a93a1bd
INFO[0866] POST /v1.20/containers/3a49b331227e3a4ac70f73a9c706f2d00d725d37e7b072a43c5c19044a93a1bd/start
antman@pluto:~$ WARN[0867] Your kernel does not support OOM notifications: There is no path for "memory" in state


antman@pluto:~$ docker run --name processor -m 256m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest processor
Post http:///var/run/docker.sock/v1.20/containers/create?name=processor: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker run --name processor -m 256m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest processor
INFO[0911] POST /v1.20/containers/create?name=processor
WARN[0911] Your kernel does not support memory limit capabilities. Limitation discarded.
WARN[0911] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.


7bdfd66fbc3889dfbe008996a60356eaab84043c59d5d9a9e3fbfe058812db85
INFO[0912] POST /v1.20/containers/7bdfd66fbc3889dfbe008996a60356eaab84043c59d5d9a9e3fbfe058812db85/start
WARN[0912] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ sudo docker ps
INFO[0919] GET /v1.20/containers/json
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
7bdfd66fbc38 binux/pyspider:latest "pyspider processor" 8 seconds ago Up 7 seconds 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp processor
3a49b331227e binux/pyspider:latest "pyspider result_work" 53 seconds ago Up 52 seconds 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp result_worker
4a14acb0d99d binux/pyspider:latest "pyspider phantomjs" About a minute ago Up About a minute 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp phantomjs
3d866d983b28 rabbitmq:latest "/docker-entrypoint.s" 4 minutes ago Up 4 minutes 4369/tcp, 5672/tcp, 25672/tcp rabbitmq
71faf233cc38 mysql:latest "/entrypoint.sh mysql" 5 minutes ago Up 5 minutes 3306/tcp mysql
antman@pluto:~$ sudo docker run --name fetcher -m 256m -d --link phantomjs:phantomjs --link rabbitmq:rabbitmq binux/pyspider:latest fetcher --no-xmlrpc
INFO[0928] POST /v1.20/containers/create?name=fetcher
WARN[0928] Your kernel does not support memory limit capabilities. Limitation discarded.
WARN[0928] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.


cf1b75d3ee431c85015352fdf051863b335863ce9e48087b36b6bd34e97d21b8
INFO[0929] POST /v1.20/containers/cf1b75d3ee431c85015352fdf051863b335863ce9e48087b36b6bd34e97d21b8/start
antman@pluto:~$ WARN[0930] Your kernel does not support OOM notifications: There is no path for "memory" in state


antman@pluto:~$ sudo docker run --name scheduler -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest scheduler
INFO[0944] POST /v1.20/containers/create?name=scheduler
WARN[0944] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
WARNING: Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
dc2830d9021a2ab04389d8b15cabfb3a5cdba6ac5c8df058085a7cb487753573
INFO[0945] POST /v1.20/containers/dc2830d9021a2ab04389d8b15cabfb3a5cdba6ac5c8df058085a7cb487753573/start
WARN[0945] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ sudo docker run --name webui -m 256m -d -p 5000:5000 --link mysql:mysql --link rabbitmq:rabbitmq --link scheduler:scheduler --link phantomjs:phantomjs binux/pyspider:latest webui
INFO[0953] POST /v1.20/containers/create?name=webui
WARN[0953] Your kernel does not support memory limit capabilities. Limitation discarded.
WARN[0953] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.


b9b6737a163a8414d458cd3c44bc0085bdba6de9fe92a19379fb692606538063
INFO[0953] POST /v1.20/containers/b9b6737a163a8414d458cd3c44bc0085bdba6de9fe92a19379fb692606538063/start
WARN[0954] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ docker ps
Get http:///var/run/docker.sock/v1.20/containers/json: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker ps
INFO[1028] GET /v1.20/containers/json
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
b9b6737a163a binux/pyspider:latest "pyspider webui" About a minute ago Up About a minute 23333/tcp, 24444/tcp, 0.0.0.0:5000->5000/tcp, 25555/tcp webui
dc2830d9021a binux/pyspider:latest "pyspider scheduler" About a minute ago Up About a minute 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp scheduler
cf1b75d3ee43 binux/pyspider:latest "pyspider fetcher --n" About a minute ago Up About a minute 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp fetcher
7bdfd66fbc38 binux/pyspider:latest "pyspider processor" About a minute ago Up About a minute 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp processor
3a49b331227e binux/pyspider:latest "pyspider result_work" 2 minutes ago Up 2 minutes 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp result_worker
4a14acb0d99d binux/pyspider:latest "pyspider phantomjs" 2 minutes ago Up 2 minutes 5000/tcp, 23333/tcp, 24444/tcp, 25555/tcp phantomjs
3d866d983b28 rabbitmq:latest "/docker-entrypoint.s" 6 minutes ago Up 6 minutes 4369/tcp, 5672/tcp, 25672/tcp rabbitmq
71faf233cc38 mysql:latest "/entrypoint.sh mysql" 7 minutes ago Up 7 minutes 3306/tcp mysql

Alles anzeigen

antman · 25. Oktober 2015

Yes it seems to be working. I had to sudo everything. There are a few errors but the webui is operational.
I also did a

Code

sudo apt-get install aufs-tools

but it was probably unnecessary because even there was an "auplink" error the container was running
Half the result here, half after the time limit...

Code

antman@pluto:~$ sudo docker run --name mysql -d -v /data/mysql:/var/lib/mysql -e MYSQL_ALLOW_EMPTY_PASSWORD=yes mysql:latest
INFO[0355] POST /v1.20/containers/create?name=mysql
WARN[0355] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
ERRO[0355] Handler for POST /containers/create returned error: No such image: mysql:latest (tag: latest)
ERRO[0355] HTTP Error err=No such image: mysql:latest (tag: latest) statusCode=404
Unable to find image 'mysql:latest' locally
INFO[0355] POST /v1.20/images/create?fromImage=mysql&tag=latest
latest: Pulling from library/mysql
d0ca40da9e35: Pull complete


Status: Downloaded newer image for mysql:latest
INFO[0571] POST /v1.20/containers/create?name=mysql
WARN[0571] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
ERRO[0571] Couldn't run auplink before unmount: exec: "auplink": executable file not found in $PATH


WARNING: Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
71faf233cc3875aabbdccea6d7fb47761b153e25d56ab347424540ceefa27fa4
INFO[0571] POST /v1.20/containers/71faf233cc3875aabbdccea6d7fb47761b153e25d56ab347424540ceefa27fa4/start
WARN[0571] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ docker run --name rabbitmq -d rabbitmq:latest
Post http:///var/run/docker.sock/v1.20/containers/create?name=rabbitmq: dial unix /var/run/docker.sock: permission denied.
* Are you trying to connect to a TLS-enabled daemon without TLS?
* Is your docker daemon up and running?
antman@pluto:~$ sudo docker run --name rabbitmq -d rabbitmq:latest
INFO[0652] POST /v1.20/containers/create?name=rabbitmq
WARN[0652] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
ERRO[0652] Couldn't run auplink before unmount: exec: "auplink": executable file not found in $PATH
ERRO[0653] Couldn't run auplink before unmount: exec: "auplink": executable file not found in $PATH
WARNING: Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
3d866d983b281bcb374d8c40a91db8e5925a9c08c173d7724af2c3f43eab026e
INFO[0653] POST /v1.20/containers/3d866d983b281bcb374d8c40a91db8e5925a9c08c173d7724af2c3f43eab026e/start
WARN[0653] Your kernel does not support OOM notifications: There is no path for "memory" in state
antman@pluto:~$ sudo apt-get install aufs-tools
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following NEW packages will be installed:
aufs-tools
0 upgraded, 1 newly installed, 0 to remove and 20 not upgraded.
Need to get 91.9 kB of archives.
After this operation, 174 kB of additional disk space will be used.
Get:1 http://ftp.gr.debian.org/debian/ wheezy/main aufs-tools amd64 1:3.0+20120411-2 [91.9 kB]
Fetched 91.9 kB in 0s (225 kB/s)
Selecting previously unselected package aufs-tools.
(Reading database ... 55946 files and directories currently installed.)
Unpacking aufs-tools (from .../aufs-tools_1%3a3.0+20120411-2_amd64.deb) ...
Processing triggers for man-db ...
Setting up aufs-tools (1:3.0+20120411-2) ...
[master edac8e4] committing changes in /etc after apt run
Author: antman <antman@pluto.lan>
2 files changed, 82 insertions(+)
create mode 100644 default/aufs
Creating index of upgradeable packages ...
Creating index of openmediavault plugins ...
antman@pluto:~$ sudo docker run --name mysql -d -v /data/mysql:/var/lib/mysql -e MYSQL_ALLOW_EMPTY_PASSWORD=yes mysql:latest
INFO[0816] POST /v1.20/containers/create?name=mysql
WARN[0816] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
ERRO[0816] Handler for POST /containers/create returned error: Conflict. The name "mysql" is already in use by container 71faf233cc38. You have to delete (or rename) that container to be able to reuse that name.
ERRO[0816] HTTP Error err=Conflict. The name "mysql" is already in use by container 71faf233cc38. You have to delete (or rename) that container to be able to reuse that name. statusCode=409
Error response from daemon: Conflict. The name "mysql" is already in use by container 71faf233cc38. You have to delete (or rename) that container to be able to reuse that name.
antman@pluto:~$ sudo docker run --name rabbitmq -d rabbitmq:latest
INFO[0822] POST /v1.20/containers/create?name=rabbitmq
WARN[0822] Your kernel does not support memory swappiness capabilities, memory swappiness discarded.
ERRO[0822] Handler for POST /containers/create returned error: Conflict. The name "rabbitmq" is already in use by container 3d866d983b28. You have to delete (or rename) that container to be able to reuse that name.
ERRO[0822] HTTP Error err=Conflict. The name "rabbitmq" is already in use by container 3d866d983b28. You have to delete (or rename) that container to be able to reuse that name. statusCode=409
Error response from daemon: Conflict. The name "rabbitmq" is already in use by container 3d866d983b28. You have to delete (or rename) that container to be able to reuse that name.

Alles anzeigen

antman · 25. Oktober 2015

I am trying to install pyspider with the commands taken from http://docs.pyspider.org/en/la…ing-pyspider-with-Docker/ i am trying to install pyspider an apparently I am doing something wrong in the gui.

The commands are as follows:

Code

# mysql
docker run --name mysql -d -v /data/mysql:/var/lib/mysql -e MYSQL_ALLOW_EMPTY_PASSWORD=yes mysql:latest
# rabbitmq
docker run --name rabbitmq -d rabbitmq:latest
# phantomjs
docker run --name phantomjs -d binux/pyspider:latest phantomjs
# result worker
docker run --name result_worker -m 128m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest result_worker
# processor, run multiple instance if needed.
docker run --name processor -m 256m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest processor
# fetcher, run multiple instance if needed.
docker run --name fetcher -m 256m -d --link phantomjs:phantomjs --link rabbitmq:rabbitmq binux/pyspider:latest fetcher --no-xmlrpc
# scheduler
docker run --name scheduler -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest scheduler
# webui
docker run --name webui -m 256m -d -p 5000:5000 --link mysql:mysql --link rabbitmq:rabbitmq --link scheduler:scheduler --link phantomjs:phantomjs binux/pyspider:latest webui

Alles anzeigen

So I am doing the following:
1. I install mysql from the docker gui adding MYSQL_ALLOW_EMPTY_PASSWORD=yes at the environment variables and /data/mysql /var/lib/mysql to the "Volumes and Bind mounts"
2. I install rabbitmq from the docker gui
3. "result worker" This is the interesting part: The command:

Code

docker run --name result_worker -m 128m --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest result_worker

I interpre it as putting:
container name:result_worker
extra arguments: -m 128m -d --link mysql:mysql --link rabbitmq:rabbitmq binux/pyspider:latest result_worker
4. the same for the other processes.

The problem:

All the CONTAINERS show STATUS: Restarting() except the rabbitmq container.
Messages log:
- aufs au_opts_verify:1570:docker[15860]: dirperm1 breaks the protection by the permission bits on the lower branch
- device veth99d277c entered promiscuous mode
- IPv6: ADDRCONF(NETDEV_UP): vethe253ed7: link is not ready
- docker0: port 1(veth99d277c) entered forwarding state
- docker0: port 1(veth99d277c) entered disabled state
- IPv6: ADDRCONF(NETDEV_CHANGE): vethe253ed7: link becomes ready

I suspect it has something to do with the way the way I try to start linked containers. Any ideas? What is the proper way to use "--link" docker parameters?

antman · 2. November 2014

"Find duplicates" plugin would be nice for huge number of files probably based on
dupfiles(tested on millions of files)[0],
fdupes(can hardlink duplicates)[1],
qdupe(python, easy to alter, fast algo)[2].

[0] http://liw.fi/dupfiles/
[1] https://github.com/adrianlopezroche/fdupes
[2] https://github.com/cwilper/qdupe

Beiträge von antman

Docker GUI plugin now stable

Docker GUI plugin now stable

Docker GUI plugin now stable

Docker GUI plugin now stable

Docker GUI plugin now stable

Plugins that are wanted - Part 4