Mercurial > code > home > repos > homeauto

annotate service/collector/tasks.py @ 647:57c21b039aeb

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
makefile to invoke Ignore-this: 766949fabca4a9edfecba59c493899ef
author drewp@bigasterisk.com
date Wed, 25 Sep 2019 17:25:16 -0700
parents service/collector/makefile@7fd9fa5d33aa
children be2fbdbdf549
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
647
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
1 from invoke import task
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
2 JOB = 'collector'
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
3 PORT = 9072
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
4 TAG_x86 = f'bang6:5000/{JOB.lower()}_x86:latest'
351
7716b1810d6c reasoning & collector move into docker images
drewp@bigasterisk.com
parents:
diff changeset
5
647
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
6 ANSIBLE_TAG = 'reasoning' # sic
351
7716b1810d6c reasoning & collector move into docker images
drewp@bigasterisk.com
parents:
diff changeset
7
647
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
8 @task
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
9 def build_image(ctx):
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
10 ctx.run(f'docker build --network=host -t {TAG_x86} .')
351
7716b1810d6c reasoning & collector move into docker images
drewp@bigasterisk.com
parents:
diff changeset
11
647
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
12 @task(pre=[build_image])
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
13 def push_image(ctx):
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
14 ctx.run(f'docker push {TAG_x86}')
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
15
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
16 @task(pre=[build_image])
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
17 def shell(ctx):
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
18 ctx.run(f'docker run --rm --name={JOB}_shell --cap-add SYS_PTRACE --dns 10.2.0.1 --dns-search bigasterisk.com -it --cap-add SYS_PTRACE -v `pwd`/.mypy_cache:/opt/.mypy_cache -v `pwd`/../../stubs:/opt/stubs -v `pwd`/sse_collector.py:/opt/sse_collector.py --net=host {TAG_x86} /bin/bash', pty=True)
354
818b7b410575 patch rdflib_jsonld for new rdflib
drewp@bigasterisk.com
parents: 351
diff changeset
19
647
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
20 @task(pre=[build_image])
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
21 def local_run(ctx):
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
22 ctx.run(f'docker run --rm -it -p {PORT}:{PORT} --net=host --cap-add SYS_PTRACE --dns 10.2.0.1 --dns-search bigasterisk.com -v `pwd`/static:/opt/static {TAG_x86} python3 sse_collector.py -v', pty=True)
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
23
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
24 #local_run_strace: build_image
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
25 # docker run --rm -it -p ${PORT}:${PORT} \ --name=$(JOB)_local \ --net=host \ --cap-add SYS_PTRACE \ ${TAG} \ strace -f -tts 200 python3 /mnt/sse_collector.py -v
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
26
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
27 #local_run_pyspy: build_image
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
28 # docker run --rm -it -p ${PORT}:${PORT} \ --name=$(JOB)_local \ --net=host \ --cap-add SYS_PTRACE \ ${TAG} \ py-spy -- python3 sse_collector.py
442
ee74dc3b58fb collector build improvements; stats and logging
drewp@bigasterisk.com
parents: 354
diff changeset
29
647
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
30 #typecheck: build_image
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
31 # docker run --rm -it -p ${PORT}:${PORT} \ --name=$(JOB)_mypy \ --net=host \ -v `pwd`/.mypy_cache:/opt/.mypy_cache \ ${TAG} \
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
32 # /usr/local/bin/mypy -m sse_collector -m export_to_influxdb -m logsetup -m patchablegraph -m patchsource -m rdfdb.patch
449
ef7eba0551f2 collector partial py3+types update. WIP
drewp@bigasterisk.com
parents: 442
diff changeset
33
647
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
34 #redeploy: push_image
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
35 # supervisorctl restart sse_collector_9072
442
ee74dc3b58fb collector build improvements; stats and logging
drewp@bigasterisk.com
parents: 354
diff changeset
36
647
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
37 @task(pre=[push_image])
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
38 def redeploy(ctx):
57c21b039aeb makefile to invoke
drewp@bigasterisk.com
parents: 595
diff changeset
39 ctx.run(f'supervisorctl -s http://bang:9001/ restart sse_{JOB}_{PORT}')