annotate tasks.py @ 49:febc20caabcb

more alerts
author drewp@bigasterisk.com
date Sun, 10 Mar 2024 14:49:32 -0700
parents 3b91d52b007d
children 21185db8a52e
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
20
f5777b65f035 fast update of scrape_main.yaml
drewp@bigasterisk.com
parents: 15
diff changeset
1 import yaml
4
1eb6e6a2b9b6 version control configs finally; use configmaps to present them to VM
drewp@bigasterisk.com
parents:
diff changeset
2 from invoke import task
20
f5777b65f035 fast update of scrape_main.yaml
drewp@bigasterisk.com
parents: 15
diff changeset
3 from kubernetes import config
4
1eb6e6a2b9b6 version control configs finally; use configmaps to present them to VM
drewp@bigasterisk.com
parents:
diff changeset
4
22
cd115f1ca2a8 use configmaps and a special pod refresh trick
drewp@bigasterisk.com
parents: 20
diff changeset
5 import alert_rules
27
eec015e90818 reformat
drewp@bigasterisk.com
parents: 22
diff changeset
6 from k8s_ops import firstPodName, refreshPodCmaps, replaceCmap
4
1eb6e6a2b9b6 version control configs finally; use configmaps to present them to VM
drewp@bigasterisk.com
parents:
diff changeset
7
20
f5777b65f035 fast update of scrape_main.yaml
drewp@bigasterisk.com
parents: 15
diff changeset
8 config.load_kube_config()
12
b6720e379d5b config updates
drewp@bigasterisk.com
parents: 10
diff changeset
9
b6720e379d5b config updates
drewp@bigasterisk.com
parents: 10
diff changeset
10
22
cd115f1ca2a8 use configmaps and a special pod refresh trick
drewp@bigasterisk.com
parents: 20
diff changeset
11 @task
cd115f1ca2a8 use configmaps and a special pod refresh trick
drewp@bigasterisk.com
parents: 20
diff changeset
12 def push_config(ctx):
cd115f1ca2a8 use configmaps and a special pod refresh trick
drewp@bigasterisk.com
parents: 20
diff changeset
13 configObj = scrapeConfig(ctx)
32
eb1de82c93aa refactor the merging of all the groups
drewp@bigasterisk.com
parents: 27
diff changeset
14 rulesObj = alert_rules.allRules(ctx)
10
2023a6ce7bc0 some of the config-rebuild code
drewp@bigasterisk.com
parents: 4
diff changeset
15
22
cd115f1ca2a8 use configmaps and a special pod refresh trick
drewp@bigasterisk.com
parents: 20
diff changeset
16 replaceCmap("victoriametrics-config", {"scrape_main": configObj, "rules": rulesObj})
4
1eb6e6a2b9b6 version control configs finally; use configmaps to present them to VM
drewp@bigasterisk.com
parents:
diff changeset
17
34
3b91d52b007d rules tuning
drewp@bigasterisk.com
parents: 32
diff changeset
18 # these don't give errors on rules format! they just quietly keep the old
3b91d52b007d rules tuning
drewp@bigasterisk.com
parents: 32
diff changeset
19 # rules! use `skaffold run` to get errs.
3b91d52b007d rules tuning
drewp@bigasterisk.com
parents: 32
diff changeset
20 #
3b91d52b007d rules tuning
drewp@bigasterisk.com
parents: 32
diff changeset
21 # or run
3b91d52b007d rules tuning
drewp@bigasterisk.com
parents: 32
diff changeset
22 # validateTemplates = flag.Bool("rule.validateTemplates", true, "Whether to validate annotation and label templates")
3b91d52b007d rules tuning
drewp@bigasterisk.com
parents: 32
diff changeset
23 # validateExpressions = flag.Bool("rule.validateExpressions", true, "Whether to validate rules expressions via MetricsQL engine")
3b91d52b007d rules tuning
drewp@bigasterisk.com
parents: 32
diff changeset
24
22
cd115f1ca2a8 use configmaps and a special pod refresh trick
drewp@bigasterisk.com
parents: 20
diff changeset
25 refreshPodCmaps(firstPodName("app=victoriametrics"))
cd115f1ca2a8 use configmaps and a special pod refresh trick
drewp@bigasterisk.com
parents: 20
diff changeset
26 refreshPodCmaps(firstPodName("app=vmalert"))
4
1eb6e6a2b9b6 version control configs finally; use configmaps to present them to VM
drewp@bigasterisk.com
parents:
diff changeset
27
22
cd115f1ca2a8 use configmaps and a special pod refresh trick
drewp@bigasterisk.com
parents: 20
diff changeset
28 # If the VM reloader isn't fast enough, we could do this too:
cd115f1ca2a8 use configmaps and a special pod refresh trick
drewp@bigasterisk.com
parents: 20
diff changeset
29 # hup(ctx, 'deploy/victoriametrics', 'victoria-metrics-prod')
20
f5777b65f035 fast update of scrape_main.yaml
drewp@bigasterisk.com
parents: 15
diff changeset
30
f5777b65f035 fast update of scrape_main.yaml
drewp@bigasterisk.com
parents: 15
diff changeset
31
f5777b65f035 fast update of scrape_main.yaml
drewp@bigasterisk.com
parents: 15
diff changeset
32 def scrapeConfig(ctx):
22
cd115f1ca2a8 use configmaps and a special pod refresh trick
drewp@bigasterisk.com
parents: 20
diff changeset
33 return yaml.load(open("config/scrape_main.yaml"), yaml.FullLoader)