Commit Graph

454 Commits

Author SHA1 Message Date
162f567c85 Stop Nomad and Vault when recovering Consul 2022-11-18 08:58:20 -08:00
3b9ad36ed0 New playbook to stop cluster gracefully 2022-11-18 08:57:41 -08:00
049d9f0fe0 Make sure grafana points to port bound within it's task group 2022-11-18 08:57:06 -08:00
3a828af690 No longer need to pin the envoy proxy 2022-11-18 08:56:29 -08:00
080cea9637 Fix minitor
Healthcheck was failing due to wrong path and log alert was failing
due to the config file being templated by Nomad. Updated to use a
different delimiter.
2022-11-16 09:04:32 -08:00
f481e7b938 Update blocky dashboards 2022-11-16 08:42:36 -08:00
35403d0219 Update nomad dashboard 2022-11-16 08:37:29 -08:00
416676c9f9 Update minitor dashboard 2022-11-16 08:35:01 -08:00
12b91e9566 Fix env location for lldap 2022-11-15 16:54:37 -08:00
8a21dd7eb4 Bump traefik version 2022-11-15 15:57:23 -08:00
a1def1c69d Increase memory for lldap
Password hashing was causing OOM kills
2022-11-15 15:57:23 -08:00
c7d0fca6e7 Pin lldap verison 2022-11-15 15:57:23 -08:00
86b472435c Use explicit lldap ports so that connect proxy can find them 2022-11-15 15:57:23 -08:00
2db266bda7 Update blocky upstream dns to bootstrap better (hopefully) and forward to consul 2022-11-15 10:26:26 -08:00
cf2779c971 Update lldap to use dynamic ports 2022-11-15 09:43:13 -08:00
b098a325f8 Add backups for photoprism 2022-11-15 09:19:55 -08:00
c5135be4a0 Pin photoprism version to avoid pulling every time 2022-11-15 09:19:32 -08:00
4a68894238 Add some minitor checks 2022-11-15 09:04:18 -08:00
17ab7f637f Add metrics support to service template 2022-11-15 09:04:18 -08:00
e104cbccc4 Use new Photos share for Photoprism 2022-11-15 09:04:18 -08:00
954a878915 Grafana update + renderer + new dashboards 2022-11-15 09:04:18 -08:00
bee9b641cc Fix local dns in docker 2022-11-15 09:04:18 -08:00
19f1f8448d WIP: Add a new playbook for stopping cluster
Hopefully without data loss
2022-11-14 23:11:13 -08:00
bbec244f45 Fix typo in recovery playbooks 2022-11-14 23:10:16 -08:00
0d47a1f8c8 Tune PhotoPrism 2022-11-11 16:21:47 -08:00
bb400a3f1c Add blocky metrics to grafana 2022-11-11 16:21:17 -08:00
da70aa74ca Add expose path for blocky /metrics
Not sure if it's needed
2022-11-11 13:47:27 -08:00
a30749f357 Switch services to module based Terraform template from levant
This ends up with a better experience in dealing with tfstate for some
services. Not sure why.
2022-11-11 13:47:26 -08:00
49c8a73ac9 Store loki data on ephemeral disk 2022-11-11 13:24:54 -08:00
3bfc1f61ac Update levant service template with some defaults 2022-11-11 13:24:28 -08:00
af32c9e2e5 Put grafana bootstrap secrets in secrets location 2022-11-10 13:39:12 -08:00
3077e66e70 Limit all existing services to websecure entrypoint
This will be a bigger issue if exposing a public entrypoint.
2022-11-10 13:37:50 -08:00
29110eaf47 Update Nomad UI links to Consul and Vault 2022-11-10 13:37:50 -08:00
5b0f50140c Update playbook that clears nomad and consul data 2022-11-10 13:37:50 -08:00
068dc73717 Add photoprism 2022-11-10 13:37:50 -08:00
e9f2fae609 Switch mysql to mariadb 2022-11-10 13:37:50 -08:00
77c2fcc96b Add db bootstrap and more template options to services template 2022-11-10 10:20:53 -08:00
2bde762902 Use journald for Nomad Docker logging so they can be ingested into Loki 2022-11-10 10:19:51 -08:00
92fd139263 Update nomad version to 1.4.2 2022-11-10 10:19:22 -08:00
ae5f4d61fb Make consul raft v3 explicit 2022-11-10 10:19:07 -08:00
e707f2a790 Add pi4 host back 2022-11-10 10:18:37 -08:00
539b9073cb Update permissions for mysql volume 2022-11-10 10:18:28 -08:00
0e0d2bbcc6 Fix ansible_galaxy target references 2022-11-10 10:18:02 -08:00
51a0b71bd8 Update recovery scripts 2022-11-10 10:15:30 -08:00
1fad6b691c Update some metrics 2022-11-07 20:50:18 -08:00
f9d46faae9 Rename backup jobs to be lower case 2022-11-04 09:39:08 -07:00
931e2b6e00 Make sure grafana mysql dump happens after dir is created 2022-11-03 22:18:04 -07:00
9d56f6226c Try to reduce concurrent ftp 2022-11-03 22:17:48 -07:00
39bd8aafaf Move backup jobs to local dir
Makes debugging easier
2022-11-03 22:17:26 -07:00
779db10abc Add middleware support to service levant template 2022-11-03 15:10:51 -07:00