IamTheFij
4f5f4e0fe6
Increase priority of backup tasks
2022-11-18 08:58:38 -08:00
IamTheFij
162f567c85
Stop Nomad and Vault when recovering Consul
2022-11-18 08:58:20 -08:00
IamTheFij
3b9ad36ed0
New playbook to stop cluster gracefully
2022-11-18 08:57:41 -08:00
IamTheFij
049d9f0fe0
Make sure grafana points to port bound within it's task group
2022-11-18 08:57:06 -08:00
IamTheFij
3a828af690
No longer need to pin the envoy proxy
2022-11-18 08:56:29 -08:00
IamTheFij
080cea9637
Fix minitor
...
Healthcheck was failing due to wrong path and log alert was failing
due to the config file being templated by Nomad. Updated to use a
different delimiter.
2022-11-16 09:04:32 -08:00
IamTheFij
f481e7b938
Update blocky dashboards
2022-11-16 08:42:36 -08:00
IamTheFij
35403d0219
Update nomad dashboard
2022-11-16 08:37:29 -08:00
IamTheFij
416676c9f9
Update minitor dashboard
2022-11-16 08:35:01 -08:00
IamTheFij
12b91e9566
Fix env location for lldap
2022-11-15 16:54:37 -08:00
IamTheFij
8a21dd7eb4
Bump traefik version
2022-11-15 15:57:23 -08:00
IamTheFij
a1def1c69d
Increase memory for lldap
...
Password hashing was causing OOM kills
2022-11-15 15:57:23 -08:00
IamTheFij
c7d0fca6e7
Pin lldap verison
2022-11-15 15:57:23 -08:00
IamTheFij
86b472435c
Use explicit lldap ports so that connect proxy can find them
2022-11-15 15:57:23 -08:00
IamTheFij
2db266bda7
Update blocky upstream dns to bootstrap better (hopefully) and forward to consul
2022-11-15 10:26:26 -08:00
IamTheFij
cf2779c971
Update lldap to use dynamic ports
2022-11-15 09:43:13 -08:00
IamTheFij
b098a325f8
Add backups for photoprism
2022-11-15 09:19:55 -08:00
IamTheFij
c5135be4a0
Pin photoprism version to avoid pulling every time
2022-11-15 09:19:32 -08:00
IamTheFij
4a68894238
Add some minitor checks
2022-11-15 09:04:18 -08:00
IamTheFij
17ab7f637f
Add metrics support to service template
2022-11-15 09:04:18 -08:00
IamTheFij
e104cbccc4
Use new Photos share for Photoprism
2022-11-15 09:04:18 -08:00
IamTheFij
954a878915
Grafana update + renderer + new dashboards
2022-11-15 09:04:18 -08:00
IamTheFij
bee9b641cc
Fix local dns in docker
2022-11-15 09:04:18 -08:00
IamTheFij
19f1f8448d
WIP: Add a new playbook for stopping cluster
...
Hopefully without data loss
2022-11-14 23:11:13 -08:00
IamTheFij
bbec244f45
Fix typo in recovery playbooks
2022-11-14 23:10:16 -08:00
IamTheFij
0d47a1f8c8
Tune PhotoPrism
2022-11-11 16:21:47 -08:00
IamTheFij
bb400a3f1c
Add blocky metrics to grafana
2022-11-11 16:21:17 -08:00
IamTheFij
da70aa74ca
Add expose path for blocky /metrics
...
Not sure if it's needed
2022-11-11 13:47:27 -08:00
IamTheFij
a30749f357
Switch services to module based Terraform template from levant
...
This ends up with a better experience in dealing with tfstate for some
services. Not sure why.
2022-11-11 13:47:26 -08:00
IamTheFij
49c8a73ac9
Store loki data on ephemeral disk
2022-11-11 13:24:54 -08:00
IamTheFij
3bfc1f61ac
Update levant service template with some defaults
2022-11-11 13:24:28 -08:00
IamTheFij
af32c9e2e5
Put grafana bootstrap secrets in secrets location
2022-11-10 13:39:12 -08:00
IamTheFij
3077e66e70
Limit all existing services to websecure entrypoint
...
This will be a bigger issue if exposing a public entrypoint.
2022-11-10 13:37:50 -08:00
IamTheFij
29110eaf47
Update Nomad UI links to Consul and Vault
2022-11-10 13:37:50 -08:00
IamTheFij
5b0f50140c
Update playbook that clears nomad and consul data
2022-11-10 13:37:50 -08:00
IamTheFij
068dc73717
Add photoprism
2022-11-10 13:37:50 -08:00
IamTheFij
e9f2fae609
Switch mysql to mariadb
2022-11-10 13:37:50 -08:00
IamTheFij
77c2fcc96b
Add db bootstrap and more template options to services template
2022-11-10 10:20:53 -08:00
IamTheFij
2bde762902
Use journald for Nomad Docker logging so they can be ingested into Loki
2022-11-10 10:19:51 -08:00
IamTheFij
92fd139263
Update nomad version to 1.4.2
2022-11-10 10:19:22 -08:00
IamTheFij
ae5f4d61fb
Make consul raft v3 explicit
2022-11-10 10:19:07 -08:00
IamTheFij
e707f2a790
Add pi4 host back
2022-11-10 10:18:37 -08:00
IamTheFij
539b9073cb
Update permissions for mysql volume
2022-11-10 10:18:28 -08:00
IamTheFij
0e0d2bbcc6
Fix ansible_galaxy target references
2022-11-10 10:18:02 -08:00
IamTheFij
51a0b71bd8
Update recovery scripts
2022-11-10 10:15:30 -08:00
IamTheFij
1fad6b691c
Update some metrics
2022-11-07 20:50:18 -08:00
IamTheFij
f9d46faae9
Rename backup jobs to be lower case
2022-11-04 09:39:08 -07:00
IamTheFij
931e2b6e00
Make sure grafana mysql dump happens after dir is created
2022-11-03 22:18:04 -07:00
IamTheFij
9d56f6226c
Try to reduce concurrent ftp
2022-11-03 22:17:48 -07:00
IamTheFij
39bd8aafaf
Move backup jobs to local dir
...
Makes debugging easier
2022-11-03 22:17:26 -07:00
IamTheFij