Commit Graph

600 Commits

Author SHA1 Message Date
080cea9637 Fix minitor
Healthcheck was failing due to wrong path and log alert was failing
due to the config file being templated by Nomad. Updated to use a
different delimiter.
2022-11-16 09:04:32 -08:00
f481e7b938 Update blocky dashboards 2022-11-16 08:42:36 -08:00
35403d0219 Update nomad dashboard 2022-11-16 08:37:29 -08:00
416676c9f9 Update minitor dashboard 2022-11-16 08:35:01 -08:00
12b91e9566 Fix env location for lldap 2022-11-15 16:54:37 -08:00
8a21dd7eb4 Bump traefik version 2022-11-15 15:57:23 -08:00
a1def1c69d Increase memory for lldap
Password hashing was causing OOM kills
2022-11-15 15:57:23 -08:00
c7d0fca6e7 Pin lldap verison 2022-11-15 15:57:23 -08:00
86b472435c Use explicit lldap ports so that connect proxy can find them 2022-11-15 15:57:23 -08:00
2db266bda7 Update blocky upstream dns to bootstrap better (hopefully) and forward to consul 2022-11-15 10:26:26 -08:00
cf2779c971 Update lldap to use dynamic ports 2022-11-15 09:43:13 -08:00
b098a325f8 Add backups for photoprism 2022-11-15 09:19:55 -08:00
c5135be4a0 Pin photoprism version to avoid pulling every time 2022-11-15 09:19:32 -08:00
4a68894238 Add some minitor checks 2022-11-15 09:04:18 -08:00
17ab7f637f Add metrics support to service template 2022-11-15 09:04:18 -08:00
e104cbccc4 Use new Photos share for Photoprism 2022-11-15 09:04:18 -08:00
954a878915 Grafana update + renderer + new dashboards 2022-11-15 09:04:18 -08:00
bee9b641cc Fix local dns in docker 2022-11-15 09:04:18 -08:00
19f1f8448d WIP: Add a new playbook for stopping cluster
Hopefully without data loss
2022-11-14 23:11:13 -08:00
bbec244f45 Fix typo in recovery playbooks 2022-11-14 23:10:16 -08:00
0d47a1f8c8 Tune PhotoPrism 2022-11-11 16:21:47 -08:00
bb400a3f1c Add blocky metrics to grafana 2022-11-11 16:21:17 -08:00
da70aa74ca Add expose path for blocky /metrics
Not sure if it's needed
2022-11-11 13:47:27 -08:00
a30749f357 Switch services to module based Terraform template from levant
This ends up with a better experience in dealing with tfstate for some
services. Not sure why.
2022-11-11 13:47:26 -08:00
49c8a73ac9 Store loki data on ephemeral disk 2022-11-11 13:24:54 -08:00
3bfc1f61ac Update levant service template with some defaults 2022-11-11 13:24:28 -08:00
af32c9e2e5 Put grafana bootstrap secrets in secrets location 2022-11-10 13:39:12 -08:00
3077e66e70 Limit all existing services to websecure entrypoint
This will be a bigger issue if exposing a public entrypoint.
2022-11-10 13:37:50 -08:00
29110eaf47 Update Nomad UI links to Consul and Vault 2022-11-10 13:37:50 -08:00
5b0f50140c Update playbook that clears nomad and consul data 2022-11-10 13:37:50 -08:00
068dc73717 Add photoprism 2022-11-10 13:37:50 -08:00
e9f2fae609 Switch mysql to mariadb 2022-11-10 13:37:50 -08:00
77c2fcc96b Add db bootstrap and more template options to services template 2022-11-10 10:20:53 -08:00
2bde762902 Use journald for Nomad Docker logging so they can be ingested into Loki 2022-11-10 10:19:51 -08:00
92fd139263 Update nomad version to 1.4.2 2022-11-10 10:19:22 -08:00
ae5f4d61fb Make consul raft v3 explicit 2022-11-10 10:19:07 -08:00
e707f2a790 Add pi4 host back 2022-11-10 10:18:37 -08:00
539b9073cb Update permissions for mysql volume 2022-11-10 10:18:28 -08:00
0e0d2bbcc6 Fix ansible_galaxy target references 2022-11-10 10:18:02 -08:00
51a0b71bd8 Update recovery scripts 2022-11-10 10:15:30 -08:00
1fad6b691c Update some metrics 2022-11-07 20:50:18 -08:00
f9d46faae9 Rename backup jobs to be lower case 2022-11-04 09:39:08 -07:00
931e2b6e00 Make sure grafana mysql dump happens after dir is created 2022-11-03 22:18:04 -07:00
9d56f6226c Try to reduce concurrent ftp 2022-11-03 22:17:48 -07:00
39bd8aafaf Move backup jobs to local dir
Makes debugging easier
2022-11-03 22:17:26 -07:00
779db10abc Add middleware support to service levant template 2022-11-03 15:10:51 -07:00
5bbb6c494c Fix some formatting 2022-11-03 15:10:09 -07:00
695567b8aa Add backup job for grafana 2022-11-02 20:30:04 -07:00
2d63d7e74d Add sqlite backup for lldap 2022-11-02 20:14:25 -07:00
37e80980bc Refactor ansible to clean root dir 2022-11-02 14:20:09 -07:00