Commit Graph

493 Commits

Author SHA1 Message Date
IamTheFij 25fcdd2292 WIP: Add support for creating a test cluster
This will help with verifying backups and making sure my configuration
is dynamic.
2023-11-30 09:57:18 -08:00
IamTheFij 2d733b278c Make backup jobids static so they work on clean deploy 2023-11-30 09:55:08 -08:00
IamTheFij b218633c2c Add scheduled job to update UniFi Traffic Routes
Because I use a custom DNS server, Domain based routing rules
don't work. This instead resolves the domains and then adds
the IP addresses to the rules.
2023-11-20 10:37:03 -08:00
IamTheFij e21ec11eb5 Fix grafana
Broken template
2023-11-20 10:35:49 -08:00
IamTheFij d6f9c2a7e4 Fix diun include tags variable
This fixes a configuration bug causing diun to include all tags by default.
2023-11-16 12:22:44 -08:00
IamTheFij 891cfa7b2d Update blocky dashboard to not use consul tags 2023-11-16 12:21:59 -08:00
IamTheFij c11b8e157b Fix grafana dashboard provisioning
A path mismatch existed after migrating to alloc storage
2023-11-16 12:21:40 -08:00
IamTheFij 0d208b7394 Add dummy backup job to keep backup task running on all hosts
Otherwise, if a client is not running any stateful services, the task
will fail and Nomad will eventually stop retrying. If a service gets
relocated to the host, the task is not restarted. This makes sure the
task will cover moved services and make it more easy to determine that
backups are healthy.
2023-11-16 12:19:19 -08:00
IamTheFij 9b347880cc Ignore some regeneratable files in backups
Reduces the size of Lidarr and Photoprism backups
2023-11-07 16:50:02 -08:00
IamTheFij a0185d9642 Bump resources for backups to allow more memory
Was getting OOM killed
2023-11-07 16:49:27 -08:00
IamTheFij f2f5f4407c Add TZ to restic-scheduler 2023-11-07 16:48:57 -08:00
IamTheFij 0b3d3caff6 Update restic-scheduler to fix index out of range error 2023-11-07 16:48:41 -08:00
IamTheFij 52abd94a38 Use minio as restic repo rather than sftp
I've been getting a lot of restic lock errors using sftp
2023-11-06 16:35:13 -08:00
IamTheFij 0391fd95ad Allow fixers to actually fix things 2023-11-06 14:41:54 -08:00
IamTheFij df1ae60936 Add change_script to service module 2023-11-06 14:41:13 -08:00
IamTheFij a2d33ac309 Add proxmox influxdb to Grafana 2023-10-23 13:10:01 -07:00
IamTheFij 1b48892172 Add read-only implementation of fixers as scheduled batches 2023-10-23 12:59:45 -07:00
IamTheFij 48a48bb080 Move sonarr and nzbget to their own jobs 2023-10-23 12:59:11 -07:00
IamTheFij bd2c5ca3db Put restic cache on ephemeral disk 2023-10-23 08:54:05 -07:00
IamTheFij 48074bdc39 Fix log from orphaned services to not say deleting when it's in dry run. 2023-10-19 12:08:28 -07:00
IamTheFij 2f3fc87f12 Consider job status when detecting missing services
Prevents false alarms and attempts to restart failed or stopped allocs.
2023-10-19 12:07:57 -07:00
IamTheFij 369802cacc Bump Postgres memory to 500mb 2023-10-19 12:07:14 -07:00
IamTheFij 0c3f98d5c3 Pin Grafana to amd64 since renderer requires it.
This could be mitigated by moving the renderer to another task group.
2023-10-19 12:06:47 -07:00
IamTheFij b97cfb68ad Minor Nomad bmp 1.6.2 2023-10-19 12:05:52 -07:00
IamTheFij d83591cfd4 Make diun disk sticky 2023-09-27 21:34:14 -07:00
IamTheFij f80eccdfa2 Update diun to use global defaults 2023-09-27 21:33:55 -07:00
IamTheFij 5fe30d005b Update missing services script to restart allocs 2023-09-27 21:30:48 -07:00
IamTheFij ad439d48f3 Add waiting for loki and prom dependencies in core 2023-09-27 21:30:22 -07:00
IamTheFij df4737655a Remount network shares when recovering cluster 2023-09-27 21:26:44 -07:00
IamTheFij b29f405090 Bump prometheus versiosn and pin blocky 2023-09-18 21:58:43 -07:00
IamTheFij cf90248430 Remove old Consul and Vault references 2023-09-17 21:43:04 -07:00
IamTheFij 72a108753b Bump lldap to latest release 2023-09-14 12:14:07 -07:00
IamTheFij 8dd00c1249 authelia and grafana to shared smtp secrets 2023-08-29 15:11:40 -07:00
IamTheFij edeb6cf444 lldap: access shared smtp secrets 2023-08-29 14:56:06 -07:00
IamTheFij 2bd939e651 Remove deprecated hcl2 enabled 2023-08-29 13:02:04 -07:00
IamTheFij ea8ca478c6 Fix blocky acl 2023-08-29 12:59:14 -07:00
IamTheFij 769965ae6b Fix lidarr to use postgres db creds 2023-08-29 12:52:30 -07:00
IamTheFij f5898b0283 Add workload ACL management for mysql and postgres access
Allows required jobs to access shared secrets and auto generates psks
for stunnel.

Currently supporting MySQL, Postgres, and LDAP.
2023-08-29 12:48:48 -07:00
IamTheFij cdba6aa24f Add script to check for missing services 2023-08-28 13:54:24 -07:00
IamTheFij 50447b9a7d Add a read-only check for orphaned service script 2023-08-28 13:54:06 -07:00
IamTheFij 08f92f8ba5 Add new backup and orphaned service scripts 2023-08-26 15:59:50 -07:00
IamTheFij b13e31d9f8 Move scripts to subdir 2023-08-26 15:58:57 -07:00
IamTheFij a57e87d21f Fix var path for adhoc backup jobs 2023-08-26 15:56:21 -07:00
IamTheFij 2efc7f8c2f Add ability to set job meta for services 2023-08-24 15:41:18 -07:00
IamTheFij 7aa5b800ba Clean up finally rendered templates for services 2023-08-24 15:37:42 -07:00
IamTheFij 013dd8248b Make base_hostname more configurable 2023-08-24 15:03:36 -07:00
IamTheFij f6dd3f4284 Clean up root module and move lldap to databases 2023-08-24 13:52:03 -07:00
IamTheFij 4a7bff7611 Move metrics out of a module and into core 2023-08-24 13:00:36 -07:00
IamTheFij b4a6901687 Bump up sonarr memory a little more 2023-08-24 12:51:32 -07:00
IamTheFij d5078b24da Refactor use of wesher to be behind a variable toggle
Occasionally I run into issues with Wesher. This makes it easier to
disable use of Wesher by setting TF_VAR_use_wesher to false.
2023-08-24 12:51:32 -07:00