Currently we automate all of our backups using an Ansible role that manages our borgbackup server along with all of the borg clients. It adds/modifies scripts and crons on the clients (hypervisors) based on the variables we set and makes sure the clients can SSH into an unprivileged user and only access a specific directory as specified in .ssh/authorized_keys so it can push all of the data into a borg repo. Before it runs the borg portion of the script though, another tool on Proxmox (vzdump) backups up all of the VMs daily to the local disk and compresses them with pigz (multi-threaded gzip). Borg will then send all of the specified directories & files to our remote borg server for safe keeping.

I just added support for rclone so that after the all of the clients finish their backups for the day, it will do a weekly rclone sync on the borg server to our bucket on Wasabi object storage. I picked Wasabi, because they don't charge for egress (outgoing bandwidth). So in the event of a major disaster and we've lost our borg server, we could retrieve our borg repos from Wasabi.