[user@workstation homelab]$ ./rebuild-k8s.sh
Tainting: k8s-controller-01
Resource instance module.k8s-controller-01.libvirt_domain.main has been marked as tainted.
Resource instance module.k8s-controller-01.libvirt_volume.main has been marked as tainted.
Tainting: k8s-controller-02
Resource instance module.k8s-controller-02.libvirt_domain.main has been marked as tainted.
Resource instance module.k8s-controller-02.libvirt_volume.main has been marked as tainted.
Tainting: k8s-controller-03
Resource instance module.k8s-controller-03.libvirt_domain.main has been marked as tainted.
Resource instance module.k8s-controller-03.libvirt_volume.main has been marked as tainted.
Tainting: k8s-worker-01
Resource instance module.k8s-worker-01.libvirt_domain.main has been marked as tainted.
Resource instance module.k8s-worker-01.libvirt_volume.main has been marked as tainted.
Tainting: k8s-worker-02
Resource instance module.k8s-worker-02.libvirt_domain.main has been marked as tainted.
Resource instance module.k8s-worker-02.libvirt_volume.main has been marked as tainted.
Tainting: k8s-worker-03
Resource instance module.k8s-worker-03.libvirt_domain.main has been marked as tainted.
Resource instance module.k8s-worker-03.libvirt_volume.main has been marked as tainted.
Waiting 30s
random_password.k8s-worker-02: Refreshing state... [id=none]
random_password.k8s-worker-01: Refreshing state... [id=none]
random_password.k8s-controller-01: Refreshing state... [id=none]
random_password.k8s-controller-03: Refreshing state... [id=none]
random_password.k8s-controller-02: Refreshing state... [id=none]
random_password.k8s-worker-03: Refreshing state... [id=none]
module.k8s-controller-02.libvirt_cloudinit_disk.cloudinit: Refreshing state... [id=/var/lib/libvirt/images/k8s-controller-02.lab.alexgardner.id.au-cloudinit.iso;572dd86d-61a6-4fce-95c4-44798223d7bd]
module.k8s-worker-02.libvirt_volume.main: Refreshing state... [id=/var/lib/libvirt/images/k8s-worker-02.lab.alexgardner.id.au.qcow2]
module.k8s-controller-02.libvirt_volume.main: Refreshing state... [id=/var/lib/libvirt/images/k8s-controller-02.lab.alexgardner.id.au.qcow2]
module.k8s-worker-02.libvirt_cloudinit_disk.cloudinit: Refreshing state... [id=/var/lib/libvirt/images/k8s-worker-02.lab.alexgardner.id.au-cloudinit.iso;47475e07-842b-4f92-87be-b5d4a02ae461]
module.k8s-controller-02.libvirt_domain.main: Refreshing state... [id=952bc61e-8d33-49ce-9653-75dbd188b103]
module.k8s-worker-02.libvirt_domain.main: Refreshing state... [id=1dc95e20-d55f-4c83-aaf4-3b5aced64196]
module.k8s-controller-01.libvirt_volume.main: Refreshing state... [id=/var/lib/libvirt/images/k8s-controller-01.lab.alexgardner.id.au.qcow2]
module.k8s-worker-01.libvirt_cloudinit_disk.cloudinit: Refreshing state... [id=/var/lib/libvirt/images/k8s-worker-01.lab.alexgardner.id.au-cloudinit.iso;8f970aa2-57c5-4c91-afc6-367ce34e58e6]
module.k8s-worker-01.libvirt_volume.main: Refreshing state... [id=/var/lib/libvirt/images/k8s-worker-01.lab.alexgardner.id.au.qcow2]
module.k8s-controller-01.libvirt_cloudinit_disk.cloudinit: Refreshing state... [id=/var/lib/libvirt/images/k8s-controller-01.lab.alexgardner.id.au-cloudinit.iso;bba61c65-519e-42a6-a6a3-bb88891b6753]
module.k8s-worker-03.libvirt_volume.main: Refreshing state... [id=/var/lib/libvirt/images/k8s-worker-03.lab.alexgardner.id.au.qcow2]
module.k8s-controller-03.libvirt_cloudinit_disk.cloudinit: Refreshing state... [id=/var/lib/libvirt/images/k8s-controller-03.lab.alexgardner.id.au-cloudinit.iso;284f8b5f-62ad-453f-aebc-c9fe6d3dbfc8]
module.k8s-controller-03.libvirt_volume.main: Refreshing state... [id=/var/lib/libvirt/images/k8s-controller-03.lab.alexgardner.id.au.qcow2]
module.k8s-worker-03.libvirt_cloudinit_disk.cloudinit: Refreshing state... [id=/var/lib/libvirt/images/k8s-worker-03.lab.alexgardner.id.au-cloudinit.iso;c54d422d-a53b-4813-9772-3907b7967ef0]
module.k8s-controller-01.libvirt_domain.main: Refreshing state... [id=6fdb3e4d-01d5-46a8-90ef-95b4963fd498]
module.k8s-worker-01.libvirt_domain.main: Refreshing state... [id=b4dc5c82-4136-4eaf-976f-39efe4a047c0]
module.k8s-worker-03.libvirt_domain.main: Refreshing state... [id=f49d69a8-ecf9-4283-a090-81eb458124c2]
module.k8s-controller-03.libvirt_domain.main: Refreshing state... [id=ae6a8d0d-0245-4613-9a96-ca1834dd33e9]
Note: Objects have changed outside of Terraform
Terraform detected the following changes made outside of Terraform since the last "terraform apply":
# module.k8s-controller-01.libvirt_domain.main has changed
~ resource "libvirt_domain" "main" {
+ cmdline = []
id = "6fdb3e4d-01d5-46a8-90ef-95b4963fd498"
name = "k8s-controller-01.lab.alexgardner.id.au"
# (11 unchanged attributes hidden)
# (4 unchanged blocks hidden)
}
# module.k8s-controller-02.libvirt_domain.main has changed
~ resource "libvirt_domain" "main" {
+ cmdline = []
id = "952bc61e-8d33-49ce-9653-75dbd188b103"
name = "k8s-controller-02.lab.alexgardner.id.au"
# (11 unchanged attributes hidden)
# (4 unchanged blocks hidden)
}
# module.k8s-controller-03.libvirt_domain.main has changed
~ resource "libvirt_domain" "main" {
+ cmdline = []
id = "ae6a8d0d-0245-4613-9a96-ca1834dd33e9"
name = "k8s-controller-03.lab.alexgardner.id.au"
# (11 unchanged attributes hidden)
# (4 unchanged blocks hidden)
}
# module.k8s-worker-01.libvirt_domain.main has changed
~ resource "libvirt_domain" "main" {
+ cmdline = []
id = "b4dc5c82-4136-4eaf-976f-39efe4a047c0"
name = "k8s-worker-01.lab.alexgardner.id.au"
# (11 unchanged attributes hidden)
# (4 unchanged blocks hidden)
}
# module.k8s-worker-02.libvirt_domain.main has changed
~ resource "libvirt_domain" "main" {
+ cmdline = []
id = "1dc95e20-d55f-4c83-aaf4-3b5aced64196"
name = "k8s-worker-02.lab.alexgardner.id.au"
# (11 unchanged attributes hidden)
# (4 unchanged blocks hidden)
}
# module.k8s-worker-03.libvirt_domain.main has changed
~ resource "libvirt_domain" "main" {
+ cmdline = []
id = "f49d69a8-ecf9-4283-a090-81eb458124c2"
name = "k8s-worker-03.lab.alexgardner.id.au"
# (11 unchanged attributes hidden)
# (4 unchanged blocks hidden)
}
Unless you have made equivalent changes to your configuration, or ignored the relevant attributes using
ignore_changes, the following plan may include actions to undo or respond to these changes.
──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with
the following symbols:
-/+ destroy and then create replacement
Terraform will perform the following actions:
# module.k8s-controller-01.libvirt_domain.main is tainted, so must be replaced
-/+ resource "libvirt_domain" "main" {
~ arch = "x86_64" -> (known after apply)
- cmdline = [] -> null
~ disk = [
~ {
~ block_device = "" -> null
~ file = "" -> null
~ scsi = false -> null
~ url = "" -> null
~ volume_id = "/var/lib/libvirt/images/k8s-controller-01.lab.alexgardner.id.au.qcow2" -> (known after apply)
~ wwn = "" -> null
},
]
~ emulator = "/usr/bin/qemu-system-x86_64" -> (known after apply)
~ id = "6fdb3e4d-01d5-46a8-90ef-95b4963fd498" -> (known after apply)
~ machine = "pc" -> (known after apply)
name = "k8s-controller-01.lab.alexgardner.id.au"
# (7 unchanged attributes hidden)
~ console {
# (5 unchanged attributes hidden)
}
~ console {
# (5 unchanged attributes hidden)
}
~ graphics {
- websocket = 0 -> null
# (4 unchanged attributes hidden)
}
~ network_interface {
~ addresses = [] -> (known after apply)
~ mac = "52:54:00:3E:69:76" -> (known after apply)
+ network_id = (known after apply)
+ network_name = (known after apply)
- wait_for_lease = false -> null
# (2 unchanged attributes hidden)
}
}
# module.k8s-controller-01.libvirt_volume.main is tainted, so must be replaced
-/+ resource "libvirt_volume" "main" {
~ format = "qcow2" -> (known after apply)
~ id = "/var/lib/libvirt/images/k8s-controller-01.lab.alexgardner.id.au.qcow2" -> (known after apply)
name = "k8s-controller-01.lab.alexgardner.id.au.qcow2"
# (3 unchanged attributes hidden)
}
# module.k8s-controller-02.libvirt_domain.main is tainted, so must be replaced
-/+ resource "libvirt_domain" "main" {
~ arch = "x86_64" -> (known after apply)
- cmdline = [] -> null
~ disk = [
~ {
~ block_device = "" -> null
~ file = "" -> null
~ scsi = false -> null
~ url = "" -> null
~ volume_id = "/var/lib/libvirt/images/k8s-controller-02.lab.alexgardner.id.au.qcow2" -> (known after apply)
~ wwn = "" -> null
},
]
~ emulator = "/usr/bin/qemu-system-x86_64" -> (known after apply)
~ id = "952bc61e-8d33-49ce-9653-75dbd188b103" -> (known after apply)
~ machine = "pc" -> (known after apply)
name = "k8s-controller-02.lab.alexgardner.id.au"
# (7 unchanged attributes hidden)
~ console {
# (5 unchanged attributes hidden)
}
~ console {
# (5 unchanged attributes hidden)
}
~ graphics {
- websocket = 0 -> null
# (4 unchanged attributes hidden)
}
~ network_interface {
~ addresses = [] -> (known after apply)
~ mac = "52:54:00:9E:93:54" -> (known after apply)
+ network_id = (known after apply)
+ network_name = (known after apply)
- wait_for_lease = false -> null
# (2 unchanged attributes hidden)
}
}
# module.k8s-controller-02.libvirt_volume.main is tainted, so must be replaced
-/+ resource "libvirt_volume" "main" {
~ format = "qcow2" -> (known after apply)
~ id = "/var/lib/libvirt/images/k8s-controller-02.lab.alexgardner.id.au.qcow2" -> (known after apply)
name = "k8s-controller-02.lab.alexgardner.id.au.qcow2"
# (3 unchanged attributes hidden)
}
# module.k8s-controller-03.libvirt_domain.main is tainted, so must be replaced
-/+ resource "libvirt_domain" "main" {
~ arch = "x86_64" -> (known after apply)
- cmdline = [] -> null
~ disk = [
~ {
~ block_device = "" -> null
~ file = "" -> null
~ scsi = false -> null
~ url = "" -> null
~ volume_id = "/var/lib/libvirt/images/k8s-controller-03.lab.alexgardner.id.au.qcow2" -> (known after apply)
~ wwn = "" -> null
},
]
~ emulator = "/usr/bin/qemu-system-x86_64" -> (known after apply)
~ id = "ae6a8d0d-0245-4613-9a96-ca1834dd33e9" -> (known after apply)
~ machine = "pc" -> (known after apply)
name = "k8s-controller-03.lab.alexgardner.id.au"
# (7 unchanged attributes hidden)
~ console {
# (5 unchanged attributes hidden)
}
~ console {
# (5 unchanged attributes hidden)
}
~ graphics {
- websocket = 0 -> null
# (4 unchanged attributes hidden)
}
~ network_interface {
~ addresses = [] -> (known after apply)
~ mac = "52:54:00:5E:45:AC" -> (known after apply)
+ network_id = (known after apply)
+ network_name = (known after apply)
- wait_for_lease = false -> null
# (2 unchanged attributes hidden)
}
}
# module.k8s-controller-03.libvirt_volume.main is tainted, so must be replaced
-/+ resource "libvirt_volume" "main" {
~ format = "qcow2" -> (known after apply)
~ id = "/var/lib/libvirt/images/k8s-controller-03.lab.alexgardner.id.au.qcow2" -> (known after apply)
name = "k8s-controller-03.lab.alexgardner.id.au.qcow2"
# (3 unchanged attributes hidden)
}
# module.k8s-worker-01.libvirt_domain.main is tainted, so must be replaced
-/+ resource "libvirt_domain" "main" {
~ arch = "x86_64" -> (known after apply)
- cmdline = [] -> null
~ disk = [
~ {
~ block_device = "" -> null
~ file = "" -> null
~ scsi = false -> null
~ url = "" -> null
~ volume_id = "/var/lib/libvirt/images/k8s-worker-01.lab.alexgardner.id.au.qcow2" -> (known after apply)
~ wwn = "" -> null
},
]
~ emulator = "/usr/bin/qemu-system-x86_64" -> (known after apply)
~ id = "b4dc5c82-4136-4eaf-976f-39efe4a047c0" -> (known after apply)
~ machine = "pc" -> (known after apply)
name = "k8s-worker-01.lab.alexgardner.id.au"
# (7 unchanged attributes hidden)
~ console {
# (5 unchanged attributes hidden)
}
~ console {
# (5 unchanged attributes hidden)
}
~ graphics {
- websocket = 0 -> null
# (4 unchanged attributes hidden)
}
~ network_interface {
~ addresses = [] -> (known after apply)
~ mac = "52:54:00:4A:57:C9" -> (known after apply)
+ network_id = (known after apply)
+ network_name = (known after apply)
- wait_for_lease = false -> null
# (2 unchanged attributes hidden)
}
}
# module.k8s-worker-01.libvirt_volume.main is tainted, so must be replaced
-/+ resource "libvirt_volume" "main" {
~ format = "qcow2" -> (known after apply)
~ id = "/var/lib/libvirt/images/k8s-worker-01.lab.alexgardner.id.au.qcow2" -> (known after apply)
name = "k8s-worker-01.lab.alexgardner.id.au.qcow2"
# (3 unchanged attributes hidden)
}
# module.k8s-worker-02.libvirt_domain.main is tainted, so must be replaced
-/+ resource "libvirt_domain" "main" {
~ arch = "x86_64" -> (known after apply)
- cmdline = [] -> null
~ disk = [
~ {
~ block_device = "" -> null
~ file = "" -> null
~ scsi = false -> null
~ url = "" -> null
~ volume_id = "/var/lib/libvirt/images/k8s-worker-02.lab.alexgardner.id.au.qcow2" -> (known after apply)
~ wwn = "" -> null
},
]
~ emulator = "/usr/bin/qemu-system-x86_64" -> (known after apply)
~ id = "1dc95e20-d55f-4c83-aaf4-3b5aced64196" -> (known after apply)
~ machine = "pc" -> (known after apply)
name = "k8s-worker-02.lab.alexgardner.id.au"
# (7 unchanged attributes hidden)
~ console {
# (5 unchanged attributes hidden)
}
~ console {
# (5 unchanged attributes hidden)
}
~ graphics {
- websocket = 0 -> null
# (4 unchanged attributes hidden)
}
~ network_interface {
~ addresses = [] -> (known after apply)
~ mac = "52:54:00:4A:11:2D" -> (known after apply)
+ network_id = (known after apply)
+ network_name = (known after apply)
- wait_for_lease = false -> null
# (2 unchanged attributes hidden)
}
}
# module.k8s-worker-02.libvirt_volume.main is tainted, so must be replaced
-/+ resource "libvirt_volume" "main" {
~ format = "qcow2" -> (known after apply)
~ id = "/var/lib/libvirt/images/k8s-worker-02.lab.alexgardner.id.au.qcow2" -> (known after apply)
name = "k8s-worker-02.lab.alexgardner.id.au.qcow2"
# (3 unchanged attributes hidden)
}
# module.k8s-worker-03.libvirt_domain.main is tainted, so must be replaced
-/+ resource "libvirt_domain" "main" {
~ arch = "x86_64" -> (known after apply)
- cmdline = [] -> null
~ disk = [
~ {
~ block_device = "" -> null
~ file = "" -> null
~ scsi = false -> null
~ url = "" -> null
~ volume_id = "/var/lib/libvirt/images/k8s-worker-03.lab.alexgardner.id.au.qcow2" -> (known after apply)
~ wwn = "" -> null
},
]
~ emulator = "/usr/bin/qemu-system-x86_64" -> (known after apply)
~ id = "f49d69a8-ecf9-4283-a090-81eb458124c2" -> (known after apply)
~ machine = "pc" -> (known after apply)
name = "k8s-worker-03.lab.alexgardner.id.au"
# (7 unchanged attributes hidden)
~ console {
# (5 unchanged attributes hidden)
}
~ console {
# (5 unchanged attributes hidden)
}
~ graphics {
- websocket = 0 -> null
# (4 unchanged attributes hidden)
}
~ network_interface {
~ addresses = [] -> (known after apply)
~ mac = "52:54:00:6E:02:BC" -> (known after apply)
+ network_id = (known after apply)
+ network_name = (known after apply)
- wait_for_lease = false -> null
# (2 unchanged attributes hidden)
}
}
# module.k8s-worker-03.libvirt_volume.main is tainted, so must be replaced
-/+ resource "libvirt_volume" "main" {
~ format = "qcow2" -> (known after apply)
~ id = "/var/lib/libvirt/images/k8s-worker-03.lab.alexgardner.id.au.qcow2" -> (known after apply)
name = "k8s-worker-03.lab.alexgardner.id.au.qcow2"
# (3 unchanged attributes hidden)
}
Plan: 12 to add, 0 to change, 12 to destroy.
module.k8s-worker-03.libvirt_domain.main: Destroying... [id=f49d69a8-ecf9-4283-a090-81eb458124c2]
module.k8s-controller-03.libvirt_domain.main: Destroying... [id=ae6a8d0d-0245-4613-9a96-ca1834dd33e9]
module.k8s-controller-01.libvirt_domain.main: Destroying... [id=6fdb3e4d-01d5-46a8-90ef-95b4963fd498]
module.k8s-worker-01.libvirt_domain.main: Destroying... [id=b4dc5c82-4136-4eaf-976f-39efe4a047c0]
module.k8s-worker-02.libvirt_domain.main: Destroying... [id=1dc95e20-d55f-4c83-aaf4-3b5aced64196]
module.k8s-controller-02.libvirt_domain.main: Destroying... [id=952bc61e-8d33-49ce-9653-75dbd188b103]
module.k8s-controller-02.libvirt_domain.main: Destruction complete after 1s
module.k8s-controller-02.libvirt_volume.main: Destroying... [id=/var/lib/libvirt/images/k8s-controller-02.lab.alexgardner.id.au.qcow2]
module.k8s-worker-02.libvirt_domain.main: Destruction complete after 1s
module.k8s-worker-02.libvirt_volume.main: Destroying... [id=/var/lib/libvirt/images/k8s-worker-02.lab.alexgardner.id.au.qcow2]
module.k8s-controller-01.libvirt_domain.main: Destruction complete after 1s
module.k8s-worker-03.libvirt_domain.main: Destruction complete after 1s
module.k8s-controller-03.libvirt_domain.main: Destruction complete after 1s
module.k8s-controller-01.libvirt_volume.main: Destroying... [id=/var/lib/libvirt/images/k8s-controller-01.lab.alexgardner.id.au.qcow2]
module.k8s-worker-03.libvirt_volume.main: Destroying... [id=/var/lib/libvirt/images/k8s-worker-03.lab.alexgardner.id.au.qcow2]
module.k8s-controller-03.libvirt_volume.main: Destroying... [id=/var/lib/libvirt/images/k8s-controller-03.lab.alexgardner.id.au.qcow2]
module.k8s-worker-01.libvirt_domain.main: Destruction complete after 1s
module.k8s-worker-01.libvirt_volume.main: Destroying... [id=/var/lib/libvirt/images/k8s-worker-01.lab.alexgardner.id.au.qcow2]
module.k8s-controller-02.libvirt_volume.main: Destruction complete after 0s
module.k8s-controller-02.libvirt_volume.main: Creating...
module.k8s-controller-01.libvirt_volume.main: Destruction complete after 0s
module.k8s-worker-03.libvirt_volume.main: Destruction complete after 0s
module.k8s-worker-03.libvirt_volume.main: Creating...
module.k8s-controller-01.libvirt_volume.main: Creating...
module.k8s-worker-01.libvirt_volume.main: Destruction complete after 0s
module.k8s-worker-01.libvirt_volume.main: Creating...
module.k8s-controller-01.libvirt_volume.main: Creation complete after 0s [id=/var/lib/libvirt/images/k8s-controller-01.lab.alexgardner.id.au.qcow2]
module.k8s-controller-01.libvirt_domain.main: Creating...
module.k8s-worker-01.libvirt_volume.main: Creation complete after 0s [id=/var/lib/libvirt/images/k8s-worker-01.lab.alexgardner.id.au.qcow2]
module.k8s-worker-01.libvirt_domain.main: Creating...
module.k8s-worker-02.libvirt_volume.main: Destruction complete after 1s
module.k8s-worker-02.libvirt_volume.main: Creating...
module.k8s-controller-02.libvirt_volume.main: Creation complete after 1s [id=/var/lib/libvirt/images/k8s-controller-02.lab.alexgardner.id.au.qcow2]
module.k8s-controller-02.libvirt_domain.main: Creating...
module.k8s-worker-02.libvirt_volume.main: Creation complete after 0s [id=/var/lib/libvirt/images/k8s-worker-02.lab.alexgardner.id.au.qcow2]
module.k8s-worker-02.libvirt_domain.main: Creating...
module.k8s-controller-03.libvirt_volume.main: Destruction complete after 1s
module.k8s-controller-03.libvirt_volume.main: Creating...
module.k8s-worker-03.libvirt_volume.main: Creation complete after 1s [id=/var/lib/libvirt/images/k8s-worker-03.lab.alexgardner.id.au.qcow2]
module.k8s-worker-03.libvirt_domain.main: Creating...
module.k8s-controller-03.libvirt_volume.main: Creation complete after 0s [id=/var/lib/libvirt/images/k8s-controller-03.lab.alexgardner.id.au.qcow2]
module.k8s-controller-03.libvirt_domain.main: Creating...
module.k8s-controller-02.libvirt_domain.main: Creation complete after 1s [id=af0c9723-b9ae-4548-a795-47e7c77214e5]
module.k8s-worker-02.libvirt_domain.main: Creation complete after 1s [id=f4fe94e2-911e-4fa1-b0fa-c000d36a1896]
module.k8s-controller-01.libvirt_domain.main: Creation complete after 2s [id=55000b5a-2f5b-4829-ad8f-52c5ea772bb8]
module.k8s-worker-01.libvirt_domain.main: Creation complete after 2s [id=a79f813f-9b36-47ce-871b-95fe4d67bf65]
module.k8s-controller-03.libvirt_domain.main: Creation complete after 1s [id=494cc4d1-f272-461b-92e4-3cc61b590141]
module.k8s-worker-03.libvirt_domain.main: Creation complete after 1s [id=f2570954-8827-4b29-8b37-5fe3cab59ed8]
Apply complete! Resources: 12 added, 0 changed, 12 destroyed.
Waiting 60s
Resetting SSH Host Keys: k8s-controller-01
# Host 10.1.1.41 found: line 1061
# Host 10.1.1.41 found: line 1062
# Host 10.1.1.41 found: line 1063
/home/user/.ssh/known_hosts updated.
Original contents retained as /home/user/.ssh/known_hosts.old
# 10.1.1.41:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.41:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.41:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.41:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.41:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
Resetting SSH Host Keys: k8s-controller-02
# Host 10.1.1.42 found: line 1061
# Host 10.1.1.42 found: line 1062
# Host 10.1.1.42 found: line 1063
/home/user/.ssh/known_hosts updated.
Original contents retained as /home/user/.ssh/known_hosts.old
# 10.1.1.42:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.42:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.42:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.42:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.42:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
Resetting SSH Host Keys: k8s-controller-03
# Host 10.1.1.43 found: line 1061
# Host 10.1.1.43 found: line 1062
# Host 10.1.1.43 found: line 1063
/home/user/.ssh/known_hosts updated.
Original contents retained as /home/user/.ssh/known_hosts.old
# 10.1.1.43:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.43:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.43:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.43:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.43:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
Resetting SSH Host Keys: k8s-worker-01
# Host 10.1.1.51 found: line 1061
# Host 10.1.1.51 found: line 1062
# Host 10.1.1.51 found: line 1063
/home/user/.ssh/known_hosts updated.
Original contents retained as /home/user/.ssh/known_hosts.old
# 10.1.1.51:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.51:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.51:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.51:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.51:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
Resetting SSH Host Keys: k8s-worker-02
# Host 10.1.1.52 found: line 1061
# Host 10.1.1.52 found: line 1062
# Host 10.1.1.52 found: line 1063
/home/user/.ssh/known_hosts updated.
Original contents retained as /home/user/.ssh/known_hosts.old
# 10.1.1.52:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.52:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.52:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.52:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.52:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
Resetting SSH Host Keys: k8s-worker-03
# Host 10.1.1.53 found: line 1061
# Host 10.1.1.53 found: line 1062
# Host 10.1.1.53 found: line 1063
/home/user/.ssh/known_hosts updated.
Original contents retained as /home/user/.ssh/known_hosts.old
# 10.1.1.53:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.53:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.53:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.53:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
# 10.1.1.53:22 SSH-2.0-OpenSSH_7.9p1 Debian-10+deb10u2
PLAY [k8s_all] ********************************************************************************************************
TASK [Gathering Facts] ************************************************************************************************
ok: [k8s-worker-01]
ok: [k8s-controller-01]
ok: [k8s-controller-02]
ok: [k8s-worker-02]
ok: [k8s-controller-03]
ok: [k8s-worker-03]
TASK [common | set variables] *****************************************************************************************
ok: [k8s-controller-01] => (item=/homelab/ansible/roles/common/vars/Debian.yml)
ok: [k8s-controller-02] => (item=/homelab/ansible/roles/common/vars/Debian.yml)
ok: [k8s-controller-03] => (item=/homelab/ansible/roles/common/vars/Debian.yml)
ok: [k8s-worker-01] => (item=/homelab/ansible/roles/common/vars/Debian.yml)
ok: [k8s-worker-02] => (item=/homelab/ansible/roles/common/vars/Debian.yml)
ok: [k8s-worker-03] => (item=/homelab/ansible/roles/common/vars/Debian.yml)
TASK [common | populate service facts] ********************************************************************************
ok: [k8s-controller-03]
ok: [k8s-worker-02]
ok: [k8s-controller-01]
ok: [k8s-controller-02]
ok: [k8s-worker-01]
ok: [k8s-worker-03]
TASK [common : network | update hostname] *****************************************************************************
skipping: [k8s-controller-01]
skipping: [k8s-controller-02]
skipping: [k8s-controller-03]
skipping: [k8s-worker-01]
skipping: [k8s-worker-02]
skipping: [k8s-worker-03]
TASK [common : network | configure /etc/resolv.conf] ******************************************************************
changed: [k8s-worker-01]
changed: [k8s-controller-01]
changed: [k8s-controller-03]
changed: [k8s-worker-02]
changed: [k8s-controller-02]
changed: [k8s-worker-03]
TASK [common : network | configure /etc/hosts] ************************************************************************
changed: [k8s-controller-01]
changed: [k8s-controller-02]
changed: [k8s-worker-02]
changed: [k8s-controller-03]
changed: [k8s-worker-01]
changed: [k8s-worker-03]
TASK [common : firewall] **********************************************************************************************
included: /homelab/ansible/roles/common/tasks/firewall-Debian.yml for k8s-controller-01, k8s-controller-02, k8s-controller-03, k8s-worker-01, k8s-worker-02, k8s-worker-03
TASK [common : firewall | install ufw package] ************************************************************************
changed: [k8s-controller-03]
changed: [k8s-worker-01]
changed: [k8s-controller-01]
changed: [k8s-worker-02]
changed: [k8s-controller-02]
changed: [k8s-worker-03]
TASK [common : firewall | allow ssh inbound from clients] *************************************************************
changed: [k8s-worker-01]
changed: [k8s-controller-01]
changed: [k8s-controller-03]
changed: [k8s-controller-02]
changed: [k8s-worker-02]
changed: [k8s-worker-03]
TASK [common : firewall | set outbound default] ***********************************************************************
ok: [k8s-controller-02]
ok: [k8s-controller-01]
ok: [k8s-worker-02]
ok: [k8s-worker-01]
ok: [k8s-controller-03]
ok: [k8s-worker-03]
TASK [common : firewall | set inbound default] ************************************************************************
ok: [k8s-controller-01]
ok: [k8s-worker-01]
ok: [k8s-controller-03]
ok: [k8s-controller-02]
ok: [k8s-worker-02]
ok: [k8s-worker-03]
TASK [common : firewall | enable firewall] ****************************************************************************
changed: [k8s-controller-02]
changed: [k8s-worker-01]
changed: [k8s-controller-03]
changed: [k8s-worker-02]
changed: [k8s-controller-01]
changed: [k8s-worker-03]
TASK [common : ntp | update timezone] *********************************************************************************
changed: [k8s-controller-03]
changed: [k8s-worker-01]
changed: [k8s-controller-01]
changed: [k8s-worker-02]
changed: [k8s-controller-02]
changed: [k8s-worker-03]
TASK [common : ntp | install ntp package] *****************************************************************************
changed: [k8s-controller-03]
changed: [k8s-worker-02]
changed: [k8s-worker-01]
changed: [k8s-controller-01]
changed: [k8s-controller-02]
changed: [k8s-worker-03]
TASK [common : ntp | configure /etc/ntp.conf] *************************************************************************
ok: [k8s-worker-01]
ok: [k8s-worker-02]
ok: [k8s-controller-02]
ok: [k8s-controller-01]
ok: [k8s-controller-03]
ok: [k8s-worker-03]
TASK [common : ntp | start and enable ntp service] ********************************************************************
ok: [k8s-controller-03]
ok: [k8s-worker-01]
ok: [k8s-controller-01]
ok: [k8s-worker-02]
ok: [k8s-controller-02]
ok: [k8s-worker-03]
TASK [packages | install common packages] *****************************************************************************
changed: [k8s-controller-03] => (item=htop)
changed: [k8s-worker-02] => (item=htop)
changed: [k8s-controller-02] => (item=htop)
changed: [k8s-worker-01] => (item=htop)
changed: [k8s-controller-01] => (item=htop)
changed: [k8s-controller-03] => (item=lsof)
changed: [k8s-controller-02] => (item=lsof)
changed: [k8s-worker-02] => (item=lsof)
changed: [k8s-controller-01] => (item=lsof)
changed: [k8s-worker-01] => (item=lsof)
ok: [k8s-controller-03] => (item=net-tools)
ok: [k8s-controller-02] => (item=net-tools)
ok: [k8s-worker-02] => (item=net-tools)
ok: [k8s-controller-01] => (item=net-tools)
ok: [k8s-worker-01] => (item=net-tools)
ok: [k8s-controller-03] => (item=screen)
ok: [k8s-controller-02] => (item=screen)
ok: [k8s-worker-02] => (item=screen)
ok: [k8s-controller-01] => (item=screen)
ok: [k8s-worker-01] => (item=screen)
changed: [k8s-controller-03] => (item=strace)
changed: [k8s-controller-02] => (item=strace)
changed: [k8s-worker-01] => (item=strace)
changed: [k8s-worker-02] => (item=strace)
changed: [k8s-controller-01] => (item=strace)
changed: [k8s-controller-03] => (item=telnet)
changed: [k8s-controller-02] => (item=telnet)
changed: [k8s-worker-02] => (item=telnet)
changed: [k8s-worker-01] => (item=telnet)
changed: [k8s-controller-01] => (item=telnet)
ok: [k8s-controller-03] => (item=vim)
ok: [k8s-controller-02] => (item=vim)
ok: [k8s-worker-02] => (item=vim)
ok: [k8s-controller-01] => (item=vim)
ok: [k8s-worker-01] => (item=vim)
changed: [k8s-controller-03] => (item=gpg)
changed: [k8s-worker-01] => (item=gpg)
changed: [k8s-controller-01] => (item=gpg)
changed: [k8s-controller-02] => (item=gpg)
changed: [k8s-worker-02] => (item=gpg)
changed: [k8s-controller-03] => (item=rsync)
changed: [k8s-worker-01] => (item=rsync)
changed: [k8s-controller-01] => (item=rsync)
changed: [k8s-controller-03] => (item=arping)
changed: [k8s-controller-02] => (item=rsync)
changed: [k8s-worker-02] => (item=rsync)
changed: [k8s-worker-01] => (item=arping)
changed: [k8s-controller-01] => (item=arping)
changed: [k8s-controller-02] => (item=arping)
changed: [k8s-worker-02] => (item=arping)
changed: [k8s-controller-03] => (item=dnsutils)
changed: [k8s-worker-01] => (item=dnsutils)
changed: [k8s-controller-01] => (item=dnsutils)
changed: [k8s-controller-03] => (item=apt-transport-https)
changed: [k8s-controller-02] => (item=dnsutils)
ok: [k8s-controller-03] => (item=ca-certificates)
changed: [k8s-worker-01] => (item=apt-transport-https)
changed: [k8s-controller-01] => (item=apt-transport-https)
ok: [k8s-controller-03] => (item=curl)
ok: [k8s-worker-01] => (item=ca-certificates)
changed: [k8s-worker-02] => (item=dnsutils)
ok: [k8s-controller-01] => (item=ca-certificates)
ok: [k8s-controller-03] => (item=gnupg)
ok: [k8s-worker-01] => (item=curl)
changed: [k8s-controller-02] => (item=apt-transport-https)
ok: [k8s-controller-01] => (item=curl)
ok: [k8s-worker-01] => (item=gnupg)
ok: [k8s-controller-03] => (item=lsb-release)
ok: [k8s-controller-02] => (item=ca-certificates)
changed: [k8s-worker-02] => (item=apt-transport-https)
ok: [k8s-controller-01] => (item=gnupg)
ok: [k8s-worker-01] => (item=lsb-release)
ok: [k8s-controller-02] => (item=curl)
ok: [k8s-worker-02] => (item=ca-certificates)
ok: [k8s-controller-01] => (item=lsb-release)
ok: [k8s-controller-02] => (item=gnupg)
ok: [k8s-worker-02] => (item=curl)
changed: [k8s-controller-03] => (item=tree)
ok: [k8s-controller-02] => (item=lsb-release)
ok: [k8s-worker-02] => (item=gnupg)
changed: [k8s-worker-01] => (item=tree)
ok: [k8s-worker-02] => (item=lsb-release)
changed: [k8s-controller-01] => (item=tree)
changed: [k8s-controller-02] => (item=tree)
changed: [k8s-worker-03] => (item=htop)
changed: [k8s-worker-02] => (item=tree)
changed: [k8s-worker-03] => (item=lsof)
ok: [k8s-worker-03] => (item=net-tools)
ok: [k8s-worker-03] => (item=screen)
changed: [k8s-worker-03] => (item=strace)
changed: [k8s-worker-03] => (item=telnet)
ok: [k8s-worker-03] => (item=vim)
changed: [k8s-worker-03] => (item=gpg)
changed: [k8s-worker-03] => (item=rsync)
changed: [k8s-worker-03] => (item=arping)
changed: [k8s-worker-03] => (item=dnsutils)
changed: [k8s-worker-03] => (item=apt-transport-https)
ok: [k8s-worker-03] => (item=ca-certificates)
ok: [k8s-worker-03] => (item=curl)
ok: [k8s-worker-03] => (item=gnupg)
ok: [k8s-worker-03] => (item=lsb-release)
changed: [k8s-worker-03] => (item=tree)
TASK [common : packages | enable additional repos] ********************************************************************
changed: [k8s-controller-01]
changed: [k8s-worker-01]
changed: [k8s-controller-03]
changed: [k8s-worker-02]
changed: [k8s-controller-02]
changed: [k8s-worker-03]
TASK [common : auto-updates] ******************************************************************************************
included: /homelab/ansible/roles/common/tasks/auto-update-Debian.yml for k8s-controller-01, k8s-controller-02, k8s-controller-03, k8s-worker-01, k8s-worker-02, k8s-worker-03
TASK [common : auto-updates | install unattended-upgrades package] ****************************************************
ok: [k8s-worker-02]
ok: [k8s-controller-03]
ok: [k8s-worker-01]
ok: [k8s-controller-01]
ok: [k8s-controller-02]
ok: [k8s-worker-03]
TASK [common : auto-updates | configure /etc/apt/apt.conf.d/20auto-upgrades] ******************************************
changed: [k8s-controller-01]
changed: [k8s-worker-01]
changed: [k8s-controller-03]
changed: [k8s-controller-02]
changed: [k8s-worker-02]
changed: [k8s-worker-03]
TASK [common : auto-updates | configure /etc/apt/apt.conf.d/50unattended-upgrades] ************************************
changed: [k8s-controller-01]
changed: [k8s-controller-02]
changed: [k8s-worker-01]
changed: [k8s-worker-02]
changed: [k8s-controller-03]
changed: [k8s-worker-03]
TASK [common : auto-updates | start and enable unattended-upgrades service] *******************************************
ok: [k8s-controller-01]
ok: [k8s-worker-01]
ok: [k8s-controller-02]
ok: [k8s-controller-03]
ok: [k8s-worker-02]
ok: [k8s-worker-03]
TASK [common : users | install sudo package] **************************************************************************
ok: [k8s-controller-01]
ok: [k8s-worker-01]
ok: [k8s-controller-02]
ok: [k8s-controller-03]
ok: [k8s-worker-02]
ok: [k8s-worker-03]
TASK [common : users | create admin users] ****************************************************************************
changed: [k8s-controller-01] => (item=adminuser)
changed: [k8s-worker-01] => (item=adminuser)
changed: [k8s-controller-03] => (item=adminuser)
changed: [k8s-controller-02] => (item=adminuser)
changed: [k8s-worker-02] => (item=adminuser)
changed: [k8s-worker-03] => (item=adminuser)
TASK [common : users | configure etc/sudoers.d/20_admins_sudo] ********************************************************
changed: [k8s-controller-01]
changed: [k8s-worker-01]
changed: [k8s-controller-02]
changed: [k8s-worker-02]
changed: [k8s-controller-03]
changed: [k8s-worker-03]
RUNNING HANDLER [common : auto-updates | restart unattended-upgrades service] *****************************************
changed: [k8s-controller-01]
changed: [k8s-worker-01]
changed: [k8s-controller-03]
changed: [k8s-controller-02]
changed: [k8s-worker-02]
changed: [k8s-worker-03]
TASK [docker | set variables] *****************************************************************************************
ok: [k8s-controller-01] => (item=/homelab/ansible/roles/docker/vars/default.yml)
ok: [k8s-controller-02] => (item=/homelab/ansible/roles/docker/vars/default.yml)
ok: [k8s-controller-03] => (item=/homelab/ansible/roles/docker/vars/default.yml)
ok: [k8s-worker-01] => (item=/homelab/ansible/roles/docker/vars/default.yml)
ok: [k8s-worker-02] => (item=/homelab/ansible/roles/docker/vars/default.yml)
ok: [k8s-worker-03] => (item=/homelab/ansible/roles/docker/vars/default.yml)
TASK [docker] *********************************************************************************************************
included: /homelab/ansible/roles/docker/tasks/docker.yml for k8s-controller-01, k8s-controller-02, k8s-controller-03, k8s-worker-01, k8s-worker-02, k8s-worker-03
TASK [docker | install docker key] ************************************************************************************
changed: [k8s-controller-01]
changed: [k8s-worker-01]
changed: [k8s-controller-02]
changed: [k8s-worker-02]
changed: [k8s-controller-03]
changed: [k8s-worker-03]
TASK [docker | add docker repo] ***************************************************************************************
changed: [k8s-controller-03]
changed: [k8s-worker-01]
changed: [k8s-controller-01]
changed: [k8s-worker-02]
changed: [k8s-controller-02]
changed: [k8s-worker-03]
TASK [docker | install docker engine packages] ************************************************************************
changed: [k8s-controller-03] => (item=docker-ce)
ok: [k8s-controller-03] => (item=docker-ce-cli)
ok: [k8s-controller-03] => (item=containerd.io)
changed: [k8s-worker-01] => (item=docker-ce)
changed: [k8s-controller-01] => (item=docker-ce)
ok: [k8s-worker-01] => (item=docker-ce-cli)
changed: [k8s-worker-02] => (item=docker-ce)
changed: [k8s-controller-02] => (item=docker-ce)
ok: [k8s-controller-01] => (item=docker-ce-cli)
ok: [k8s-worker-02] => (item=docker-ce-cli)
ok: [k8s-controller-02] => (item=docker-ce-cli)
ok: [k8s-controller-01] => (item=containerd.io)
ok: [k8s-worker-01] => (item=containerd.io)
ok: [k8s-worker-02] => (item=containerd.io)
ok: [k8s-controller-02] => (item=containerd.io)
changed: [k8s-worker-03] => (item=docker-ce)
ok: [k8s-worker-03] => (item=docker-ce-cli)
ok: [k8s-worker-03] => (item=containerd.io)
TASK [docker | configure /etc/docker/daemon.json] *********************************************************************
changed: [k8s-controller-01]
changed: [k8s-worker-01]
changed: [k8s-worker-02]
changed: [k8s-controller-03]
changed: [k8s-controller-02]
changed: [k8s-worker-03]
TASK [docker | configure /etc/containerd/config.toml] *****************************************************************
changed: [k8s-controller-01]
changed: [k8s-worker-01]
changed: [k8s-controller-02]
changed: [k8s-controller-03]
changed: [k8s-worker-02]
changed: [k8s-worker-03]
TASK [docker | start and enable docker service] ***********************************************************************
ok: [k8s-controller-03]
ok: [k8s-controller-01]
ok: [k8s-worker-01]
ok: [k8s-controller-02]
ok: [k8s-worker-02]
ok: [k8s-worker-03]
TASK [docker | start and enable containerd service] *******************************************************************
ok: [k8s-controller-01]
ok: [k8s-worker-01]
ok: [k8s-controller-02]
ok: [k8s-worker-02]
ok: [k8s-controller-03]
ok: [k8s-worker-03]
RUNNING HANDLER [docker | restart docker] *****************************************************************************
changed: [k8s-worker-01]
changed: [k8s-controller-01]
changed: [k8s-controller-03]
changed: [k8s-worker-02]
changed: [k8s-controller-02]
changed: [k8s-worker-03]
RUNNING HANDLER [docker | restart containerd] *************************************************************************
changed: [k8s-controller-01]
changed: [k8s-worker-01]
changed: [k8s-controller-02]
changed: [k8s-worker-02]
changed: [k8s-controller-03]
changed: [k8s-worker-03]
TASK [kubernetes_common : kubernetes-common | set variables] **********************************************************
ok: [k8s-controller-01] => (item=/homelab/ansible/roles/kubernetes_common/vars/default.yml)
ok: [k8s-controller-02] => (item=/homelab/ansible/roles/kubernetes_common/vars/default.yml)
ok: [k8s-controller-03] => (item=/homelab/ansible/roles/kubernetes_common/vars/default.yml)
ok: [k8s-worker-01] => (item=/homelab/ansible/roles/kubernetes_common/vars/default.yml)
ok: [k8s-worker-02] => (item=/homelab/ansible/roles/kubernetes_common/vars/default.yml)
ok: [k8s-worker-03] => (item=/homelab/ansible/roles/kubernetes_common/vars/default.yml)
TASK [kubernetes_common : swap | disable swap] ************************************************************************
skipping: [k8s-controller-01]
skipping: [k8s-controller-02]
skipping: [k8s-controller-03]
skipping: [k8s-worker-01]
skipping: [k8s-worker-02]
skipping: [k8s-worker-03]
TASK [kubernetes_common : swap | disable swap on system start] ********************************************************
ok: [k8s-controller-03] => (item=swap)
ok: [k8s-controller-01] => (item=swap)
ok: [k8s-worker-01] => (item=swap)
ok: [k8s-worker-02] => (item=swap)
ok: [k8s-controller-02] => (item=swap)
ok: [k8s-controller-01] => (item=none)
ok: [k8s-worker-01] => (item=none)
ok: [k8s-worker-02] => (item=none)
ok: [k8s-controller-03] => (item=none)
ok: [k8s-controller-02] => (item=none)
ok: [k8s-worker-03] => (item=swap)
ok: [k8s-worker-03] => (item=none)
TASK [kubernetes_common : network | configure /etc/modules-load.d/k8s.conf] *******************************************
changed: [k8s-controller-01]
changed: [k8s-worker-01]
changed: [k8s-controller-02]
changed: [k8s-worker-02]
changed: [k8s-controller-03]
changed: [k8s-worker-03]
TASK [kubernetes_common : network | configure /etc/sysctl.d/k8s.conf] *************************************************
changed: [k8s-controller-01]
changed: [k8s-worker-01]
changed: [k8s-controller-02]
changed: [k8s-controller-03]
changed: [k8s-worker-02]
changed: [k8s-worker-03]
TASK [kubernetes_common : network | allow kubernetes related tcp ports inbound from all kubernetes hosts] *************
changed: [k8s-controller-01] => (item=['179', '10.1.1.41'])
changed: [k8s-worker-01] => (item=['179', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['179', '10.1.1.41'])
changed: [k8s-worker-02] => (item=['179', '10.1.1.41'])
changed: [k8s-controller-03] => (item=['179', '10.1.1.41'])
changed: [k8s-controller-01] => (item=['179', '10.1.1.42'])
changed: [k8s-worker-01] => (item=['179', '10.1.1.42'])
changed: [k8s-controller-02] => (item=['179', '10.1.1.42'])
changed: [k8s-worker-02] => (item=['179', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['179', '10.1.1.42'])
changed: [k8s-controller-01] => (item=['179', '10.1.1.43'])
changed: [k8s-worker-01] => (item=['179', '10.1.1.43'])
changed: [k8s-controller-03] => (item=['179', '10.1.1.43'])
changed: [k8s-controller-02] => (item=['179', '10.1.1.43'])
changed: [k8s-worker-02] => (item=['179', '10.1.1.43'])
changed: [k8s-controller-03] => (item=['179', '10.1.1.51'])
changed: [k8s-worker-02] => (item=['179', '10.1.1.51'])
changed: [k8s-controller-02] => (item=['179', '10.1.1.51'])
changed: [k8s-worker-01] => (item=['179', '10.1.1.51'])
changed: [k8s-controller-01] => (item=['179', '10.1.1.51'])
changed: [k8s-controller-03] => (item=['179', '10.1.1.52'])
changed: [k8s-worker-02] => (item=['179', '10.1.1.52'])
changed: [k8s-controller-02] => (item=['179', '10.1.1.52'])
changed: [k8s-worker-01] => (item=['179', '10.1.1.52'])
changed: [k8s-controller-01] => (item=['179', '10.1.1.52'])
changed: [k8s-controller-02] => (item=['179', '10.1.1.53'])
changed: [k8s-worker-02] => (item=['179', '10.1.1.53'])
changed: [k8s-controller-01] => (item=['179', '10.1.1.53'])
changed: [k8s-worker-01] => (item=['179', '10.1.1.53'])
changed: [k8s-controller-03] => (item=['179', '10.1.1.53'])
changed: [k8s-worker-02] => (item=['5473', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['5473', '10.1.1.41'])
changed: [k8s-worker-01] => (item=['5473', '10.1.1.41'])
changed: [k8s-controller-01] => (item=['5473', '10.1.1.41'])
changed: [k8s-controller-03] => (item=['5473', '10.1.1.41'])
changed: [k8s-controller-01] => (item=['5473', '10.1.1.42'])
changed: [k8s-worker-01] => (item=['5473', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['5473', '10.1.1.42'])
changed: [k8s-controller-02] => (item=['5473', '10.1.1.42'])
changed: [k8s-worker-02] => (item=['5473', '10.1.1.42'])
changed: [k8s-worker-01] => (item=['5473', '10.1.1.43'])
changed: [k8s-controller-01] => (item=['5473', '10.1.1.43'])
changed: [k8s-controller-03] => (item=['5473', '10.1.1.43'])
changed: [k8s-worker-02] => (item=['5473', '10.1.1.43'])
changed: [k8s-controller-02] => (item=['5473', '10.1.1.43'])
changed: [k8s-worker-01] => (item=['5473', '10.1.1.51'])
changed: [k8s-controller-01] => (item=['5473', '10.1.1.51'])
changed: [k8s-controller-03] => (item=['5473', '10.1.1.51'])
changed: [k8s-controller-02] => (item=['5473', '10.1.1.51'])
changed: [k8s-worker-02] => (item=['5473', '10.1.1.51'])
changed: [k8s-controller-01] => (item=['5473', '10.1.1.52'])
changed: [k8s-worker-01] => (item=['5473', '10.1.1.52'])
changed: [k8s-controller-02] => (item=['5473', '10.1.1.52'])
changed: [k8s-worker-02] => (item=['5473', '10.1.1.52'])
changed: [k8s-controller-03] => (item=['5473', '10.1.1.52'])
changed: [k8s-worker-01] => (item=['5473', '10.1.1.53'])
changed: [k8s-controller-01] => (item=['5473', '10.1.1.53'])
changed: [k8s-controller-02] => (item=['5473', '10.1.1.53'])
changed: [k8s-worker-02] => (item=['5473', '10.1.1.53'])
changed: [k8s-controller-03] => (item=['5473', '10.1.1.53'])
changed: [k8s-controller-01] => (item=['9099', '10.1.1.41'])
changed: [k8s-worker-01] => (item=['9099', '10.1.1.41'])
changed: [k8s-worker-02] => (item=['9099', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['9099', '10.1.1.41'])
changed: [k8s-controller-03] => (item=['9099', '10.1.1.41'])
changed: [k8s-controller-01] => (item=['9099', '10.1.1.42'])
changed: [k8s-worker-01] => (item=['9099', '10.1.1.42'])
changed: [k8s-worker-02] => (item=['9099', '10.1.1.42'])
changed: [k8s-controller-02] => (item=['9099', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['9099', '10.1.1.42'])
changed: [k8s-worker-01] => (item=['9099', '10.1.1.43'])
changed: [k8s-controller-01] => (item=['9099', '10.1.1.43'])
changed: [k8s-worker-02] => (item=['9099', '10.1.1.43'])
changed: [k8s-controller-02] => (item=['9099', '10.1.1.43'])
changed: [k8s-controller-03] => (item=['9099', '10.1.1.43'])
changed: [k8s-worker-01] => (item=['9099', '10.1.1.51'])
changed: [k8s-controller-01] => (item=['9099', '10.1.1.51'])
changed: [k8s-controller-02] => (item=['9099', '10.1.1.51'])
changed: [k8s-worker-02] => (item=['9099', '10.1.1.51'])
changed: [k8s-controller-03] => (item=['9099', '10.1.1.51'])
changed: [k8s-worker-01] => (item=['9099', '10.1.1.52'])
changed: [k8s-controller-01] => (item=['9099', '10.1.1.52'])
changed: [k8s-controller-03] => (item=['9099', '10.1.1.52'])
changed: [k8s-worker-02] => (item=['9099', '10.1.1.52'])
changed: [k8s-controller-02] => (item=['9099', '10.1.1.52'])
changed: [k8s-worker-01] => (item=['9099', '10.1.1.53'])
changed: [k8s-controller-01] => (item=['9099', '10.1.1.53'])
changed: [k8s-controller-03] => (item=['9099', '10.1.1.53'])
changed: [k8s-controller-02] => (item=['9099', '10.1.1.53'])
changed: [k8s-worker-02] => (item=['9099', '10.1.1.53'])
changed: [k8s-worker-03] => (item=['179', '10.1.1.41'])
changed: [k8s-worker-03] => (item=['179', '10.1.1.42'])
changed: [k8s-worker-03] => (item=['179', '10.1.1.43'])
changed: [k8s-worker-03] => (item=['179', '10.1.1.51'])
changed: [k8s-worker-03] => (item=['179', '10.1.1.52'])
changed: [k8s-worker-03] => (item=['179', '10.1.1.53'])
changed: [k8s-worker-03] => (item=['5473', '10.1.1.41'])
changed: [k8s-worker-03] => (item=['5473', '10.1.1.42'])
changed: [k8s-worker-03] => (item=['5473', '10.1.1.43'])
changed: [k8s-worker-03] => (item=['5473', '10.1.1.51'])
changed: [k8s-worker-03] => (item=['5473', '10.1.1.52'])
changed: [k8s-worker-03] => (item=['5473', '10.1.1.53'])
changed: [k8s-worker-03] => (item=['9099', '10.1.1.41'])
changed: [k8s-worker-03] => (item=['9099', '10.1.1.42'])
changed: [k8s-worker-03] => (item=['9099', '10.1.1.43'])
changed: [k8s-worker-03] => (item=['9099', '10.1.1.51'])
changed: [k8s-worker-03] => (item=['9099', '10.1.1.52'])
changed: [k8s-worker-03] => (item=['9099', '10.1.1.53'])
TASK [kubernetes_common : network | allow kubernetes related udp ports inbound from all kubernetes hosts] *************
changed: [k8s-controller-01] => (item=['4789', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['4789', '10.1.1.41'])
changed: [k8s-worker-01] => (item=['4789', '10.1.1.41'])
changed: [k8s-worker-02] => (item=['4789', '10.1.1.41'])
changed: [k8s-controller-03] => (item=['4789', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['4789', '10.1.1.42'])
changed: [k8s-worker-02] => (item=['4789', '10.1.1.42'])
changed: [k8s-worker-01] => (item=['4789', '10.1.1.42'])
changed: [k8s-controller-01] => (item=['4789', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['4789', '10.1.1.42'])
changed: [k8s-controller-02] => (item=['4789', '10.1.1.43'])
changed: [k8s-worker-02] => (item=['4789', '10.1.1.43'])
changed: [k8s-controller-01] => (item=['4789', '10.1.1.43'])
changed: [k8s-worker-01] => (item=['4789', '10.1.1.43'])
changed: [k8s-controller-03] => (item=['4789', '10.1.1.43'])
changed: [k8s-controller-02] => (item=['4789', '10.1.1.51'])
changed: [k8s-worker-02] => (item=['4789', '10.1.1.51'])
changed: [k8s-worker-01] => (item=['4789', '10.1.1.51'])
changed: [k8s-controller-01] => (item=['4789', '10.1.1.51'])
changed: [k8s-controller-03] => (item=['4789', '10.1.1.51'])
changed: [k8s-controller-02] => (item=['4789', '10.1.1.52'])
changed: [k8s-controller-01] => (item=['4789', '10.1.1.52'])
changed: [k8s-worker-01] => (item=['4789', '10.1.1.52'])
changed: [k8s-worker-02] => (item=['4789', '10.1.1.52'])
changed: [k8s-controller-03] => (item=['4789', '10.1.1.52'])
changed: [k8s-worker-01] => (item=['4789', '10.1.1.53'])
changed: [k8s-controller-02] => (item=['4789', '10.1.1.53'])
changed: [k8s-worker-02] => (item=['4789', '10.1.1.53'])
changed: [k8s-controller-01] => (item=['4789', '10.1.1.53'])
changed: [k8s-controller-03] => (item=['4789', '10.1.1.53'])
changed: [k8s-worker-03] => (item=['4789', '10.1.1.41'])
changed: [k8s-worker-03] => (item=['4789', '10.1.1.42'])
changed: [k8s-worker-03] => (item=['4789', '10.1.1.43'])
changed: [k8s-worker-03] => (item=['4789', '10.1.1.51'])
changed: [k8s-worker-03] => (item=['4789', '10.1.1.52'])
changed: [k8s-worker-03] => (item=['4789', '10.1.1.53'])
TASK [kubernetes_common : packages | install kubernetes key] **********************************************************
changed: [k8s-controller-01]
changed: [k8s-worker-01]
changed: [k8s-worker-02]
changed: [k8s-controller-02]
changed: [k8s-controller-03]
changed: [k8s-worker-03]
TASK [kubernetes_common : packages | add kubernetes repo] *************************************************************
changed: [k8s-worker-01]
changed: [k8s-controller-03]
changed: [k8s-controller-01]
changed: [k8s-controller-02]
changed: [k8s-worker-02]
changed: [k8s-worker-03]
TASK [kubernetes_common : packages | install kubernetes packages] *****************************************************
changed: [k8s-worker-01] => (item=kubelet)
changed: [k8s-controller-03] => (item=kubelet)
changed: [k8s-worker-02] => (item=kubelet)
changed: [k8s-controller-02] => (item=kubelet)
changed: [k8s-controller-01] => (item=kubelet)
changed: [k8s-worker-01] => (item=kubeadm)
ok: [k8s-worker-01] => (item=kubectl)
changed: [k8s-controller-03] => (item=kubeadm)
ok: [k8s-controller-03] => (item=kubectl)
changed: [k8s-worker-02] => (item=kubeadm)
ok: [k8s-worker-02] => (item=kubectl)
changed: [k8s-controller-02] => (item=kubeadm)
ok: [k8s-controller-02] => (item=kubectl)
changed: [k8s-controller-01] => (item=kubeadm)
ok: [k8s-controller-01] => (item=kubectl)
changed: [k8s-worker-03] => (item=kubelet)
changed: [k8s-worker-03] => (item=kubeadm)
ok: [k8s-worker-03] => (item=kubectl)
TASK [kubernetes_common : packages | prevent kubernetes from being upgraded] ******************************************
changed: [k8s-controller-01] => (item=kubelet)
changed: [k8s-worker-01] => (item=kubelet)
changed: [k8s-controller-03] => (item=kubelet)
changed: [k8s-controller-02] => (item=kubelet)
changed: [k8s-worker-02] => (item=kubelet)
changed: [k8s-controller-03] => (item=kubeadm)
changed: [k8s-worker-01] => (item=kubeadm)
changed: [k8s-controller-02] => (item=kubeadm)
changed: [k8s-worker-02] => (item=kubeadm)
changed: [k8s-controller-01] => (item=kubeadm)
changed: [k8s-worker-02] => (item=kubectl)
changed: [k8s-controller-02] => (item=kubectl)
changed: [k8s-controller-01] => (item=kubectl)
changed: [k8s-controller-03] => (item=kubectl)
changed: [k8s-worker-01] => (item=kubectl)
changed: [k8s-worker-03] => (item=kubelet)
changed: [k8s-worker-03] => (item=kubeadm)
changed: [k8s-worker-03] => (item=kubectl)
TASK [kubernetes_common : directories | manage kubernetes directories] ************************************************
ok: [k8s-worker-01] => (item=/etc/kubernetes/)
ok: [k8s-controller-01] => (item=/etc/kubernetes/)
ok: [k8s-controller-02] => (item=/etc/kubernetes/)
ok: [k8s-worker-02] => (item=/etc/kubernetes/)
ok: [k8s-controller-03] => (item=/etc/kubernetes/)
changed: [k8s-worker-01] => (item=/etc/kubernetes/pki/)
changed: [k8s-controller-01] => (item=/etc/kubernetes/pki/)
changed: [k8s-controller-03] => (item=/etc/kubernetes/pki/)
changed: [k8s-worker-02] => (item=/etc/kubernetes/pki/)
changed: [k8s-controller-02] => (item=/etc/kubernetes/pki/)
ok: [k8s-worker-03] => (item=/etc/kubernetes/)
changed: [k8s-worker-03] => (item=/etc/kubernetes/pki/)
TASK [kubernetes_common : pki | configure /etc/kubernetes/kubelet.conf] ***********************************************
changed: [k8s-controller-01]
changed: [k8s-controller-02]
changed: [k8s-worker-01]
changed: [k8s-controller-03]
changed: [k8s-worker-02]
changed: [k8s-worker-03]
TASK [kubernetes_common : pki | configure /etc/kubernetes/pki/ca.crt] *************************************************
changed: [k8s-controller-01]
changed: [k8s-worker-01]
changed: [k8s-controller-02]
changed: [k8s-worker-02]
changed: [k8s-controller-03]
changed: [k8s-worker-03]
PLAY [k8s_controllers] ************************************************************************************************
TASK [Gathering Facts] ************************************************************************************************
ok: [k8s-controller-02]
ok: [k8s-controller-01]
ok: [k8s-controller-03]
TASK [pacemaker | set variables] **************************************************************************************
ok: [k8s-controller-01] => (item=/homelab/ansible/roles/pacemaker/vars/default.yml)
ok: [k8s-controller-02] => (item=/homelab/ansible/roles/pacemaker/vars/default.yml)
ok: [k8s-controller-03] => (item=/homelab/ansible/roles/pacemaker/vars/default.yml)
TASK [network | allow pacemaker tcp inbound from pacemaker servers] ***************************************************
changed: [k8s-controller-01] => (item=['2224', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['2224', '10.1.1.41'])
changed: [k8s-controller-03] => (item=['2224', '10.1.1.41'])
changed: [k8s-controller-01] => (item=['2224', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['2224', '10.1.1.42'])
changed: [k8s-controller-02] => (item=['2224', '10.1.1.42'])
changed: [k8s-controller-01] => (item=['2224', '10.1.1.43'])
changed: [k8s-controller-02] => (item=['2224', '10.1.1.43'])
changed: [k8s-controller-03] => (item=['2224', '10.1.1.43'])
changed: [k8s-controller-01] => (item=['3121', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['3121', '10.1.1.41'])
changed: [k8s-controller-03] => (item=['3121', '10.1.1.41'])
changed: [k8s-controller-01] => (item=['3121', '10.1.1.42'])
changed: [k8s-controller-02] => (item=['3121', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['3121', '10.1.1.42'])
changed: [k8s-controller-01] => (item=['3121', '10.1.1.43'])
changed: [k8s-controller-02] => (item=['3121', '10.1.1.43'])
changed: [k8s-controller-03] => (item=['3121', '10.1.1.43'])
changed: [k8s-controller-01] => (item=['21064', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['21064', '10.1.1.41'])
changed: [k8s-controller-03] => (item=['21064', '10.1.1.41'])
changed: [k8s-controller-01] => (item=['21064', '10.1.1.42'])
changed: [k8s-controller-02] => (item=['21064', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['21064', '10.1.1.42'])
changed: [k8s-controller-01] => (item=['21064', '10.1.1.43'])
changed: [k8s-controller-02] => (item=['21064', '10.1.1.43'])
changed: [k8s-controller-03] => (item=['21064', '10.1.1.43'])
TASK [network | allow pacemaker udp inbound from pacemaker servers] ***************************************************
changed: [k8s-controller-01] => (item=['5405', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['5405', '10.1.1.41'])
changed: [k8s-controller-03] => (item=['5405', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['5405', '10.1.1.42'])
changed: [k8s-controller-01] => (item=['5405', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['5405', '10.1.1.42'])
changed: [k8s-controller-02] => (item=['5405', '10.1.1.43'])
changed: [k8s-controller-01] => (item=['5405', '10.1.1.43'])
changed: [k8s-controller-03] => (item=['5405', '10.1.1.43'])
TASK [packages | install pacemaker packages] **************************************************************************
changed: [k8s-controller-01] => (item=pacemaker)
ok: [k8s-controller-01] => (item=corosync)
changed: [k8s-controller-03] => (item=pacemaker)
ok: [k8s-controller-03] => (item=corosync)
changed: [k8s-controller-02] => (item=pacemaker)
ok: [k8s-controller-02] => (item=corosync)
changed: [k8s-controller-01] => (item=pcs)
changed: [k8s-controller-01] => (item=crmsh)
changed: [k8s-controller-03] => (item=pcs)
changed: [k8s-controller-02] => (item=pcs)
changed: [k8s-controller-03] => (item=crmsh)
changed: [k8s-controller-02] => (item=crmsh)
TASK [pacemaker : services | start and enable services] ***************************************************************
ok: [k8s-controller-01] => (item=pacemaker)
ok: [k8s-controller-03] => (item=pacemaker)
ok: [k8s-controller-02] => (item=pacemaker)
ok: [k8s-controller-01] => (item=corosync)
ok: [k8s-controller-02] => (item=corosync)
ok: [k8s-controller-03] => (item=corosync)
ok: [k8s-controller-01] => (item=pcsd)
ok: [k8s-controller-02] => (item=pcsd)
ok: [k8s-controller-03] => (item=pcsd)
TASK [pacemaker : corosync | configure /etc/corosync/authkey] *********************************************************
changed: [k8s-controller-01]
changed: [k8s-controller-02]
changed: [k8s-controller-03]
TASK [pacemaker : corosync | configure /etc/corosync/corosync.conf] ***************************************************
changed: [k8s-controller-01]
changed: [k8s-controller-03]
changed: [k8s-controller-02]
[WARNING]: flush_handlers task does not support when conditional
RUNNING HANDLER [pacemaker : corosync | restart corosync] *************************************************************
changed: [k8s-controller-03]
changed: [k8s-controller-01]
changed: [k8s-controller-02]
TASK [pacemaker : settings | capture cluster properties] **************************************************************
ok: [k8s-controller-01]
TASK [pacemaker : settings | disable stonith] *************************************************************************
changed: [k8s-controller-01]
TASK [kubernetes_controller : kubernetes-controller | set variables] **************************************************
ok: [k8s-controller-01] => (item=/homelab/ansible/roles/kubernetes_controller/vars/default.yml)
ok: [k8s-controller-02] => (item=/homelab/ansible/roles/kubernetes_controller/vars/default.yml)
ok: [k8s-controller-03] => (item=/homelab/ansible/roles/kubernetes_controller/vars/default.yml)
TASK [kubernetes_controller : network | allow kubernetes ports inbound from kubernetes controllers] *******************
changed: [k8s-controller-01] => (item=['2379', '10.1.1.41'])
changed: [k8s-controller-03] => (item=['2379', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['2379', '10.1.1.41'])
changed: [k8s-controller-01] => (item=['2379', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['2379', '10.1.1.42'])
changed: [k8s-controller-02] => (item=['2379', '10.1.1.42'])
changed: [k8s-controller-01] => (item=['2379', '10.1.1.43'])
changed: [k8s-controller-03] => (item=['2379', '10.1.1.43'])
changed: [k8s-controller-02] => (item=['2379', '10.1.1.43'])
changed: [k8s-controller-01] => (item=['2380', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['2380', '10.1.1.41'])
changed: [k8s-controller-03] => (item=['2380', '10.1.1.41'])
changed: [k8s-controller-01] => (item=['2380', '10.1.1.42'])
changed: [k8s-controller-02] => (item=['2380', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['2380', '10.1.1.42'])
changed: [k8s-controller-01] => (item=['2380', '10.1.1.43'])
changed: [k8s-controller-02] => (item=['2380', '10.1.1.43'])
changed: [k8s-controller-03] => (item=['2380', '10.1.1.43'])
changed: [k8s-controller-01] => (item=['10250', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['10250', '10.1.1.41'])
changed: [k8s-controller-03] => (item=['10250', '10.1.1.41'])
changed: [k8s-controller-01] => (item=['10250', '10.1.1.42'])
changed: [k8s-controller-02] => (item=['10250', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['10250', '10.1.1.42'])
changed: [k8s-controller-01] => (item=['10250', '10.1.1.43'])
changed: [k8s-controller-02] => (item=['10250', '10.1.1.43'])
changed: [k8s-controller-03] => (item=['10250', '10.1.1.43'])
changed: [k8s-controller-01] => (item=['10251', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['10251', '10.1.1.41'])
changed: [k8s-controller-03] => (item=['10251', '10.1.1.41'])
changed: [k8s-controller-01] => (item=['10251', '10.1.1.42'])
changed: [k8s-controller-02] => (item=['10251', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['10251', '10.1.1.42'])
changed: [k8s-controller-01] => (item=['10251', '10.1.1.43'])
changed: [k8s-controller-02] => (item=['10251', '10.1.1.43'])
changed: [k8s-controller-03] => (item=['10251', '10.1.1.43'])
changed: [k8s-controller-01] => (item=['10252', '10.1.1.41'])
changed: [k8s-controller-02] => (item=['10252', '10.1.1.41'])
changed: [k8s-controller-03] => (item=['10252', '10.1.1.41'])
changed: [k8s-controller-01] => (item=['10252', '10.1.1.42'])
changed: [k8s-controller-01] => (item=['10252', '10.1.1.43'])
changed: [k8s-controller-02] => (item=['10252', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['10252', '10.1.1.42'])
changed: [k8s-controller-03] => (item=['10252', '10.1.1.43'])
changed: [k8s-controller-02] => (item=['10252', '10.1.1.43'])
TASK [kubernetes_controller : network | allow kubernetes api inbound from kubernetes servers] *************************
changed: [k8s-controller-01] => (item=10.1.1.41)
changed: [k8s-controller-03] => (item=10.1.1.41)
changed: [k8s-controller-02] => (item=10.1.1.41)
changed: [k8s-controller-01] => (item=10.1.1.42)
changed: [k8s-controller-03] => (item=10.1.1.42)
changed: [k8s-controller-02] => (item=10.1.1.42)
changed: [k8s-controller-01] => (item=10.1.1.43)
changed: [k8s-controller-03] => (item=10.1.1.43)
changed: [k8s-controller-02] => (item=10.1.1.43)
changed: [k8s-controller-01] => (item=10.1.1.51)
changed: [k8s-controller-03] => (item=10.1.1.51)
changed: [k8s-controller-02] => (item=10.1.1.51)
changed: [k8s-controller-01] => (item=10.1.1.52)
changed: [k8s-controller-03] => (item=10.1.1.52)
changed: [k8s-controller-02] => (item=10.1.1.52)
changed: [k8s-controller-01] => (item=10.1.1.53)
changed: [k8s-controller-03] => (item=10.1.1.53)
changed: [k8s-controller-02] => (item=10.1.1.53)
TASK [kubernetes_controller : network | allow kubernetes api inbound from permitted clients] **************************
changed: [k8s-controller-01] => (item=10.1.3.100)
changed: [k8s-controller-02] => (item=10.1.3.100)
changed: [k8s-controller-03] => (item=10.1.3.100)
TASK [kubernetes_controller : pacemaker | capture configured resources] ***********************************************
ok: [k8s-controller-01]
TASK [kubernetes_controller : pacemaker | create kubernetes-ip resource] **********************************************
changed: [k8s-controller-01] => (item={'resource_id': 'kubernetes-ip', 'action': 'create', 'provider': 'ocf:heartbeat:IPaddr2', 'options': ['ip=10.1.1.150', 'cidr_netmask=24', 'nic=ens3'], 'op': 'monitor', 'op_options': ['interval=30s']})
RUNNING HANDLER [kubernetes_controller : pacemaker | pause to allow floating ip address to come online] ***************
Pausing for 30 seconds
(ctrl+C then 'C' = continue early, ctrl+C then 'A' = abort)
ok: [k8s-controller-01]
TASK [kubernetes_controller : pacemaker | refresh ip address facts] ***************************************************
ok: [k8s-controller-03]
ok: [k8s-controller-01]
ok: [k8s-controller-02]
TASK [kubernetes_controller : directories | manage kubernetes directories] ********************************************
changed: [k8s-controller-01] => (item=/etc/kubernetes/pki/etcd/)
changed: [k8s-controller-03] => (item=/etc/kubernetes/pki/etcd/)
changed: [k8s-controller-02] => (item=/etc/kubernetes/pki/etcd/)
changed: [k8s-controller-02] => (item=/etc/kubernetes/secrets/)
changed: [k8s-controller-01] => (item=/etc/kubernetes/secrets/)
changed: [k8s-controller-03] => (item=/etc/kubernetes/secrets/)
changed: [k8s-controller-01] => (item=/root/.kube/)
changed: [k8s-controller-02] => (item=/root/.kube/)
changed: [k8s-controller-03] => (item=/root/.kube/)
TASK [kubernetes_controller : pki | configure /root/.kube/config] *****************************************************
changed: [k8s-controller-01]
changed: [k8s-controller-03]
changed: [k8s-controller-02]
TASK [kubernetes_controller : pki | configure /etc/kubernetes/.conf] ****************************************
changed: [k8s-controller-01] => (item=admin)
changed: [k8s-controller-02] => (item=admin)
changed: [k8s-controller-03] => (item=admin)
changed: [k8s-controller-01] => (item=controller-manager)
changed: [k8s-controller-02] => (item=controller-manager)
changed: [k8s-controller-03] => (item=controller-manager)
changed: [k8s-controller-01] => (item=scheduler)
changed: [k8s-controller-03] => (item=scheduler)
changed: [k8s-controller-02] => (item=scheduler)
TASK [kubernetes_controller : pki | configure /etc/kubernetes/pki/.crt] *************************************
changed: [k8s-controller-01] => (item=front-proxy-ca)
changed: [k8s-controller-03] => (item=front-proxy-ca)
changed: [k8s-controller-02] => (item=front-proxy-ca)
changed: [k8s-controller-01] => (item=apiserver-etcd-client)
changed: [k8s-controller-03] => (item=apiserver-etcd-client)
changed: [k8s-controller-02] => (item=apiserver-etcd-client)
changed: [k8s-controller-03] => (item=apiserver)
changed: [k8s-controller-01] => (item=apiserver)
changed: [k8s-controller-02] => (item=apiserver)
changed: [k8s-controller-01] => (item=apiserver-kubelet-client)
changed: [k8s-controller-03] => (item=apiserver-kubelet-client)
changed: [k8s-controller-02] => (item=apiserver-kubelet-client)
changed: [k8s-controller-01] => (item=front-proxy-client)
changed: [k8s-controller-03] => (item=front-proxy-client)
changed: [k8s-controller-02] => (item=front-proxy-client)
TASK [kubernetes_controller : pki | configure /etc/kubernetes/pki/.key] *************************************
changed: [k8s-controller-01] => (item=apiserver-etcd-client)
changed: [k8s-controller-02] => (item=apiserver-etcd-client)
changed: [k8s-controller-03] => (item=apiserver-etcd-client)
changed: [k8s-controller-01] => (item=apiserver)
changed: [k8s-controller-03] => (item=apiserver)
changed: [k8s-controller-02] => (item=apiserver)
changed: [k8s-controller-01] => (item=apiserver-kubelet-client)
changed: [k8s-controller-03] => (item=apiserver-kubelet-client)
changed: [k8s-controller-02] => (item=apiserver-kubelet-client)
changed: [k8s-controller-01] => (item=front-proxy-client)
changed: [k8s-controller-03] => (item=front-proxy-client)
changed: [k8s-controller-02] => (item=front-proxy-client)
TASK [kubernetes_controller : pki | configure /etc/kubernetes/pki/etcd/.crt] ********************************
changed: [k8s-controller-01] => (item=ca)
changed: [k8s-controller-02] => (item=ca)
changed: [k8s-controller-03] => (item=ca)
changed: [k8s-controller-01] => (item=healthcheck-client)
changed: [k8s-controller-02] => (item=healthcheck-client)
changed: [k8s-controller-03] => (item=healthcheck-client)
TASK [kubernetes_controller : pki | configure /etc/kubernetes/pki/etcd/.key] ********************************
changed: [k8s-controller-02] => (item=healthcheck-client)
changed: [k8s-controller-01] => (item=healthcheck-client)
changed: [k8s-controller-03] => (item=healthcheck-client)
TASK [kubernetes_controller : pki | configure /etc/kubernetes/pki/etcd/.crt] ********************************
changed: [k8s-controller-01] => (item=peer)
changed: [k8s-controller-03] => (item=peer)
changed: [k8s-controller-02] => (item=peer)
changed: [k8s-controller-01] => (item=server)
changed: [k8s-controller-02] => (item=server)
changed: [k8s-controller-03] => (item=server)
TASK [kubernetes_controller : pki | configure /etc/kubernetes/pki/etcd/.key] ********************************
changed: [k8s-controller-01] => (item=peer)
changed: [k8s-controller-03] => (item=peer)
changed: [k8s-controller-02] => (item=peer)
changed: [k8s-controller-01] => (item=server)
changed: [k8s-controller-03] => (item=server)
changed: [k8s-controller-02] => (item=server)
TASK [kubernetes_controller : pki | configure /etc/kubernetes/pki/sa.] **************************************
changed: [k8s-controller-01] => (item=key)
changed: [k8s-controller-02] => (item=key)
changed: [k8s-controller-03] => (item=key)
changed: [k8s-controller-01] => (item=pub)
changed: [k8s-controller-02] => (item=pub)
changed: [k8s-controller-03] => (item=pub)
TASK [kubernetes_controller : kubeadm | kubeadm init] *****************************************************************
skipping: [k8s-controller-02]
skipping: [k8s-controller-03]
changed: [k8s-controller-01]
TASK [kubernetes_controller : kubeadm | create join token] ************************************************************
skipping: [k8s-controller-02]
skipping: [k8s-controller-03]
changed: [k8s-controller-01]
TASK [kubernetes_controller : kubeadm | store join token] *************************************************************
changed: [k8s-controller-01]
TASK [kubernetes_controller : kubeadm | join controllers] *************************************************************
skipping: [k8s-controller-01]
changed: [k8s-controller-02]
changed: [k8s-controller-03]
TASK [kubernetes_controller : encryption | configure /etc/kubernetes/secrets/encryption-config.yaml] ******************
changed: [k8s-controller-03]
changed: [k8s-controller-02]
changed: [k8s-controller-01]
TASK [kubernetes_controller : encryption | configure /etc/kubernetes/manifests/kube-apiserver.yaml] *******************
changed: [k8s-controller-02]
changed: [k8s-controller-01]
changed: [k8s-controller-03]
RUNNING HANDLER [kubernetes_controller : encryption | pause to allow kube-apiserver to redeploy] **********************
Pausing for 60 seconds
(ctrl+C then 'C' = continue early, ctrl+C then 'A' = abort)
ok: [k8s-controller-02]
TASK [kubernetes_controller : helm | download archived helm binary] ***************************************************
changed: [k8s-controller-03]
changed: [k8s-controller-02]
changed: [k8s-controller-01]
TASK [kubernetes_controller : helm | extract helm binary] *************************************************************
changed: [k8s-controller-02]
changed: [k8s-controller-03]
changed: [k8s-controller-01]
TASK [kubernetes_controller : argocd | download argocd binary] ********************************************************
changed: [k8s-controller-01]
changed: [k8s-controller-03]
changed: [k8s-controller-02]
TASK [kubernetes_controller : kubeseal | download archived kubeseal binary] *******************************************
changed: [k8s-controller-02]
changed: [k8s-controller-03]
changed: [k8s-controller-01]
TASK [kubernetes_controller : kubeseal | extract kubeseal binary] *****************************************************
changed: [k8s-controller-01]
changed: [k8s-controller-02]
changed: [k8s-controller-03]
TASK [kubernetes_controller : git-repo | checkout git-repo] ***********************************************************
changed: [k8s-controller-01]
changed: [k8s-controller-02]
changed: [k8s-controller-03]
TASK [kubernetes_controller : calico | install calico] ****************************************************************
changed: [k8s-controller-01]
PLAY [k8s_workers] ****************************************************************************************************
TASK [Gathering Facts] ************************************************************************************************
ok: [k8s-worker-02]
ok: [k8s-worker-01]
ok: [k8s-worker-03]
TASK [kubernetes_worker : kubernetes-worker | set variables] **********************************************************
ok: [k8s-worker-01] => (item=/homelab/ansible/roles/kubernetes_worker/vars/default.yml)
ok: [k8s-worker-02] => (item=/homelab/ansible/roles/kubernetes_worker/vars/default.yml)
ok: [k8s-worker-03] => (item=/homelab/ansible/roles/kubernetes_worker/vars/default.yml)
TASK [kubernetes_worker : kubernetes-worker | populate service facts] *************************************************
ok: [k8s-worker-02]
ok: [k8s-worker-01]
ok: [k8s-worker-03]
TASK [kubernetes_worker : network | allow kubelet api inbound from kubernetes controllers] ****************************
changed: [k8s-worker-01] => (item=10.1.1.41)
changed: [k8s-worker-03] => (item=10.1.1.41)
changed: [k8s-worker-02] => (item=10.1.1.41)
changed: [k8s-worker-01] => (item=10.1.1.42)
changed: [k8s-worker-03] => (item=10.1.1.42)
changed: [k8s-worker-02] => (item=10.1.1.42)
changed: [k8s-worker-01] => (item=10.1.1.43)
changed: [k8s-worker-03] => (item=10.1.1.43)
changed: [k8s-worker-02] => (item=10.1.1.43)
TASK [kubernetes_worker : network | allow nodeport services inbound from kubernetes servers] **************************
changed: [k8s-worker-01] => (item=10.1.1.41)
changed: [k8s-worker-02] => (item=10.1.1.41)
changed: [k8s-worker-03] => (item=10.1.1.41)
changed: [k8s-worker-01] => (item=10.1.1.42)
changed: [k8s-worker-03] => (item=10.1.1.42)
changed: [k8s-worker-02] => (item=10.1.1.42)
changed: [k8s-worker-01] => (item=10.1.1.43)
changed: [k8s-worker-03] => (item=10.1.1.43)
changed: [k8s-worker-02] => (item=10.1.1.43)
changed: [k8s-worker-01] => (item=10.1.1.51)
changed: [k8s-worker-03] => (item=10.1.1.51)
changed: [k8s-worker-02] => (item=10.1.1.51)
changed: [k8s-worker-01] => (item=10.1.1.52)
changed: [k8s-worker-03] => (item=10.1.1.52)
changed: [k8s-worker-01] => (item=10.1.1.53)
changed: [k8s-worker-02] => (item=10.1.1.52)
changed: [k8s-worker-03] => (item=10.1.1.53)
changed: [k8s-worker-02] => (item=10.1.1.53)
TASK [kubernetes_worker : kubeadm | create join token] ****************************************************************
changed: [k8s-worker-01 -> k8s-controller-01]
TASK [kubernetes_worker : kubeadm | store join token] *****************************************************************
changed: [k8s-worker-01]
TASK [kubernetes_worker : kubeadm | join workers] *********************************************************************
skipping: [k8s-worker-03]
changed: [k8s-worker-02]
changed: [k8s-worker-01]
PLAY [k8s_bootstrap] **************************************************************************************************
TASK [Gathering Facts] ************************************************************************************************
ok: [k8s-controller-01]
ok: [k8s-controller-02]
ok: [k8s-controller-03]
TASK [kubernetes_bootstrap : kubernetes-bootstrap | set variables] ****************************************************
ok: [k8s-controller-01] => (item=/homelab/ansible/roles/kubernetes_bootstrap/vars/default.yml)
ok: [k8s-controller-02] => (item=/homelab/ansible/roles/kubernetes_bootstrap/vars/default.yml)
ok: [k8s-controller-03] => (item=/homelab/ansible/roles/kubernetes_bootstrap/vars/default.yml)
TASK [kubernetes_bootstrap : kubernetes-bootstrap | pause to allow cluster to fully come online] **********************
Pausing for 120 seconds
(ctrl+C then 'C' = continue early, ctrl+C then 'A' = abort)
ok: [k8s-controller-01]
TASK [kubernetes_bootstrap : argocd | manage argocd 'flag' directory] *************************************************
changed: [k8s-controller-01]
changed: [k8s-controller-03]
changed: [k8s-controller-02]
TASK [kubernetes_bootstrap : argocd | install argocd] *****************************************************************
changed: [k8s-controller-01]
TASK [kubernetes_bootstrap : argocd | pause to allow argocd to fully deploy] ******************************************
Pausing for 120 seconds
(ctrl+C then 'C' = continue early, ctrl+C then 'A' = abort)
ok: [k8s-controller-01]
TASK [kubernetes_bootstrap : argocd | install core-apps app] **********************************************************
changed: [k8s-controller-01]
PLAY RECAP ************************************************************************************************************
k8s-controller-01 : ok=98 changed=68 unreachable=0 failed=0 skipped=3 rescued=0 ignored=0
k8s-controller-02 : ok=86 changed=61 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0
k8s-controller-03 : ok=87 changed=61 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0
k8s-worker-01 : ok=58 changed=37 unreachable=0 failed=0 skipped=2 rescued=0 ignored=0
k8s-worker-02 : ok=56 changed=35 unreachable=0 failed=0 skipped=2 rescued=0 ignored=0
k8s-worker-03 : ok=56 changed=35 unreachable=0 failed=0 skipped=2 rescued=0 ignored=0