0
0
mirror of https://github.com/bpg/terraform-provider-proxmox.git synced 2025-08-22 19:38:35 +00:00
Terraform / OpenTofu Provider for Proxmox VE
Go to file
Sven Greb 357f7c70a7
feat(node): implement initial support to manage APT repositories (#1325)
* feat(nodes): Initial support to manage APT repositories

> Summary

This commit implements initial support for managing APT repositories
which is (currently) limited to…

- …adding "standard" repositories to allow to configure it.
- toggling the activation status (enabled/disabled) of any configured
  repository.

+ !WARNING!
+ Note that deleting or modifying a repository in any other way is
+ (sadly) not possible (yet?)!
+ The limited functionality is due to the (current) capabilities of
+ the Proxmox VE APT repository API [1] itself.

>> Why are there two resources for one API entity?

Even though an APT repository should be seen as a single API entity, it
was required to implement standard repositories as dedicated
`proxmox_virtual_environment_apt_standard_repository`. This is because
standard repositories must be configured (added) first to the default
source list files because their activation status can be toggled. This
is handled by the HTTP `PUT` request, but the modifying request is
`POST` which would require two calls within the same Terraform execution
cycle. I tried to implement it in a single resource and it worked out
mostly after some handling some edges cases, but in the end there were
still too many situations an edge cases where it might break due to
Terraform state drifts between states. In the end the dedicated
resources are way cleaner and easier to use without no complexity and
conditional attribute juggling for practitioners.

>> Other "specialties"

Unfortunately the Proxmox VE API responses to HTTP `GET` requests with
four larger arrays which are, more or less, kind of connected to each
other, but they also somehow stand on their own. This means that there
is a `files` array that contains the `repositories` again which again
contains all repositories with their metadata of every source file. On
the other hand available standard repositories are listed in the
`standard-repos` array, but their activation status is only stored when
they have already been added through a `PUT` request. The `infos` array
is more less useless.

So in order to get the required data and store them in the state the
`importFromAPI` methods of the models must loop through all the
deep-nested arrays and act based on specific attributes like a matching
file path, comparing it to the activation status and so on.

In the end the implementation is really stable after testing it with all
possible conditions and state combinations.

@bpg if you'd like me to create a small data logic flow chart to make it
easier to understand some parts of the code let me know. I can make my
local notes "shareable" which I created to not loose track of the logic.

>> What is the way to manage the activation status of a "standard" repository?

Because the two resources are modular and scoped they can be simply
combined to manage an APT "standard" repository, e.g. toggling its
activation status. The following examples are also included in the
documentations.

```hcl
// This resource ensure that the "no-subscription" standard repository
// is added to the source list.
// It represents the `PUT` API request.
resource "proxmox_virtual_environment_apt_standard_repository" "example" {
  handle = "no-subscription"
  node   = "pve"
}

// This resource allows to actually modify the activation status of the
// standard repository as it represents the `POST`.
// Using the values from the dedicated standard repository resource
// makes sure that Terraform correctly resolves dependency order.
resource "proxmox_virtual_environment_apt_repository" "example" {
  enabled   = true
  file_path = proxmox_virtual_environment_apt_standard_repository.example.file_path
  index     = proxmox_virtual_environment_apt_standard_repository.example.index
  node      = proxmox_virtual_environment_apt_standard_repository.example.node
}
```

[1]: https://pve.proxmox.com/pve-docs/api-viewer/#/nodes/{node}/apt/repositories

---------

Signed-off-by: Sven Greb <development@svengreb.de>
Signed-off-by: Pavel Boldyrev <627562+bpg@users.noreply.github.com>
Co-authored-by: Pavel Boldyrev <627562+bpg@users.noreply.github.com>
2024-07-05 18:48:35 -04:00
.devcontainer chore(vm): refactoring, add acceptance tests (#1040) 2024-02-19 16:56:13 -05:00
.github feat(vm): implement filtering in vms data source. (#1423) 2024-07-05 15:52:39 -04:00
.vscode fix(vm): state drift due to disk re-ordering (#1215) 2024-04-15 16:45:38 -04:00
docs feat(node): implement initial support to manage APT repositories (#1325) 2024-07-05 18:48:35 -04:00
example feat(vm): implement filtering in vms data source. (#1423) 2024-07-05 15:52:39 -04:00
examples feat(node): implement initial support to manage APT repositories (#1325) 2024-07-05 18:48:35 -04:00
fwprovider feat(node): implement initial support to manage APT repositories (#1325) 2024-07-05 18:48:35 -04:00
proxmox feat(node): implement initial support to manage APT repositories (#1325) 2024-07-05 18:48:35 -04:00
proxmoxtf feat(vm): implement filtering in vms data source. (#1423) 2024-07-05 15:52:39 -04:00
templates chore(vm2): add datasource implementation (#1318) 2024-05-22 02:06:41 +00:00
tools feat(node): implement initial support to manage APT repositories (#1325) 2024-07-05 18:48:35 -04:00
utils chore(code): fix code quality warnings (#1409) 2024-06-25 00:47:50 -04:00
.all-contributorsrc docs: add konstantin-kornienko as a contributor for code, and ideas (#1428) 2024-07-05 16:11:28 -04:00
.gitignore fix(docs): update HOW-TOs for cloud-init (#955) 2024-01-24 03:44:39 +00:00
.golangci.yml feat(node): implement initial support to manage APT repositories (#1325) 2024-07-05 18:48:35 -04:00
.goreleaser.yaml misc: update goreleaser config 2024-06-25 01:41:19 -04:00
.lycheeignore misc: add .lycheeignore 2024-01-20 23:18:36 -05:00
.markdownlint.json chore(docs): update README.md (#1045) 2024-02-20 00:05:54 +00:00
.markdownlintignore feat(provider): add DNS lookup fallback for node IP resolution (#848) 2023-12-29 12:24:36 -05:00
.mergify.yml misc(ci): update .mergify.yml (#1024) 2024-02-08 22:52:37 -05:00
.release-please-manifest.json chore(main): release 0.60.1 (#1397) 2024-06-25 01:29:21 -04:00
CHANGELOG.md chore(main): release 0.60.1 (#1397) 2024-06-25 01:29:21 -04:00
CODE_OF_CONDUCT.md Update project to use bpg/terraform-provider-proxmox 2021-09-09 12:20:19 -04:00
CONTRIBUTING.md misc: update documentation 2024-05-05 22:27:18 -04:00
CONTRIBUTORS.md docs: add konstantin-kornienko as a contributor for code, and ideas (#1428) 2024-07-05 16:11:28 -04:00
example.tfrc fix(build): Fix make example-init for TF 1.4 (#262) 2023-03-16 22:09:41 -04:00
go.mod chore(deps): update module golang.org/x/crypto (v0.24.0 → v0.25.0) (#1427) 2024-07-05 16:11:18 -04:00
go.sum chore(deps): update module golang.org/x/crypto (v0.24.0 → v0.25.0) (#1427) 2024-07-05 16:11:18 -04:00
HISTORY.md tweak changelog generation 2021-09-09 07:25:06 -04:00
LICENSE Initial work 2019-12-07 19:58:29 +01:00
main.go fix(provider): EOF error when closing SSH session (#1113) 2024-03-11 20:05:11 -04:00
Makefile chore(main): release 0.60.1 (#1397) 2024-06-25 01:29:21 -04:00
qodana.yaml chore(code): fix code quality warnings (#1409) 2024-06-25 00:47:50 -04:00
README.md misc: add wakatime badge 2024-05-14 18:30:40 -04:00
release-please-config.json fix(docs): fix documentation tree structure in the TF registry (#980) 2024-01-27 22:16:53 -05:00
terraform-registry-manifest.json fix(ci): missing releases from HashiCorp Registry (#1118) 2024-03-13 01:48:05 +00:00
testacc chore(vm): refactor storage devices handling from/to API (#1394) 2024-06-17 01:23:48 +00:00

Terraform Provider for Proxmox

Go Report Card GoDoc GitHub release (latest by date) GitHub Release Date GitHub stars All Contributors Conventional Commits Buy Me A Coffee Wakatime

A Terraform / OpenTofu Provider which adds support for Proxmox solutions.

This repository is a fork of https://github.com/danitso/terraform-provider-proxmox which is no longer maintained.

Compatibility promise

This provider is compatible with the latest version of Proxmox VE (currently 8.2). While it may work with older 7.x versions, it is not guaranteed to do so.

While provider is on version 0.x, it is not guaranteed to be backwards compatible with all previous minor versions. However, we will try to keep the backwards compatibility between provider versions as much as possible.

Requirements

Using the provider

You can find the latest release and its documentation in the Terraform Registry.

Testing the provider

In order to test the provider, you can simply run make test.

make test

Tests are limited to regression tests, ensuring backwards compatibility.

A limited number of acceptance tests are available in the proxmoxtf/test directory, mostly for "new" functionality implemented using the Terraform Provider Framework. These tests are not run by default, as they require a Proxmox VE environment to be available. They can be run using make testacc, the Proxmox connection can be configured using environment variables, see provider documentation for details.

Deploying the example resources

There are number of TF examples in the example directory, which can be used to deploy a Container, VM, or other Proxmox resources on your test Proxmox environment. The following assumptions are made about the test environment:

  • It has one node named pve
  • The node has local storages named local and local-lvm
  • The "Snippets" content type is enabled in local storage

Create example/terraform.tfvars with the following variables:

virtual_environment_username = "root@pam"
virtual_environment_password = "put-your-password-here"
virtual_environment_endpoint = "https://<your-cluster-endpoint>:8006/"

Then run make example to deploy the example resources.

If you don't have free proxmox cluster to play with, there is dedicated how-to tutorial how to setup Proxmox inside VM and run make example on it.

Future work

The provider is using the Terraform SDKv2, which is considered legacy and is in maintenance mode. The work has started to migrate the provider to the new Terraform Plugin Framework, with aim to release it as a new major version 1.0.

Known issues

Disk images cannot be imported by non-PAM accounts

Due to limitations in the Proxmox VE API, certain actions need to be performed using SSH. This requires the use of a PAM account (standard Linux account).

Disk images from VMware cannot be uploaded or imported

Proxmox VE is not currently supporting VMware disk images directly. However, you can still use them as disk images by using this workaround:

resource "proxmox_virtual_environment_file" "vmdk_disk_image" {
  content_type = "iso"
  datastore_id = "datastore-id"
  node_name    = "node-name"

  source_file {
    # We must override the file extension to bypass the validation code
    # in the Proxmox VE API.
    file_name = "vmdk-file-name.img"
    path      = "path-to-vmdk-file"
  }
}

resource "proxmox_virtual_environment_vm" "example" {
  //...

  disk {
    datastore_id = "datastore-id"
    # We must tell the provider that the file format is vmdk instead of qcow2.
    file_format  = "vmdk"
    file_id      = "${proxmox_virtual_environment_file.vmdk_disk_image.id}"
  }

  //...
}

Snippets cannot be uploaded by non-PAM accounts

Due to limitations in the Proxmox VE API, certain files (snippets, backups) need to be uploaded using SFTP. This requires the use of a PAM account (standard Linux account).

Cluster hardware mappings cannot be created by non-PAM accounts

Due to limitations in the Proxmox VE API, cluster hardware mappings must be created using the root PAM account (standard Linux account) due to IOMMU interactions. Hardware mappings allow to use PCI "passthrough" and map physical USB ports.

Contributors

See CONTRIBUTORS.md for a list of contributors to this project.

Repository Metrics

Metrics

Sponsorship

❤️ This project is sponsored by:

Thanks again for your continuous support, it is much appreciated! 🙏

Acknowledgements

This project has been developed with GoLand IDE under the JetBrains Open Source license, generously provided by JetBrains s.r.o.

GoLand logo