Understanding Databricks RBAC: Grants, Permissions, and Entitlements

Documentation on Databricks Grants, Permissions and Entitlement can get complex fast, especially switching between AWS, Azure and Databricks versions. When I was then looking into implementing the RBAC design for Databricks, I started looking into the different access approaches for groups. I found you needed to be a full functioning Data Engineer using this productContinueContinue reading “Understanding Databricks RBAC: Grants, Permissions, and Entitlements”

Automating Azure PIM Requests with PowerShell

Privileged Identity Management (PIM) is made to be a secure authentication method to assign user permissions via groups and monitor the access.  This enables short time requests for the permissions that can require fields like reason for access, how long to have access and who is having access. This can typically be used for engineers’ContinueContinue reading “Automating Azure PIM Requests with PowerShell”

Best Practices for Terraform Module Testing and Validation

Terraform Modules are great for isolated components you can reuse and plug-in to your main Infrastructure as Core code base. They can then also be shared and used by multiple other teams at the same time to reduce repeated code, complexity and increase compliance. However, as they are isolated, they are harder to test, maintainContinueContinue reading “Best Practices for Terraform Module Testing and Validation”

Azure DevOps REST API: Add Users and Set Administrators Easily

When using the Azure DevOps REST API to create Teams and add users, you may want to set the administrators as well at the same time. However, this REST API is not well documented on the Microsoft documentation site for the REST API. With some searching and mapping of resources, I have below the methodContinueContinue reading “Azure DevOps REST API: Add Users and Set Administrators Easily”

Shared Azure API Management Service Design

Azure API Management Services (APIM) are a powerful, flexible, and well-equipped product in Azure, but they are also expensive. There are reasons for this, and ways in general you can reduce the cost with SKUs, but another way is to share it with other products within your organisation instead of having a dedicated APIM. IContinueContinue reading “Shared Azure API Management Service Design”

Download files and folders from Azure DevOps 

If you have a large repository it can be a long wait on the pipeline to get it checked out, only to use a few files. In this post, I will guide you through using PowerShell to download only the files you need with either the Azure DevOps REST API or CLI.  API Service  InContinueContinue reading “Download files and folders from Azure DevOps “

Automating SemVer Versioning

Application versioning is a key principle in the DevOps lifecycle, this is to ensure both users and software providers can easily tack any changes made to the application or environment, we therefore want to ensure that any manual process of updating versions is replaced with an automated process. In this post, I will go throughContinueContinue reading “Automating SemVer Versioning”

Octopus Deploy Runbook cloning with the REST API

Ever wondered how you can copy an Octopus Deploy Runbook from one Project to another? It can’t be done, well at least by using the User Interface. What you can do is use code, so by using the power of the Octopus REST API and some PowerShell we can make it possible. In this post,ContinueContinue reading “Octopus Deploy Runbook cloning with the REST API”