Tuesday, August 25, 2020

multi language beam pipelines

https://cloud.google.com/blog/products/data-analytics/multi-language-sdks-for-building-cloud-pipelines

Saturday, July 25, 2020

Saturday, June 13, 2020

Misconfigured Kubeflow workloads are a security risk

welcome to the cloud - https://www.microsoft.com/security/blog/2020/06/10/misconfigured-kubeflow-workloads-are-a-security-risk/

Wednesday, April 29, 2020

Calling Native Libraries from Java

A couple of options I've used and seen: 

Friday, April 10, 2020

Google Cloud IAM Madness

After the recent GCP outage related to IAM, I found some odd behaviour with gsutil/gcloud. A script that had faithfully run for many months stopped working with:

ServiceException: 401 Anonymous caller does not have storage.buckets.list access to project xxxx

I tried recreating the service account key used for the operation with no luck. To fix the problem, I had to create a new bucket!

gsutil mb -b on -l us-east1 gs://my-awesome-bucket123ed321/
Creating gs://my-awesome-bucket123ed321/...
gsutil ls
gs://my-awesome-bucket123ed321/
gs://<my_original_bucket_I_couldnt_see>/

Wierd!!!!


Wednesday, February 05, 2020

Cloud Billing Budget API in beta

You can finally set budgets via the API in GCP. This is a huge relief to all those org admins out there who have had to do this manually.

AND, hold on to your hats, there's terraform support as well! 

Looks like Christmas came late....


data "google_billing_account" "account" {
  provider = google-beta
  billing_account = "000000-0000000-0000000-000000"
}

resource "google_billing_budget" "budget" {
  provider = google-beta
  billing_account = data.google_billing_account.account.id
  display_name = "Example Billing Budget"
  amount {
    specified_amount {
      currency_code = "USD"
      units = "100000"
    }
  }
  threshold_rules {
      threshold_percent =  0.5
  }
}