kops cli terminates without error message when --project flag is empty

[linde]

/kind bug

1. What kops version are you running? The command kops version, will display
this information.

Client version: 1.32.1 (git-v1.32.1)

2. What Kubernetes version are you running? kubectl version will print the
version if a cluster is running or provide the Kubernetes version specified as
a kops flag.

Client Version: v1.32.4-dispatcher

3. What cloud provider are you using?

GCP

4. What commands did you run? What is the simplest way to reproduce this issue?

export GCP_PROJECT=[project name]
export GCP_BILLING_ACCOUNT=[billing account]
export GCP_FOLDER=[folder]

gcloud projects create ${GCP_PROJECT} --folder=${GCP_FOLDER}
gcloud billing projects link $GCP_PROJECT --billing-account ${GCP_BILLING_ACCOUNT}

gcloud auth application-default login --project $GCP_PROJECT

export BUCKET=gs://state-${GCP_PROJECT}
gsutil mb -p $GCP_PROJECT ${BUCKET}

export KOPS_STATE_STORE=${BUCKET}

kops -v9 create cluster simple.k8s.local --zones us-central1-a
--state ${KOPS_STATE_STORE}/ --project=${PROJECT}

5. What happened after the commands executed?

kops create cluster simple.k8s.local --zones us-central1-a --state ${KOPS_STATE_STORE}/ --project=${PROJECT}

I0806 00:10:26.999580 862615 factory.go:98] state store gs://[the bucket]
I0806 00:10:26.999833 862615 gsfs.go:277] Reading file "gs://[the bucket]/simple.k8s.local/config"
I0806 00:10:27.350495 862615 context.go:313] retrying after error error reading gs://[the bucket]/simple.k8s.local/config: Get "https://storage.googleapis.com/storage/v1/b/[the bucket]/o/simple.k8s.local%2Fconfig?alt=media&prettyPrint=false": Post "https://oauth2.mtls.googleapis.com/token": signal: segmentation fault (core dumped)
I0806 00:10:28.395846 862615 gsfs.go:277] Reading file "gs://[the bucket]/simple.k8s.local/config"
I0806 00:10:28.667281 862615 context.go:313] retrying after error error reading gs://[the bucket]/simple.k8s.local/config: Get "https://storage.googleapis.com/storage/v1/b/[the bucket]/o/simple.k8s.local%2Fconfig?alt=media&prettyPrint=false": Post "https://oauth2.mtls.googleapis.com/token": signal: segmentation fault (core dumped)
I0806 00:10:30.312114 862615 gsfs.go:277] Reading file "gs://[the bucket]/simple.k8s.local/config"
I0806 00:10:30.588128 862615 context.go:313] retrying after error error reading gs://[the bucket]/simple.k8s.local/config: Get "https://storage.googleapis.com/storage/v1/b/[the bucket]/o/simple.k8s.local%2Fconfig?alt=media&prettyPrint=false": Post "https://oauth2.mtls.googleapis.com/token": signal: segmentation fault (core dumped)
I0806 00:10:33.018138 862615 gsfs.go:277] Reading file "gs://[the bucket]/simple.k8s.local/config"
I0806 00:10:33.305145 862615 context.go:317] hit maximum retries 4 with error error reading gs://[the bucket]/simple.k8s.local/config: Get "https://storage.googleapis.com/storage/v1/b/[the bucket]/o/simple.k8s.local%2Fconfig?alt=media&prettyPrint=false": Post "https://oauth2.mtls.googleapis.com/token": signal: segmentation fault (core dumped)
Error: error reading cluster configuration "simple.k8s.local": error reading gs://[the bucket]/simple.k8s.local/config: error reading gs://[the bucket]/simple.k8s.local/config: Get "https://storage.googleapis.com/storage/v1/b/[the bucket]/o/simple.k8s.local%2Fconfig?alt=media&prettyPrint=false": Post "https://oauth2.mtls.googleapis.com/token": signal: segmentation fault (core dumped)

6. What did you expect to happen?

cluster config creation as in the getting started.

**7. Please provide your cluster manifest. Execute

didn't get that far

8. Please run the commands with most verbose logging by adding the -v 10 flag.
Paste the logs into this report, or in a gist and provide the gist link here.

done above

9. Anything else do we need to know?

[linde]

wait, I think my problem is that my project parameter is empty. I was inconsistent with ${PROJECT} versus ${GCP_PROJECT}. when I use the right param in the CLI it gives a more helpful error:

    "message": "Compute Engine API has not been used in project stevenlinde-kops-250808 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/compute.googleapis.com/overview?project=stevenlinde-kops-250808 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry."

so, will rename the bug to be empty project parameter terminates without helpful error message

[linde]

might also suggest providing a pre-req list of GCP services that need to be enabled in the docs:

gcloud services enable --project ${GCP_PROJECT}  \
               cloudresourcemanager.googleapis.com iam.googleapis.com  compute.googleapis.com

[linde]

sorry to ping/pong on this but I was able to recreate even with the right project parameter. here's the setup

export GCP_PROJECT=[project name]
export GCP_BILLING_ACCOUNT=[billing account]
export GCP_FOLDER=[folder]

gcloud projects create ${GCP_PROJECT} --folder=${GCP_FOLDER}
gcloud billing projects link $GCP_PROJECT --billing-account ${GCP_BILLING_ACCOUNT}

gcloud services enable --project ${GCP_PROJECT} {cloudresourcemanager,iam,compute,storage}.googleapis.com

gcloud auth application-default login --project ${GCP_PROJECT}
gcloud auth login --project ${GCP_PROJECT}


export BUCKET=gs://${GCP_PROJECT}
gsutil  mb -p ${GCP_PROJECT}  ${BUCKET}

export KOPS_STATE_STORE=${BUCKET}/

the issue

kops -v9 create cluster simple.k8s.local --zones us-central1-a --project=${GCP_PROJECT}
I0813 22:35:38.158505  200396 factory.go:98] state store [BUCKET]
I0813 22:35:38.158707  200396 gsfs.go:277] Reading file "[BUCKET]/simple.k8s.local/config"
I0813 22:35:38.412651  200396 context.go:313] retrying after error error reading [BUCKET]/simple.k8s.local/config: Get "https://storage.googleapis.com/storage/v1/b/[PROJECT]/o/simple.k8s.local%2Fconfig?alt=media&prettyPrint=false": Post "https://oauth2.mtls.googleapis.com/token": signal: segmentation fault (core dumped)
I0813 22:35:39.447658  200396 gsfs.go:277] Reading file "[BUCKET]/simple.k8s.local/config"
I0813 22:35:39.784376  200396 context.go:313] retrying after error error reading [BUCKET]/simple.k8s.local/config: Get "https://storage.googleapis.com/storage/v1/b/[PROJECT]/o/simple.k8s.local%2Fconfig?alt=media&prettyPrint=false": Post "https://oauth2.mtls.googleapis.com/token": signal: segmentation fault (core dumped)
I0813 22:35:41.287172  200396 gsfs.go:277] Reading file "[BUCKET]/simple.k8s.local/config"
I0813 22:35:41.658483  200396 context.go:313] retrying after error error reading [BUCKET]/simple.k8s.local/config: Get "https://storage.googleapis.com/storage/v1/b/[PROJECT]/o/simple.k8s.local%2Fconfig?alt=media&prettyPrint=false": Post "https://oauth2.mtls.googleapis.com/token": signal: segmentation fault (core dumped)
I0813 22:35:44.043349  200396 gsfs.go:277] Reading file "[BUCKET]/simple.k8s.local/config"
I0813 22:35:44.508586  200396 context.go:317] hit maximum retries 4 with error error reading [BUCKET]/simple.k8s.local/config: Get "https://storage.googleapis.com/storage/v1/b/[PROJECT]/o/simple.k8s.local%2Fconfig?alt=media&prettyPrint=false": Post "https://oauth2.mtls.googleapis.com/token": signal: segmentation fault (core dumped)
Error: error reading cluster configuration "simple.k8s.local": error reading [BUCKET]/simple.k8s.local/config: error reading [BUCKET]/simple.k8s.local/config: Get "https://storage.googleapis.com/storage/v1/b/[PROJECT]/o/simple.k8s.local%2Fconfig?alt=media&prettyPrint=false": Post "https://oauth2.mtls.googleapis.com/token": signal: segmentation fault (core dumped)

[linde]

ok, I got inspired and ran the CLI in strace and uploaded the trace.log to Gemini and it indicated persuasively the problem was with a plugin that was exec'ed ( execve("/opt/google/endpoint-verification/bin/apihelper", ...) ) so very much unrelated to kops or gcloud as well. sorry for the run around