Create a new GCP project

1. Create new project under the 2i2c GCP org. This lets us do access control more easily, and makes sure 2i2c engineers always have appropriate access to the created project.

2. Name the project, giving it a unique id. We try to keep the word ‘2i2c’ out of the project name, in case the user decide to exercise their right to replicate at some point.

3. Keep it inside the 2i2c organization, and locate inside the 2i2c folder.

4. Use the 2i2c Billing billing account, with id 0157F7-E3EA8C-25AC3C.

5. Hit the ‘Create’ button

6. You should see a notification as soon as the project is created. Switch to the freshly created project

7. GCP requires you to explicitly enable APIs before they can be used. Enable the following APIs:

   1. GKE

   2. Compute Engine

   3. Artifact Registry

   4. Filestore

8. Setup a new cluster inside it via Terraform

Checking quotas and requesting increases¶

Finally, we should check what quotas are enforced on the project and increase them as necessary.

1. Navigate to https://console.cloud.google.com

2. Select the project you created from the dropdown in the top menu bar

3. In the search bar in the top menu, search for “All quotas”

4. Once on the quotas page, check the checkbox next to the quota you would like to edit, e.g., CPUs, then click “Edit quotas”

5. In the pane that opens, enter the new limit, e.g. 128 CPUs. You will then be asked to provide some contact information. Click “Submit request” and you will receive a confirmation email.

Set up project cost export to bigquery¶

Each time we set up a new billing account, we need to set it up to export detailed usage costs to a GCP BigQuery dataset, so we can automatically figure out how much each project costs us. Ideally this would be doable with the GCP billing API, as we do not need detailed metrics - just total cost. However, the GCP billing API is super limited, and does not allow for this. So we need to use bigquery instead.

1. Go to the Billing Console, and make sure you have selected the correct project in the projects drop down in the top bar.

2. Select “Go to Linked Billing account”.

3. Select “Billing Export” in the left sidebar.

4. Under “Detailed cost usage”, select “Edit Settings”.

5. Select the project under which the bigquery dataset should be created. If the same billing account is used for multiple projects, it is alright to centralize them in a single project, if it is ok for users of one project to know the costs of the other.

6. Select the “dataset” field, and select “Create a new dataset”.

7. Provide a name (defaulting to cloud_costs) for the name of the datasets.

8. Select “Region” as the location type, and us-central1 as the region.

9. Select the “Create dataset” button

10. Select the created dataset in the “Data set” field now.

11. Click “Save”.

Bigquery export is now set up!