Notify Oncall

Operations documentation page for the Notify Oncall mechanism

Introduced via gitlab-com/support/support-team-meta#6109

This is an informational page for the notify oncall mechinism. It may not reflect the way we actually manage it.

If you are looking for information about maintaining it, please see our workflows

Where does it live

It lives within the Readiness namespace at the notify-oncall project.

How does it work

A Pagerduty webhook is used when an incident is triggered on the Customer Support - US Federal service, which in turn triggers a CI/CD pipeline within the notify-oncall project.

This then processes the payload from the Pagerduty webhook to determine if a human is currently assigned to be oncall. If one is, the scripts exit with a 0 status code.

If no human is currently assigned, the scripts then determine a list of US Government first shift agents who are available (i.e. not on PTO). Using this list, the scripts ping the availabel agents via Slack in the #spt_us-government Slack channel.