How CrawlOps works with GitLab
Pipeline → deployment → CrawlOps trigger → website crawl → previous snapshot comparison → SEO regressions → pass or fail decision.
Run automated SEO checks after GitLab deployments and detect regressions before they affect organic traffic.
Pipeline → deployment → CrawlOps trigger → website crawl → previous snapshot comparison → SEO regressions → pass or fail decision.
Technical SEO regressions are easier to fix when they are connected to the deployment that introduced them.
crawlops:
stage: test
image: curlimages/curl:latest
script:
- |
curl --fail-with-body -X POST "$CRAWLOPS_ENDPOINT" \
-H "Authorization: Bearer $CRAWLOPS_DEPLOY_TOKEN" \
-H "Accept: application/json" \
-F "environment=production" \
-F "commit_sha=$CI_COMMIT_SHA" \
-F "branch=$CI_COMMIT_BRANCH" \
-F "pipeline_id=$CI_PIPELINE_ID" \
-F "pipeline_url=$CI_PIPELINE_URL"Run a crawl after deployment and compare the result with the previous snapshot.