🧪 Deployment E2E Testing

Comprehensive end-to-end tests for GitLab + Cloudflare deployment pipeline

Overview

The E2E test suite verifies the complete deployment pipeline:

1. ✅ GitLab API connectivity
2. ✅ GitLab project creation
3. ✅ GitLab file push
4. ✅ GitLab pipeline triggering
5. ✅ Cloudflare API connectivity
6. ✅ Cloudflare project creation
7. ✅ Full pipeline flow
8. ✅ Resource cleanup

Running Tests

Quick Commands

# Full E2E test suite
yarn e2e:pipeline

# Connection verification only
yarn e2e:pipeline:verify

# Run tests, keep test resources for inspection
yarn e2e:pipeline:keep

Direct Test Execution

# With environment variables
GITLAB_API_TOKEN=xxx CLOUDFLARE_API_TOKEN=xxx CLOUDFLARE_ACCOUNT_ID=xxx \
  npx nx test backend-ai-api --testPathPattern='pipeline-e2e'

Test File Location

apis/backend-ai-api/src/app/workflow/tests/pipeline-e2e.spec.ts

Test Cases

GitLab Integration Tests

Cloudflare Integration Tests

Full Pipeline Integration

Test Output Example

PASS backend-ai-api apis/backend-ai-api/src/app/workflow/tests/pipeline-e2e.spec.ts

  Pipeline E2E Tests (Real Infrastructure)
    GitLab Integration
      ✓ should connect to GitLab API (288 ms)
      ✓ should create/find test group (334 ms)
      ✓ should create project and push code (4704 ms)
      ✓ should create project with CI config and trigger pipeline (4163 ms)
    Cloudflare Integration
      ✓ should connect to Cloudflare API (212 ms)
      ✓ should list existing Pages projects (730 ms)
      ✓ should create and delete test project (2833 ms)
    Full Pipeline Integration
      ✓ should execute complete deployment flow (4506 ms)

Console Output:
  ✅ Connected to GitLab as: gograb-space
  ✅ Using test group: gograbspace (ID: 122455722)
  ✅ Created project: gograbspace/e2e-test-1769264009565
  ✅ Pushed 3 files, commit: b7105951
  
  🚀 Starting Full Pipeline E2E Test
  1️⃣  Created GitLab project: gograbspace/e2e-test-full-1769264024426
  2️⃣  Pushed 4 files including CI config
  3️⃣  Created Cloudflare Pages project: https://e2e-test-full-1769264024426.pages.dev
  4️⃣  Triggered pipeline #2284119171
       URL: https://gitlab.com/gograbspace/e2e-test-full-1769264024426/-/pipelines/2284119171
  
  ✅ Full Pipeline E2E Test Complete!
  Summary:
     GitLab Project: https://gitlab.com/gograbspace/e2e-test-full-1769264024426
     Cloudflare URL: https://e2e-test-full-1769264024426.pages.dev
     Pipeline: https://gitlab.com/gograbspace/e2e-test-full-1769264024426/-/pipelines/2284119171
  
  🧹 Cleaning up GitLab project: gograbspace/e2e-test-1769264009565
  🧹 Cleaning up Cloudflare project: e2e-test-1769264024426

Configuration

Environment Variables

Test Group

Tests use the existing gograbspace group (ID: 122455722) because:

• Token doesn't have group creation permissions
• Avoids creating unnecessary groups

Test Resource Naming

All test resources are prefixed for easy identification:

Cleanup

Automatic Cleanup

Tests automatically clean up resources in afterAll:

• Deletes all GitLab projects created
• Deletes all Cloudflare projects created

Skip Cleanup (Debug)

E2E_SKIP_CLEANUP=true yarn e2e:pipeline

Resources remain for inspection.

Manual Cleanup

# List test projects
curl -H "PRIVATE-TOKEN: $GITLAB_API_TOKEN" \
  "https://gitlab.com/api/v4/groups/122455722/projects?search=e2e-test" | jq '.[].name'

# Delete specific project
curl -X DELETE -H "PRIVATE-TOKEN: $GITLAB_API_TOKEN" \
  "https://gitlab.com/api/v4/projects/gograbspace%2Fe2e-test-xxx"

Known Limitations

GitLab Pipeline Triggering

Pipeline triggering requires GitLab identity verification:

• Go to https://gitlab.com/-/identity_verification
• Verify via credit card or phone (one-time)
• Pipelines work immediately after

CI Job Script Validation

GitLab validates CI YAML syntax strictly:

• Script must be string or array
• Multi-line scripts need proper formatting

Troubleshooting

"403 Forbidden" on Group Operations

Cause: Token lacks group creation permission

Solution: Tests use existing gograbspace group

"Identity verification required"

Cause: GitLab.com policy for CI/CD

Solution: Verify at https://gitlab.com/-/identity_verification

Tests Timeout

Cause: Network latency or API slowness

Solution: Increase timeout in test configuration

Cleanup Failures

Cause: Resource already deleted or network error

Impact: None (cleanup is best-effort)

CI Integration

Running in CI/CD

# .github/workflows/e2e.yml
e2e-deployment:
  runs-on: ubuntu-latest
  env:
    GITLAB_API_TOKEN: ${{ secrets.GITLAB_API_TOKEN }}
    CLOUDFLARE_ACCOUNT_ID: ${{ secrets.CLOUDFLARE_ACCOUNT_ID }}
    CLOUDFLARE_API_TOKEN: ${{ secrets.CLOUDFLARE_API_TOKEN }}
  steps:
    - uses: actions/checkout@v4
    - run: yarn install
    - run: yarn e2e:pipeline

See Also

• Quick Commands
• Environment Variables
• GitLab Integration
• Cloudflare Pages