TEST012warningPro

tests-hit-live-services

Test constructs a real external-service client (OpenAI, Stripe, AWS...) with no mocking in sight.

Applies to: JavaScript, Python, TypeScript

Why this matters

A test that calls a live service only passes where the credentials exist — usually one configured laptop. In CI it fails keyless (or worse, silently burns quota and flakes on network). Mock the client at the boundary, or the suite can never gate anything.

Catch it before it ships

pip install stablestack # or: npx stablestackstablestack # scans your project, TEST012 includedstablestack explain TEST012

TEST012 is part of the Pro rule set. See pricing — the free tier ships 25 checks with no signup.

False positive in your codebase? Suppress a single line with # noqa: TEST012

More Testing checks

skipped-tests

Test is marked as skipped.

async-mock-issues

Async function mocked incorrectly.

duplicate-test-helpers

Test helper function may be duplicated across test files.

e2e-test-duplication

E2E test contains duplicated code that should use shared helpers

e2e-console-capture

E2E tests should capture console errors to catch silent JavaScript failures.

missing-e2e-tests

Web projects should have Playwright E2E tests to catch console errors and broken pages.

playwright-test-slow-misuse

Detects incorrect test.slow() usage that silently skips tests.

playwright-wait-for-timeout

waitForTimeout() in tests waits for arbitrary time instead of content/state.