42
0
Q&ATrending
How do you write meaningful performance assertions in your load tests?Most load test examples I see just report numbers (p95, p99, RPS) without failing the test definitively. I want our…
1.2k views42Be the first to answer
97 discussions
42
0
Q&ATrending
How do you onboard new team members to a large legacy test suite?We have a 1,200-test suite built over 4 years. Good test coverage, but: - No documentation of test strategy or…
1.1k views42
42
0
Q&ATrending
Do you practice mutation testing and does it actually improve your test suite?Mutation testing (mutmut for Python, Stryker for JS) sounds powerful in theory: introduce small code changes and verify…
1.1k views42
40
0
Q&ATrending
Best approach for secrets management for test credentials in CI?We have test credentials (API keys for sandbox environments, DB passwords, OAuth tokens) that need to be available in…
1.1k views40
38
0
Q&ATrending
How do you properly clean up database state between pytest tests without killing speed?Our API test suite uses a real PostgreSQL database (Docker, spun up in CI). Each test creates data and we need…
1.1k views38
39
0
Q&ATrending
How do you validate AI-generated test code before committing it?I've started using AI to generate first-pass test code. The problem: I've caught several subtle bugs in AI-generated…
1.1k views39
39
0
Q&ATrending
What is the most effective approach to testing GraphQL APIs?REST API testing feels natural with pytest + requests, but I'm not sure how to apply the same discipline to GraphQL.…
1.1k views39
35
0
Q&ATrending
Is there a practical upper limit on how long a single automated test should run?We have a handful of E2E tests that take 4–6 minutes each. They cover complex user journeys (onboarding flow,…
995 views35
36
0
Q&ATrending
Is Selenium Grid 4 still worth self-hosting or should we just use cloud providers?We're running Selenium Grid 3 on 6 VMs and it's a maintenance headache — node crashes, session leaks, version…
992 views36
35
0
Q&ATrending
Database testing strategies when your team does not own the database schema?We're an SDET team testing a service that uses a database we don't own — the schema is managed by a platform team and…
955 views35
33
0
Q&ATrending
Managing test data in pytest — factory pattern, fixtures, or external files?As our API test suite grows I'm realising ad-hoc test data in each test function is a maintenance nightmare. Three…
953 views33
31
0
Q&ATrending
JSON schema validation — jsonschema vs pydantic vs just asserting against the OpenAPI spec?I need to validate API response structures in pytest tests. Three paths I see: 1. jsonschema — explicit, dict-based…
935 views31
33
0
Q&ATrending
How do you handle timezone-related test failures in a distributed team?We have engineers in India, UK, and US. Our tests occasionally fail due to timezone-dependent logic: - Date range…
929 views33
34
0
DiscussionTrending
AI-assisted test generation — real productivity boost or just hype?Over the past few months I've been experimenting with Claude and GitHub Copilot for test case generation at work. Mixed…
904 views34
29
0
Q&ATrending
pytest-xdist vs pytest-parallel — which is more reliable for parallel test execution?We need to parallelise a 600-test pytest suite. Current serial runtime is ~22 minutes, target is under 8 minutes. I've…
904 views29
32
0
Q&ATrending
What test metrics do you actually report from CI to Slack or Teams?We want to add test result notifications to our Slack channel after each CI run. Before I build this out I want to know…
903 views32
30
0
Q&ATrending
Headless vs headed browser testing — when do you run headed locally?Most people run headed during development and headless in CI. But I'm curious about the exceptions: - When do you run…
889 views30
31
0
Q&ATrending
When should you use Playwright component testing vs full E2E tests?Playwright now supports component testing (React/Vue/Svelte) which blurs the line with E2E tests. In practice I'm…
887 views31
31
0
Q&ATrending
Using LLMs to detect flaky test patterns — any practical experience?I had an idea: take our flaky test history (test name, failure messages, stack traces, timestamps) and feed it to an…
885 views31
28
0
Q&ATrending
How do you handle API rate limiting in automated test suites?Our test suite hits a third-party API (Stripe sandbox) and we occasionally get 429s in CI, causing random test…
858 views28