Q&ATrending
Flaky test quarantine in CI — auto-retry, dedicated quarantine job, or just fix them?Our flake rate is ~4% per test in CI (down from 9% after a big cleanup push). With 800 tests that means ~32 flaky…
1.7k viewsBe the first to answer
15 discussions
Q&ATrending
How do you test third-party integrations — mock, sandbox, or contract?We integrate with: Stripe (payments), SendGrid (email), Twilio (SMS), and Segment (analytics). Each has a sandbox/test…
1.4k viewsBe the first to answer
Q&A
How do you test WebSocket connections reliably in Playwright?We have a real-time dashboard that uses WebSockets and I'm struggling to write reliable tests for it. The main…
567 viewsBe the first to answer
Q&ATrending
How do you handle API rate limiting in automated test suites?Our test suite hits a third-party API (Stripe sandbox) and we occasionally get 429s in CI, causing random test…
884 viewsBe the first to answer
Q&ATrending
What is your systematic approach when a test passes locally but fails in CI?This is the most frustrating debugging scenario I encounter regularly. Test passes 100% locally, fails 30–80% in CI. My…
2.2k viewsBe the first to answer
Q&ATrending
Systematic approach to fixing StaleElementReferenceException in Selenium?StaleElementReferenceException is the bane of our Selenium suite. We get maybe 20–30 per CI run across 800 tests,…
1.2k viewsBe the first to answer
Q&ATrending
How do you prevent pytest fixture scope mismatches from causing silent test pollution?We had a bug where a function-scoped test was accidentally using a session-scoped fixture that mutated shared state.…
731 viewsBe the first to answer
Q&ATrending
Using LLMs to detect flaky test patterns — any practical experience?I had an idea: take our flaky test history (test name, failure messages, stack traces, timestamps) and feed it to an…
901 viewsBe the first to answer
Q&A
How are you handling flaky tests in your CI/CD pipeline?Flaky tests are killing our team's confidence in the test suite. We're seeing around 8–12% flake rate on our Playwright…
34 viewsBe the first to answer
Q&ATrending
Shared test environments vs per-test isolation — how do you decide?We have two camps on our team: Camp A (shared environment): Tests run against a shared staging server. Fast to set up,…
1.2k viewsBe the first to answer
Q&ATrending
Strategy for testing APIs that call third-party services — mock, contract, or live?Our payments API calls Stripe, our notifications API calls SendGrid, and our geolocation API calls Google Maps. All…
1.4k viewsBe the first to answer
Q&ATrending
How do you handle timezone-related test failures in a distributed team?We have engineers in India, UK, and US. Our tests occasionally fail due to timezone-dependent logic: - Date range…
943 viewsBe the first to answer
Q&ATrending
Testing microservices — how do you balance service isolation vs full integration tests?We have 8 microservices. Testing strategy question: where do you draw the line between testing each service in…
1.8k viewsBe the first to answer
Q&ATrending
Database testing strategies when your team does not own the database schema?We're an SDET team testing a service that uses a database we don't own — the schema is managed by a platform team and…
970 viewsBe the first to answer
DiscussionTrending
Using observability (logs, metrics, traces) as part of your testing strategyMost testing focuses on the output: did the API return the right response? But I've started treating observability as a…
3.6k views