Senior Software Engineer in Test

Napster
Napster

Software Engineering

Poland

Posted on Jul 8, 2026
Apply now

Location: US, Remote; Poland, Ukraine

Title: Senior Software Developer in Test (SDET)

Department: Technology

About Napster

Founded on the principle of democratizing access—first to music in 1999, now to creative expertise in 2025—Napster has consistently been at the forefront of transformational technology shifts that expand markets and empower users. The company’s latest platform turns passive consumers into active creators, providing the interface layer between foundation AI models and human creativity. For more information, visit napster.com.

About the Role

Napster is looking for a Senior Software Developer in Test to own test infrastructure strategy for our real-time AI agent platform. This is not a QA-as-afterthought role. You'll be embedded in the engineering organization, making framework decisions that outlast any single sprint, leading the team toward scalable automation patterns across both deterministic and AI-driven systems, and building load testing tooling that gives us confidence before production sees a spike - with scope that grows beyond this product over time.

What You'll Own

Test Framework Architecture

  • Evaluate, propose, and drive adoption of test frameworks across the stack - including tooling for real-time, stateful session testing alongside conventional API and UI frameworks - with documented rationale, not just convention
  • Define project structure, configuration standards, and execution model across multiple test layers: unit, contract, real-time/protocol, AI behavioral, and end-to-end
  • Establish patterns for test data management, environment configuration, and cross-service dependency handling
  • Champion a test pyramid strategy suited to a system that combines standard request/response APIs with persistent, real-time sessions

Automation Leadership

  • Lead automation design reviews - define what gets automated, at what layer, and why
  • Establish and document automation patterns: service abstractions, fixture strategies, retry logic, test isolation contracts, and behavioral baselines for systems with non-deterministic output
  • Mentor engineers on writing testable code and maintainable specs; conduct test code reviews with the same rigor as production code reviews
  • Drive shift-left practices: bring testing into the design phase, not just the PR stage

Load & Performance Testing Tooling

  • Design and build internal load testing tooling and harnesses (extending k6, Locust, or Gatling) tailored to concurrent, real-time session load - not just standard HTTP throughput
  • Develop reusable libraries for traffic shaping, scenario composition, and result aggregation
  • Integrate load tests into CI/CD with configurable thresholds and automated regression alerts
  • Build dashboards and reporting pipelines that translate raw load test output into actionable signals for engineering and product

AI System Quality & Real-Time Reliability

  • Build evaluation harnesses for systems with non-deterministic, AI-generated output — defining what "passing" means in terms of statistical baselines and acceptable variance, not exact-match assertions
  • Own test coverage for real-time, stateful protocols, including session lifecycle, data stream integrity, and timing-sensitive interaction handling
  • Partner with engineering to identify where AI output quality and system reliability intersect, and design tests that catch regressions in both

Platform & Infrastructure

  • Own test infrastructure: parallel execution environments, CI integration, flakiness detection, and test result observability
  • Partner with DevOps/Platform teams to ensure test environments are production-representative
  • Identify and remediate sources of test flakiness systematically

What We're Looking For

Required

  • 4+ years of software engineering experience, with at least 2 years focused on test infrastructure, tooling, or automation engineering
  • Strong proficiency in TypeScript/JavaScript; additional experience with Python or Go a plus
  • Demonstrated experience proposing and implementing a test framework from scratch or significantly evolving an existing one
  • Hands-on experience with load testing tools (k6, Locust, Gatling, JMeter, or equivalent) and the judgment to extend them
  • Experience testing real-time, streaming, or other stateful/long-lived connection systems (e.g., WebSocket, gRPC streaming, message queues)
  • Solid understanding of distributed systems concepts: request lifecycle, async patterns, eventual consistency, timeouts
  • Experience integrating automated tests into CI/CD pipelines

Preferred

  • Experience testing or building systems involving LLMs or other non-deterministic AI components, including eval frameworks
  • Familiarity with telephony, VoIP, or other low-level communication protocols
  • Experience building internal developer tooling (CLIs, test runners, reporting dashboards)
  • Familiarity with observability tooling (Grafana, Datadog, Prometheus) for correlating load test results with system metrics
  • Knowledge of contract testing (Pact or similar)
  • Experience in a platform or infrastructure engineering role

Our Culture

  • Impact: Play a crucial role in our growth journey.
  • Culture: Join a vibrant team valuing creativity and collaboration.
  • Growth: Thrive in a fast-paced, dynamic environment.
  • Reward: Enjoy competitive compensation, equity opportunities, and comprehensive benefits.
  • Ready to shape our future? Apply now and be part of something extraordinary!

We’re looking for more forward-thinking, collaborative people to be part of our innovation journey and mission to push the boundaries of technology. If you’re ready to help us achieve this vision, we’d love to hear from you! At Napster Corp, we're looking for people who are invigorated by our values and driven to change the world, not those who simply check off boxes.

Napster Corp embraces a diversity of backgrounds and experiences and provides equal opportunity for all applicants and employees. We strive to build a company that reflects a global audience.

Apply now
See more open positions at Napster