Senior Manager, Quality Engineering

3 days ago

Apply Now

Receive Emails with Similar Jobs

Panasonic North America

WebsiteLinkedInAll Job Openings

Panasonic North America is a subsidiary of the multinational electronics company Panasonic Corporation. It specializes in a wide range of products and solutions in various sectors such as consumer electronics, automotive, industrial equipment, and renewable energy. The company is dedicated to creating innovative technologies that enhance the quality of life and promote sustainability. With a focus on connectivity and smart solutions, Panasonic North America aims to support businesses and consumers in achieving their goals in an increasingly digital world.

Complete home, business and industrial solutions

10,000+ employees

🔧 Hardware

📋 Description

• Lead a team of QA engineers, mentoring talent and fostering a culture of quality throughout the development lifecycle • Ensure quality across Panasonic Well’s main product offerings including Umi, an AI-powered wellness coach, partnering with key engineering, SRE, and Security leaders. • Develop comprehensive testing strategies for AI-powered applications, including evaluation frameworks that measure model performance and reliability • Partner with Product and Engineering teams to define quality metrics that balance product innovation with reliability • Design and implement automated testing infrastructure that scales with our AI products • Establish processes for regression testing, user acceptance testing, and continuous quality improvement • Analyze quality metrics to identify trends and recommend improvements to products and processes • Stay current with emerging QA methodologies and tools particularly relevant to AI systems • Design and implement robust evaluation benchmarks for large language model capabilities, safety, and alignment • Develop testing frameworks to detect and mitigate harmful model outputs, hallucinations, and potential misuse risks • Collaborate with research teams to translate frontier AI safety research into practical testing methodologies • Stay informed of the AI teams’ systems to measure and track model performance across diverse use cases and deployment scenarios • Lead red-teaming exercises to identify potential vulnerabilities in AI systems • Define clear criteria for model release readiness from a quality and safety perspective • Create scalable processes for human evaluation of model outputs across multiple dimensions

🎯 Requirements

• 10+ years of experience in Quality Assurance, with at least 7 years in a leadership role • Demonstrated experience developing testing strategies for AI/ML-powered applications • Strong understanding of AI evaluation frameworks, agentic AI, prompt testing, and alignment methodologies • Experience with automation frameworks and CI/CD pipelines • Excellent communication skills and ability to collaborate across technical and non-technical teams • Track record of building and scaling QA processes in fast-paced environments • Bachelor's degree in Computer Science or related field (or equivalent experience) • Expertise driving and delivering testing solutions for complex AI/ ML technology programs or products from inception to delivery. Including technical program/project management for consumer software products with AI, Data, and Cloud Infrastructure backgrounds. Health, lifestyle, and wellness experience is a plus. • Strong collaboration and communication skills. • Experience in working with cloud-based platforms and services. • Excellent written and verbal communication skills, with the ability to articulate technical concepts to both technical and non-technical stakeholders effectively. • Demonstrates critical thinking capabilities with strong attention to detail. • Understands and deals well with rapid development cycles and constant change remains flexible and calm when facing uncertainty. • Has the ability to find innovative ways to resolve problems both technical and processes. • Experience with large language model evaluation and testing • Familiarity with AI safety and alignment concepts • Knowledge of testing tools specific to machine learning systems • Experience in a high-growth tech company • Experience with model monitoring and observability in production environments • Knowledge of relevant regulatory considerations and standards for AI systems • Experience working directly with machine learning practitioners and AI researchers

🏖️ Benefits

• Competitive compensation • Comprehensive benefits (Medical, Dental, Vision, HSA, FSA) • 401(k) with employer match • Life & Short Term Disability Insurance • Supplemental Medical Coverage • Unlimited Vacation & Accrued Sick Leave • 12 Company Holidays • Paid Maternity & Parental Leave • Paid Caregiver Leave • Employee Assistance Program • Group and 1-on-1 Career Coaching • Pet Insurance • Casual Dress Code • Catered Lunch & Snacks • Discounts on Panasonic products • Company Social Events