ML QA Engineer

  • Mumbai, Mumbai, Maharashtra, India
  • Full-time
  • Department: QA

Company Description

PubMatic (Nasdaq: PUBM) is an independent technology company maximizing customer value by delivering digital advertising’s supply chain of the future. PubMatic’s sell-side platform empowers the world’s leading digital content creators across the open internet to control access to their inventory and increase monetization by enabling marketers to drive return on investment and reach addressable audiences across ad formats and devices. Since 2006, our infrastructure-driven approach has allowed for the efficient processing and utilization of data in real time. By delivering scalable and flexible programmatic innovation, we improve outcomes for our customers while championing a vibrant and transparent digital advertising supply chain.

Job Description

As a Machine learning QA engineer, you will work closely with the Product Management, Data scientist and ML Analyst to understand the ML algorithm requirements. You will be setting the ML QA team’s technical vision and roadmap, developing ML test strategies and tracking project schedules. The successful ML-QA has strong technical aptitude and is obsessed with continuous quality improvement in ML field; they are experienced and highly committed to creating world class automation for feature testing and regression for different ML models. 

Responsibilities: 

  • Design, develop and review test automation tools, frameworks for distributed systems and machine learning models. 
  • Understanding of machine learning techniques, data structures, algorithms, statistics. 
  • Proficiency of python language, working knowledge of pytest is a plus. 
  • Drive improvements in the existing automation framework to improve quality and maintainability.  
  • Strong experience setting up automated test systems using Jenkin to build various full stack testing suites. 
  • Work closely with Project Architects to make sure that the functional, non-functional requirements are properly addressed and traced in the solution architecture  
  • Develop and maintain domain, product and process knowledge to directly influence the product quality, software engineering productivity and development process maturity 
  • Provide technical leadership and direction to testing team members to adherence to coding, quality, functionality, performance, scalability and on-time delivery standards. 
  • Define, improve and automate metrics collection and reporting 
  • Drive test effectiveness and efficiencies throughout the team 
  • Drive research of industry trends and apply best practices in quality engineering practices used in evolving machine learning techniques. 
  • Provide consulting services on techniques to achieve of quality goals through education, training, coaching and collaboration 
  • Keep current on new technologies and make recommendations on future direction for quality engineering as well as apply latest techniques and industry information as appropriate. 

Qualifications

  • Bachelors in Computer Science/ Engineering; Masters is desirable.

  • 1 to 3 years of experience in distributed application testing   

  • Exposure of Machine Learning algorithms 

  • Expertise in developing the automation suites, frameworks for verification of distributed systems and machine learning models 

  • Demonstrated experience designing scalable and maintainable automated testing solutions for large scale systems 

  • Working knowledge of load generation/load balances/Controllers/performance measurement software 

  • Demonstrated ability to learn and apply new technology, tools and process.

  • Excellent English written and verbal communication skills 

  • Demonstrated collaborative and mentoring skills 

  • Experience of working in an agile environment 

 

#LI-MD1

Additional Information

Return to Office: PubMatic employees throughout the global have returned to our offices via a hybrid work schedule (3 days “in office” and 2 days “working remotely”) that is intended to maximize collaboration, innovation, and productivity among teams and across functions. All PubMatic employees in the US and India are required to be fully vaccinated to return to our offices. Covid-19 boosters are not required at this point in time.

Benefits: Our benefits package includes the best of what leading organizations provide, such as stock options, paternity/maternity leave, healthcare insurance, broadband reimbursement. As well, when we’re back in the office, we all benefit from a kitchen loaded with healthy snacks and drinks and catered lunches and much more!

Diversity and Inclusion: PubMatic is proud to be an equal opportunity employer; we don’t just value diversity, we promote and celebrate it. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.