Senior Principal Architect, Big Data

  • Full-time
  • Department: IT

Company Description

PubMatic is the leading marketing automation software company for publishers. Through real-time analytics, yield management, and workflow automation, PubMatic enables publishers to make smarter inventory decisions and improve revenue performance. Focused on serving the needs of premium publishers, PubMatic inspires buyer confidence by providing flexibility in audience discovery and planning media campaigns through its Media Buyer Console and APIs. The company's marketing automation software platform provides a global roster of comScore publishers with a single view into their advertiser relationships across every screen, every channel and every format. PubMatic was ranked by Deloitte as one of the fastest growing companies in the US for the fourth consecutive year in 2015. The company has offices worldwide, and is headquartered in Redwood City, California

Job Description

PubMatic is the technology platform that powers the programmatic advertising strategy of leading publishers and premium brands.

Reporting to the Director of Engineering, the Snr. Principal Architect (Big Data) is a hands on engineering position responsible for technical direction for the entire big data platform at PubMatic. The successful candidate will be responsible for managing a large scale data platform with 7 Petabytes of storage across hundreds of millions of users, with over 20 Terabytes of new data being ingested every day, via a platform that serves over 5 trillion advertiser bids per month, across display, mobile, video, native and other formats of advertising. S/he will provide technical guidance to a team of Big Data engineers who are building the platform and innovating in core areas of big data, real time analytics, and large-scale data processing.


Responsibilities:

  • Design, guide, innovate the Big Data platform, big data infrastructure, and big data workflow at PubMatic, scaling to 20PB in size, across multiple data centers, geographies and time zones. 
  • Drive the architecture/design decisions needed to achieve cost-effective and high performance results
  • Mentor big data engineers in software development, technology and processes.
  • Cultivate sustained innovation to deliver exceptional products to customers
  • Provide solutions for technical escalations for escalations that come to the engineering
  • Troubleshoot complex issues discovered in-house as well as in customer environments.
  • Conduct feasibility analysis, produce functional and design specifications of proposed new features.

Qualifications

  • Minimum experience: 10 years
  • Bachelors or Master’s Degree in Engineering
  • 3+ years of experience designing and implementing big data processing pipelines with a combination of the following technologies: Spark, Scala, Kafka, and HBase.
  • 10+ years coding experience in Java, with solid CS fundamentals including data structure and algorithm design, and creation of architectural specifications.
  • 10+ years contributing to R&D and production deployments of large backend systems, with at least 3 years supporting big data use cases.
  • Should have experience working at a fast moving and startup type of environment for the past 2-3 years
  • Expertise handling Spark Ecosystems on Linux platform
  • Implementation of professional software engineering best practices for the full software development life cycle, including coding standards, code reviews, source control management, documentation, build processes, automated testing, and operations.
  • A passion for developing and maintaining a high quality code and test base, and enabling contributions from engineers across the team.
  • Demonstrated ability to achieve stretch goals in a very innovative and fast paced environment.
  • Demonstrated ability to learn new technologies quickly and independently.
  • Excellent verbal and written communication skills, especially in technical communications.
  • Strong inter-personal skills and a desire to work collaboratively.

Additional Information

All your information will be kept confidential according to EEO guidelines.