Big Data Engineer

  • Full-time

Company Description

Pet360 - Company Overview

 

Pet360 believes in pet parenting and using the Web to address the unique needs of pet parents through engaging media experiences, a diverse social community, and streamlined shopping.  We want to know our customers’ pets and provide them the tools and information to be the best pet parents possible.


We are an agile software development shop, leveraging Scrum & Kanban, user stories, short release cycles, test-driven development (TDD) and continuous integration, to drive the evolution of our highly scalable and reliable enterprise-level eCommerce, Social, Mobile, Content, Ad Serving and Big Data applications.


Does the following sound like you?

...takes pride in the ability of their team to keep things running

...is never satisfied with past accomplishments

...enjoys being the go-to person for answers

...collaborates to produce the best solutions and to communicate ideas clearly

...takes the initiative to solve problems that they identify

...thrives in a fast paced environment


We're looking for someone who is:

 

Results Focused: You have an obsessive focus on shipping software that improves the lives of your users and the business of your company.

Pragmatic: You're not religious about any particular technology or methodology. You've worked with many, and you probably have strong opinions, but you use what is best for the project at hand.

Humble: You don't feel the need to prove how smart you are by writing your own ORM. You make responsible (often boring) technology decisions at work and play with crazy new things at home.

Relentlessly Resourceful: Simply put, you get stuff done. You don't ask for permission to do your job. When you're blocked, you figure out how to get unblocked.

We don't care about your major or your GPA. We care about what you've done and what you can do.


As a member of the Technology Team, you'll be responsible for improving our existing applications (which are visited by over 10 million pet parents each month), building engaging new consumer experiences, and helping to build a world-class engineering culture.

 

Job Description

Big Data Engineer

 

We’re looking for a Big Data/Hadoop Engineer whose primary responsibility is to make sure that our databases are brilliantly designed, and are performing like a well-oiled machine.  This position will be a part of the team that analyzes our (and fixes) our schema to make sure it’s well designed, optimized for performance and scalability, and meets all of the standards that we will help to set. The Database Engineer will assist the Data Warehouse Engineers in building a data warehouse and a high-performance reporting solution with that data, so an understanding of how transactional data becomes analytical data would be extremely useful. 

 

We're looking for an individual that can handle working in a fast-paced Agile environment; the ideal candidate will have a strong dedication to process, standardization, documentation. Such an individual should view producing good documentation and maintaining tight configuration management as mission critical activities, because as any good database person knows: database designs are a lot harder to change than software designs once they make it in to production. The Engineer needs to exercise independent judgment in developing methods, techniques, and evaluation criteria for obtaining results.

 

This position requires a self-starter, willing to take on large and small challenges while operating under general supervision.

Qualifications

Duties and Responsibilities:

  • Ability to understand complex business requirements/business goals/ drivers and drive solutions aligning to strategy, taking cost and risks into considering all alternatives
  • Acts as the SME for Big Data related technology to address application integration and infrastructure framework related questions
  • Guides delivery teams to ensure solutions developed within a domain have been properly implemented in accordance to the agreed upon application architecture
  • Provides architectural leadership and ensures alignment with industry best practices
  • Assess new technologies as related to solving business problems. Includes conducting Proof of Concepts to assess quality, preparing cost-benefits analysis to justify change and writing requests for proposals from vendors
  • Ability to communicate with Business Leaders
  • Design, deploy and maintain all aspects of the Hadoop ecosystem
  • Work with development teams to make the best schema designs that balance feature requests with performance concerns
  • Monitor and tune the performance of the Hadoop ecosystem
  • Analyze and make decisions about optimization of existing schemas and queries for all RDBMS database instances
  • Troubleshoot, perform problem isolation and correct problems discovered in production databases
  • Design maintainable databases for highly available and reliable solutions to meet service levels.
  • Follow change management procedures and help to create policies and best practices for all database environments
  • Ensure the development and use of an effective preventive maintenance program suitable to meet the operation objective of "99.9% availability"
  • Reduce or eliminate production problems by analyzing production usage information and using that information to come up with better designs
  • Frequently called upon to solve problems; has strong problem solving skills and the ability and desire to learn new technologies rapidly
  • Able to deal effectively with internal and external groups including development teams and vendors

 

Competencies: 

  • 5 to 7 years of relevant experience
  • Experienced with the Hadoop ecosystem and toolset – HDFS, MapReduce, Pig/Hive, Hbase, Cascading, Cascalog, etc.
  • Several years of experience programming in both compiled languages (Java, Scala, or Clojure or other JVM-based language preferred) and scripting languages (PHP, Python or Ruby preferred)
  • Experience in database performance analysis, tuning and capacity planning
  • Ability to analyze and change schema design and articulate performance impacts
  • Experience working in a SaaS environment
  • Knowledge of database scalability principles
  • Ability to work with development teams in an Agile environment to develop new features and modify existing features with a “design for the future” mentality for the schema
  • Some knowledge of database administration in a high-volume, highly-available environment
  • Hands-on database troubleshooting experience, including tracking down problematic queries and configurations
  • Interest or experience in using alternative database solutions, such as NoSQL technologies
  • Firm grasp of Linux system administration fundamentals in relation to applications and databases
  • Ongoing effort to maintain skills and knowledge at the state of the art level
  • Ability to maintain confidentiality with sensitive customer and internal information
  • Strong interpersonal, written and oral communication skills
  • Proven ability to effectively prioritize and execute tasks in a team-oriented, collaborative work place
  • Self reliant, articulate, approachable and comfortable with a rapidly changing environment
  • Exposure to, or strong desire to learn, streaming data processing frameworks such as Spark, Streaming, Storm, or Samza
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture

Additional Information

Why You'll Love Pet360

 

If this sounds like you, we desperately want to meet you. Here are just a few of the reasons we love working for Pet360:


Culture of transparency and trust. Every single pack member gets a monthly report detailing sales, page views, visits, ad revenue, and much more. As a member of the engineering team you'll have much more data.

 We're a small team which means everyone can make a big contribution to our business. Competitive salary and benefits (Medical, Dental, 401k with company match). Generous discount for pet products.