REF4276E - Hadoop Capacity Planning Engineer

  • Full-time
  • Job Family Group: Technology and Operations

Company Description

Common Purpose, Uncommon Opportunity. Everyone at Visa works with one goal in mind – making sure that Visa is the best way to pay and be paid, for everyone everywhere. This is our global vision and the common purpose that unites the entire Visa team. As a global payments technology company, tech is at the heart of what we do: Our VisaNet network processes over 13,000 transactions per second for people and businesses around the world, enabling them to use digital currency instead of cash and checks. We are also global advocates for financial inclusion, working with partners around the world to help those who lack access to financial services join the global economy. Visa’s sponsorships, including the Olympics and FIFA™ World Cup, celebrate teamwork, diversity, and excellence throughout the world. If you have a passion to make a difference in the lives of people around the world, Visa offers an uncommon opportunity to build a strong, thriving career. Visa is fueled by our team of talented employees who continuously raise the bar on delivering the convenience and security of digital currency to people all over the world. Join our team and find out how Visa is everywhere you want to be.

Job Description

This role is  that of an experienced Hadoop capacity planner responsible for ensuring that adequate infrastructure is planned and implemented to meet the needs of a growing and transforming Visa IT environment.  In this individual contributor position, you will be responsible for: 


  • Developing, maintaining, and presenting capacity plans for Visa's rapidly growing Hadoop infrastructure.
  • Creating capacity models using history and known future demand that will forecast future infrastructure needs and plan for what-if scenarios such as fail-over at various levels. Models will consider I/O capacities as well as memory and compute
  • Engaging with project teams on major initiatives to understand traffic volumes, work flows and hardware requirements to plan for adequate capacity
  • Using Cloudera, vCenter, Splunk, Cloud Optimizer and other capacity planning tools for server capacity planning analysis and evaluation.
  • Ensuring adequate capacity for all resources is maintained at the virtualized level as well as the physical level.
  • Providing virtualized capacity planning visibility for multiple hypervisors such as VMware, Hyper-V, and KVM.
  • Coordinating effectively with the Storage Capacity Planning staff and with other Engineering staff to ensure adherence to standards and guidelines
  • Providing expert advice for assisting in the choice of server vendors and server configurations as well as for tool evaluation and purchase.
  • Actin as a 3rd level Technical support for Infrastructure related challenges.

Qualifications

  • Technical depth of Hadoop, HDFS, Spark, Hive, Yarn and other distributed database components.
  • Extensive experience in Capacity Planning, and the metrics underlying the discipline are necessary, as are strong analytical skills in advanced mathematics and data science techniques.
  • Solid knowledge of the concepts of x86 virtualization are necessary for VMware and optional for Hyper-V and KVM
  • Knowledge of tools for server capacity planning analysis and evaluation such as Cloudera, VMware VROPS, vCenter, Splunk, Cloud Optimizer, and SCOM
  • Degree in Computer Science and at least 5 years industry experience in Capacity Planning and Server Administration with a good background in managing and planning servers in both dedicated and virtualized environments

Additional Information

All your information will be kept confidential according to EEO guidelines.

Privacy Policy