Lead / Senior Staff Hadoop Engineer, Data Platform

  • Full-time
  • Job Family Group: Technology and Operations

Company Description

As the world's leader in digital payments technology, Visa's mission is to connect the world through the most creative, reliable and secure payment network - enabling individuals, businesses, and economies to thrive. Our advanced global processing network, VisaNet, provides secure and reliable payments around the world, and is capable of handling more than 65,000 transaction messages a second. The company's dedication to innovation drives the rapid growth of connected commerce on any device, and fuels the dream of a cashless future for everyone, everywhere. As the world moves from analog to digital, Visa is applying our brand, products, people, network and scale to reshape the future of commerce.

At Visa, your individuality fits right in. Working here gives you an opportunity to impact the world, invest in your career growth, and be part of an inclusive and diverse workplace. We are a global team of disruptors, trailblazers, innovators and risk-takers who are helping drive economic growth in even the most remote parts of the world, creatively moving the industry forward, and doing meaningful work that brings financial literacy and digital commerce to millions of unbanked and underserved consumers.

You're an Individual. We're the team for you. Together, let's transform the way the world pays.

Job Description

  • Provide technical leadership for the Center of Excellence.
  • Collaborating with partners from business and technology organizations, develop following key deliverables: Information product and data platform strategy, Data Operations, Data availability, roadmap and proposals Information products and platform optimization.
  • Working closely with development, engineering and operation teams, jointly develop following key deliverables ensuring production scalability and stability: Conceptual architecture and detailed design
  • Project budget estimate and funding request Implementation plan
  • Develop various facets across platforms to cater real-time data processing requirements and provide L2, L3 Support for Large Clusters across DB2, Hadoop, SAS and BI.
  • Able to help and Guide L1 support engineers to fix day-to-day Operational issues.
  • Perform Tuning and Increase Operational efficiency on a continuous basis.
  • Formulate methods to enable consistent Data loading and optimize Data operations.Monitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvements.
  • Evaluate and introduce technology tools and processes that enable Visa to develop products and solutions, to embrace business opportunities and/or improve operational efficiency.
  • Work directly with project development teams to enable successful project implementation.
  • Work with Architecture and Development teams to understand usage patterns and work load requirements of new projects in order to ensure the Hadoop platform can effectively meet performance requirements and service levels of applications.
  • Develop and enhance platform best practices and educate Visa developers on best practices.

Qualifications

  • A minimum of 12 years of technical experience with a focus on open source and large data implementations in the Petabyte range.
  • Business acumen and technical expertise are both required for the role.
  • Experience with multiple open source tool sets in the Big Data space.
  • Experience with both traditional waterfall and iterative rapid release methodologies.
  • Proven track record developing and launching products at scale.
  • Possess significant functional knowledge including product development, marketing, payment and product risk.
  • A minimum of 5 years of experience as technical lead organizing and mentoring junior. and intermediate level developers.
  • Experience leading technical teams of 5 to 10 people.
  • Minimum of four-year technical degree required.
  • Experience in tool Integration, automation, configuration management in GIT, Jira platforms.
  • Excellent oral and written communication and presentation skills, analytical and problem solving skills.
  • Self-driven, ability to work independently and as part of a team. Experience on Cloudera distribution preferred.

Additional Information

All your information will be kept confidential according to EEO guidelines.

REF3865N

Privacy Policy