Lead Software Engineer Big Data

  • Full-time
  • Job Family Group: Technology and Operations

Company Description

As the world's leader in digital payments technology, Visa's mission is to connect the world through the most creative, reliable and secure payment network - enabling individuals, businesses, and economies to thrive. Our advanced global processing network, VisaNet, provides secure and reliable payments around the world, and is capable of handling more than 65,000 transaction messages a second. The company's dedication to innovation drives the rapid growth of connected commerce on any device, and fuels the dream of a cashless future for everyone, everywhere. As the world moves from analog to digital, Visa is applying our brand, products, people, network and scale to reshape the future of commerce.

At Visa, your individuality fits right in. Working here gives you an opportunity to impact the world, invest in your career growth, and be part of an inclusive and diverse workplace. We are a global team of disruptors, trailblazers, innovators and risk-takers who are helping drive economic growth in even the most remote parts of the world, creatively moving the industry forward, and doing meaningful work that brings financial literacy and digital commerce to millions of unbanked and underserved consumers.

You're an Individual. We're the team for you. Together, let's transform the way the world pays.

 

Job Description

The Data Product Development division is part of the Visa’s technology organisation. The division is responsible for providing value added product and services to our clients and for internal use. The client access to these services are enabled through a set of Data API, BI and Analytics products, Custom applications, Data Streaming & Visualisation . The data access is enabled via Web, Mobile and Web services. The BI product group is part of the Data Product Development division that develop and manages various BI and Analytics products and services.

Responsibilities:

The role is a self organised Lead Software Engineer with a solid background in implementing substantial applications at the back-end on Big Data (Hadoop & Spark) ecosystem right from ETL to batch based access via API. Architecture, design & development of various BI products and services and the end to end implementation of these services. The system involves many technologies some of which are developed using Java/J2EE, Python, MySQL and messaging technologies.

The role requires taking products developed by the team to production with adherence to due process from Dev to QA to Sandbox to Production and hence release plan, identifying and aligning tasks and their priorities, ensuring that there is end to end ownership with various components, working with release engineering, reliability engineering and support teams to ensure Tier 0 through to 4 applications have high availability and scalability & resiliency from failure.

The job will also require setting up disaster recovery plan with various teams and ensuring that all external facing products are certified appropriately.

The candidate is also responsible for security of data and systems like all engineers at Visa and requisite security compliance of systems.

The candidate will also be responsible for providing technical guidance to the team members and communicate clearly and well to ensure product stakeholders and engineering leadership are all on the same page with product status and requirements.

 

Qualifications

Qualifications

•BS / MS in Computer Science, or Information Systems or equivalent experience.

Must Have 

  • Experience as software engineer: 8-15 years
  • Big Data & NoSql Ecosystem:
    • Hadoop, Hive, Spark, ETL and workflow plus schedulers 
    • Operating knowledge of at least one of HBase or Mongo DB or Cassandra. 
    • Query optimisation a big plus.
  • Languages:
    • Must: Python, Scala, Shell Script, SQL, Basic Java
    • OOPs concepts
  • Basic Knowledge of Data Science desirable.
  • SDLC and knowledge of product life cycle a must
  • Ability to lead projects and guide engineers
  • Be able to participate in multiple System Design and code review
  • Good team player a must.
  • Must have worked using agile methodology and Continuous Integration and Continuous Deployment
  • Must be able to be an individual contributor and a self-starter
  • Good working knowledge of GIT a must.
  • Development experience in a Cross-platform, multi-tier environment
  • Relational database and SQL development experience
  • Work with different cross functional team.
 

Desirable 

  • Languages:
    • R, Java, C
  • Libraries & Environments:
    • Spring Boot, Django
  • Development experience in Cloud/Virtual environments a plus
  • Message based application development using JMS, MQ Series/Rabbit MQ desirable
  • Meta data driven development
  • Experience in implementing search using Elasticsearch, Solr is a plus
  • Experience in integrating third party APIs
  • BI tools such as Microstrategy, Tableau knowledge is a plus

Additional Information

Be up for a fun coding challenge in the interview. Come prepared to spend 6 hours to test your engineering and technical endurance.

REF24029X

 

Privacy Policy