Staff SW Engineer - Bigdata/Hadoop, Data Platform
- Bengaluru, Karnataka, India
As the world's leader in digital payments technology, Visa's mission is to connect the world through the most creative, reliable and secure payment network - enabling individuals, businesses, and economies to thrive. Our advanced global processing network, VisaNet, provides secure and reliable payments around the world, and is capable of handling more than 65,000 transaction messages a second. The company's dedication to innovation drives the rapid growth of connected commerce on any device, and fuels the dream of a cashless future for everyone, everywhere. As the world moves from analog to digital, Visa is applying our brand, products, people, network and scale to reshape the future of commerce.
At Visa, your individuality fits right in. Working here gives you an opportunity to impact the world, invest in your career growth, and be part of an inclusive and diverse workplace. We are a global team of disruptors, trailblazers, innovators and risk-takers who are helping drive economic growth in even the most remote parts of the world, creatively moving the industry forward, and doing meaningful work that brings financial literacy and digital commerce to millions of unbanked and underserved consumers.
You're an Individual. We're the team for you. Together, let's transform the way the world pays.
We are looking for a Staff SW Engineer, to be the single point of contact for some of our key Business & Technology Partners in Data Platform. Our Data Platform is evolved towards Big Data and Open source technologies, driving adoption across Visa’s technology organizations. In this role, you will define, drive and lead the technology solutions for the business problems and facilitate the delivery of the solution.
Lead and define engineering solutions to complex use cases that can be delivered on the Data Platform.
Excellent understanding and Hands on experience on Big Data technologies like Hadoop, Hive, Spark (with Scala or Java), Hbase, Impala, Kafka, Oozie, Sentry, YARN etc.
Good debugging skills and problem solver. Must be able to think out of the box to provide alternate approaches to a problem and achieve the milestones.
Good experience working with internal/external partners and be able to perform design, architecture & code reviews.
Work closely with Bangalore based technology and development teams, to deliver programs through cross-functional and multi-location teams.
Contribute and enhance Data Platform capability by bringing new technologies through tool evaluations, conducting PoCs and working with management.
Must be able to work independently with minimal supervision and supplemental engineering support, while responding quickly and efficiently to multiple program priorities.
Build strong relationship with partners and other technology teams.
10+ years of relevant work experience managing and delivering large and complex software solutions.
Extensive experience in Big Data ecosystem using Hadoop, HBase, Spark, Kafka, Hive and Java technologies. Experience on Cloudera Hadoop Distribution is preferred.
Nice to have – knowledge of one of the Stream processing frameworks (Spark Streaming/Storm/Flink).
Nice to have – understanding of search platforms either Solr or Elastic search
Strong understanding of OLTP, Data Lake, Data Integration and ETL & ELT technologies.
Nice to have – knowledge of OLAP and data cubes.
Advance knowledge in multiple design patterns for real-time and batch processing use cases.
Fluent in data platform architectural principles, engineering principles and implementation of distributed and parallel computing solutions.
Strong technical vision, exceptional communication skills, including the ability to effectively
communicate and negotiate with partner architects.
Ability to work closely and interact with multi-location cross platform teams from business and technology.
Ability to handle multiple competing priorities in a fast-paced environment.
Undergraduate degree in Computer Science or Engineering discipline, Master’s Level from a top tier school is preferred.
All your information will be kept confidential according to EEO guidelines.