Sr. Hadoop Developer (Senior Software Engineer)

  • Full-time
  • Job Family Group: Technology and Operations

Company Description

About Visa

Common Purpose, Uncommon Opportunity. Everyone at Visa works with one goal in mind – making sure that Visa is the best way to pay and be paid, for everyone everywhere. This is our global vision and the common purpose that unites the entire Visa team. As a global payments technology company, tech is at the heart of what we do. CyberSource, a Visa company, has been and continues to be a pioneer within the e-Commerce Payment Management world. Our VisaNet network is capable of handling over 65,000 transaction messages per second for people and businesses around the world, enabling them to use digital currency instead of cash and checks.

We are also global advocates for financial inclusion, working with partners around the world to help those who lack access to financial services join the global economy. Visa’s sponsorships, including the Olympics and FIFA™ World Cup, celebrate teamwork, diversity, and excellence throughout the world. If you have a passion to make a difference in the lives of people around the world, Visa offers an uncommon opportunity to build a strong, thriving career. Visa is fueled by our team of talented employees who continuously raise the bar on delivering the convenience and security of digital currency to people all over the world. Join our team and
find out how Visa is everywhere you want to be.

“Visa will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of Article 49 of the San Francisco Police Code.”

Job Description

As a Senior Software Engineer, you will be part of our Corporate IT Team. Corporate Information Technology (CIT) encompasses enterprise technology that empowers Visa Inc. staff to perform core business functions needed to support ongoing management of Visa Inc. operations. Corporate Business Systems (CBS) is a group in Corporate IT that provides application design and development service to support corporate systems within the Finance, Global Risk and Compliance, Sourcing, Legal, and Corporate Services portfolios. This position is for Finance team, so an experience in Finance is necessary. This includes managing system requirements, design, development, integration, quality assurance, implementation and maintenance of corporate applications. There will be interaction with customers and key stakeholders in Financial Systems Strategy (FSS), Project Management Office (PMO) & Global Operations.
 

Visa is currently seeking for a Senior Hadoop with Tableau developer experience in Finance area to deliver Corporate Analytics new strategic framework initiative. This BI platform provides analytical/operational capability to various business domains that are to be used by Corporate Finance Systems. This Developer role will be primarily responsible for designing, developing and implementing Hadoop framework ETL using relational databases and use Tableau reporting on it. The new Hadoop framework to be used to build from the scratch Oracle Financial analytics/P2P/Spend/Fixed asset solution into Hadoop framework from OBIA. The individual should have a finance business background with extensive experience in OBIA Fixed Assets, P2P, Financial analytics, Spend Analytics, and Projects. Expert in Hadoop framework components like Sqoop, Hive, Impala, Oozie, Spark, HBase, HDFS..

  • Must have experience in Spark (PySpark, Dataframes, RDD, Spark ML and Graph X is a bonus), Hive, Scoop, Kafka, Atscale.
  • Architect, Design and implement column family schemas of Hive and HBase within HDFS. Assign schemas and create Hive tables. Managing and deploying HDFS HBase clusters.
  • Develop efficient pig and hive scripts with joins on datasets using various techniques. Assess the quality of datasets fora Hadoop Data Lake. Apply different HDFS formats and structure like Parquet, Avro, etc. to speed up analytics.
  • Fine tune Hadoop applications for high-performance and throughput. Troubleshoot and debug any Hadoop ecosystem runtime issues.
  • Desired candidate should have strong programming skills on Scala or Python to work on Spark
  • Experience in converting core ETL logics using PySpark SQL or Scala language
  • Good experience on Apache Hadoop Map Reduce programming, PIG Scripting and Distribute Application and HDFS.
  • In-depth understanding of Data Structure and Algorithms.
  • Experience in managing and reviewing Hadoop logfiles and incremental and archival strategy implementation.
  • Implemented in setting up standards and processes for Hadoop based application design and implementation.
  • Experience in importing and exporting data using Sqoop from HDFS to Relational Database Systems and vice-versa.
  • Experience in Object Oriented Analysis, Design (OOAD) and development of software using UML Methodology, good knowledge ofJ2EE design patterns and Core Java design patterns.
  • Very good experience in complete project lifecycle (design, development, testing and implementation).
  • Experience in connecting Hadoop framework components to Tableau reporting
  • Expert in Tableau data blending and data modeling.
  • Create Functional and Technical design documentation
  • Perform Unit and QA testing data loads and development of scripts for data validation
  • Support QA, UAT, SIT and performance testing phases of development cycle
  • Understand and incorporate required security framework, including data level security
  • Understanding of data and business processes.
  • Experience in Finance OBIA modules and rebuild them from scratch in Hadoop framework
  • Support, design and configuration of Tableau sites, projects and corresponding security, ETL processes, dashboards and reports.
  • Liaise with internal business and IT groups(such as database administration, infrastructure support, development) in performing support activities, system configuration and standard functionality analysis for enhancement requests.
  • Adhere to defined support policies, procedures, and service levels with an understanding of SOX related IT controls.
  • Provide support to strategic initiatives as assigned including, but not limited to system configuration, testing of applications and process enhancements, upgrades and new solutions, ensuring sound knowledge transfer to assume post-implementation support role.
  • Expected to critically evaluate customer service requests and incidents to prioritize own workload, determine potential global and/or cross-modular impacts, determine temporary procedural work-around where feasible, and communicate to the broader group of impacted parties.
  • Conduct one-on-one user training or formalized, pre-developed larger group training sessions as assigned.
  • Proactively identify, evaluate, and communicate ideas for process improvements and training needs both for applications usage by customers as well as for internal processes and skills enhancement.
  • Work with L3 teams (SME) on the critical requests and resolve it to closure.
  • Responsible for global Customer Service, including end-user support and education and issue troubleshooting and resolution for all users of the Corporate Finance Analytics Production systems.
  • Mentoring the junior team members.

Qualifications

  • BS or equivalent in MIS, CS, or related field.
  • Minimum 4-6 years’ experience with Hadoop framework components (HDFS, Spark, Sqoop, Hive, Impala, Spark, Scala, Python, Oozie, Kafka, AtScale).
  • Experience in Tableau reporting tool with Hadoop.
  • Experience in ETL tools like Informatica or likewise.
  • Finance OBIA modules experience is highly recommended: Fixed assets, PSP, Spend analytics, Financial analytics.
  • Strong knowledge of database concepts, systems architecture, and data structures is a must.
  • Extensive experience with Oracle databases and SQL development.
  • Extensive hands-on experience with Linux and Windows.
  • Process oriented with strong analytical and problem solving skills.
  • Work independently and mentor other sin the team and with minimal supervision.
  • Experience with building analytical reports using Tableau required.
  • Solid understanding of ITIL methodology.
  • Java scripting experience is nice to have.

Additional Information

Common Purpose, Uncommon Opportunity. Everyone at Visa works with one goal in mind – making sure that Visa is the best way to pay and be paid, for everyone everywhere. This is our global vision and the common purpose that unites the entire Visa team. As a global payments technology company, tech is at the heart of what we do. CyberSource, a Visa company, has been and continues to be a pioneer within the e-Commerce Payment Management world. Our VisaNet network is capable of handling over 65,000 transaction messages per second for people and businesses around the world, enabling them to use digital currency instead of cash and checks. 

We are also global advocates for financial inclusion, working with partners around the world to help those who lack access to financial services join the global economy. Visa’s sponsorships, including the Olympics and FIFA™ World Cup, celebrate teamwork, diversity, and excellence throughout the world. If you have a passion to make a difference in the lives of people around the world, Visa offers an uncommon opportunity to build a strong, thriving career. Visa is fueled by our team of talented employees who continuously raise the bar on delivering the convenience and security of digital currency to people all over the world. Join our team and find out how Visa is everywhere you want to be. 

“Visa will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of Article 49 of the San Francisco Police Code.”

Privacy Policy