Senior Big Data Engineer

  • Full-time
  • Job Family Group: Technology and Operations

Company Description

Common Purpose, Uncommon Opportunity.
Everyone at Visa works with one goal in mind – making sure that Visa is the best way to pay and be paid, for everyone everywhere. This is our global vision and the common purpose that unites the entire Visa team. As a global payment company in Silicon Valley, technology is at the heart of what we do. Our VisaNet network processes over 13,000 transactions per second for people and businesses around the world, enabling them to use digital currency instead of cash and checks; our Advanced Authorization engine scores every authorization
VisNet processes with machine learning models for issuers to stop frauds in real-time. We are also global advocates for financial inclusion, working with partners around the world to help those who lack access to financial services join the global economy. Visa’s sponsorships, including the Olympics and FIFA™ World Cup, celebrate teamwork, diversity, and excellence throughout the world. If you have a passion to make a difference in the lives of people around the world, Visa offers an uncommon opportunity to build a strong, thriving career. Visa is fueled by our team of talented employees who continuously raise the bar on delivering the convenience and security of digital currency to people all over the world. Join our team and find out how Visa is everywhere you want to be.

Job Description

In this role, you will be responsible for a range of duties from basic data analytics, to implementing and delivering advanced data engineering, visualization solutions and high impact business projects. You will get chance to leverage your business acumen, programming skills, technical knowledge of big data and machine learning techniques.

The position will be based at Visa's headquarters in Foster City, California

Responsibilities

  • Work closely with technical leads and business analysts to understand and document business and technical requirements and constraints.

  • Work with business teams in understanding the overall client requirements and proposed Big Data Solution

  • Be hands-on in leading and/or performing development work during the production cycle.

  • Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming

  • Gather and process raw data at scale (including writing scripts, calling APIs, write SQL queries, etc.).

  • Design and develop data structures that support high performing and scalable analytic applications.

  • Work closely with Data science to integrate amazing innovations and algorithms into data lake systems.

Qualifications

We are looking for a strong analytics thinker and problem solver, with a blend of business and technical skills:

Technical skills:

  • High level of competence in Spark and Unix/Linux scripts

  • Extensive experience with SQL for extracting and aggregating data

  • Real world experience using Hadoop and the related query engines (Hive / Impala)/Hbase

  • Experience with data visualization and business intelligence tools like Tableau, Microstrategy, or other programs

Experience:     

  • Advanced degree in Computer Science or Computer Engineering, plus relevant experience.

  • 8 years of working experience in developing and doing integration projects for enterprise level solutions.

  • Strong experience with Big Data Technology, including Hadoop, MapReduce, Spark  is needed

  • Strong experience in Spark Python/ Scala and Java is needed

  • Work on MPP, Big Data technologies like Hadoop, GreePlum, Data Governance implementations and support.

  • Produce technical specifications and design for development, solution development/migration and systems integration requirements.

  • Participate and lead internal development and external collaboration meetings.

  • Oversee testing of data acquisition processes and their implementation into production.

Additional Information

Visa will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of Article 49 of the San Francisco Police Code.

All your information will be kept confidential according to EEO guidelines.

Privacy Policy