Director, Data Engineering

  • Bengaluru, Karnataka, India
  • Full-time

Company Description

As the world's leader in digital payments technology, Visa's mission is to connect the world through the most creative, reliable and secure payment network - enabling individuals, businesses, and economies to thrive. Our advanced global processing network, VisaNet, provides secure and reliable payments around the world, and is capable of handling more than 65,000 transaction messages a second. The company's dedication to innovation drives the rapid growth of connected commerce on any device, and fuels the dream of a cashless future for everyone, everywhere. As the world moves from analog to digital, Visa is applying our brand, products, people, network and scale to reshape the future of commerce.

At Visa, your individuality fits right in. Working here gives you an opportunity to impact the world, invest in your career growth, and be part of an inclusive and diverse workplace. We are a global team of disruptors, trailblazers, innovators and risk-takers who are helping drive economic growth in even the most remote parts of the world, creatively moving the industry forward, and doing meaningful work that brings financial literacy and digital commerce to millions of unbanked and underserved consumers.

You're an Individual. We're the team for you. Together, let's transform the way the world pays.

Job Description

To ensure that Visa’s payment technology is truly available to everyone, everywhere requires the success of our key bank or merchant partners and internal business units. The Global Data Science group supports these partners by using our extraordinarily rich data set that spans more than 3 billion cards globally and captures more than 100 billion transactions in a single year. Our focus lies on building creative solutions that have an immediate impact on the business of our highly analytical partners. We work in complementary teams comprising members from Data Science and various groups at Visa. To support our rapidly growing group we are looking for data engineers who are equally passionate about the opportunity to use Visa’s rich data to tackle meaningful business problems.

In this role, you will be responsible for leading a team of data engineers to design and delivery a data engineering solution for our internal and external facing business lines. You will get chance to leverage your strategic planning, business analysis and technical knowledge of data engineering, tools and data architecture definition. In addition to managing our portfolio of datasets globally, you will play key roles in helping our data scientist community to leverage these datasets effectively. For example, you can expect to help data scientists to find and use the appropriate datasets for their specific problems. You will also produce documentation and lead training sessions for data engineering solutions. You might also work with outside organizations across geographies to facilitate data-sharing agreements and other types of partnerships.


Essential Functions

  • Build and manage a team of talented data engineers with the ability to not only keep up with, but also pioneer, in this space.

  • Collaborate with and influence leadership so that your teams work directly impacts company strategy and direction.

  • Develop new techniques and data that will enable answering previously unanswerable and new questions.

  • Develop deep partnerships with engineering and product teams to deliver on major cross-functional measurements, testing.

  • Communicate effectively to all levels of the organization, including executives.

  • Provide success in partnering teams with dramatically varying backgrounds, from the highly technical to the highly creative.

  • An advanced degree in a quantitative field - computer science, statistics, operations research, economics, etc.

  • 5+ years of experience in managing teams in areas of Analytics/Data Science/Data Engineering or Quantitative fields

  • Experience designing a data engineering roadmap and executing the vision behind it.

  • Experience instilling a culture of ownership, collaboration, and results.

  • Track record of recruiting talent in data engineering, analytics, and data science.

  • Collaborate with Data Engineering teams in North America and other Global regions to production and maintenance of key data assets.


Business skills and general qualities:

  • Good business acumen to orient data analysis to business needs of clients.

  • Ability to translate business concepts into a technical architecture

  • Ability to collaborate with cross-functional teams to define priorities and develop roadmaps

  • Project management skills

  • Demonstrated intellectual and analytical rigor, strong attention to detail Team oriented, energetic, collaborative, diplomatic, and flexible style


Basic Qualifications

12+ yrs. work experience with a Bachelor’s Degree or 10+ years of work experience with a Master's or Advanced Degree in an analytical field such as computer science, statistics, finance, economics or relevant area.

Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, MLlib, GraphX, iPython, sci-kit,Pandas etc.)


Business skills and general qualities:

  • Ability to understand business requirements of the data science business.

  • Ability to translate data and technical concepts into requirements documents, business cases and user stories.

  • Good understanding of agile working practices and related program management skills.

  • Good communication and presentation skills with ability to interact with different cross-functional team members at varying levels

  • Ability to learn new tools and paradigms as data science continues to evolve at Visa and elsewhere.

  • Demonstrated intellectual and analytical rigor, team oriented, energetic, collaborative, diplomatic, and flexible style.

  • Intellectually curious and continuously striving to learn.

Technical skills:

  • Experience in creating Large scale data engineering pipelines, data-based decision-making and quantitative analysis.

  • Experience with Visualization Tools like Tableau, Power BI, D3 and exposure to code version control systems (git).

  • Experience – CICD/ Data Architectures/ Pipelines/ Quality /Code Management.

  • Exposure to Data Science including Predictive Modeling

  • Advanced experience in writing and optimizing efficient SQL queries with Python, Spark, Hive, Scala handling Large Data Sets in Big-Data Environments.  

  • Experience with complex, high volume, multi-dimensional data, as well as machine learning models based on unstructured, structured, and streaming datasets.

  • Experience with SQL for extracting, aggregating and processing big data Pipelines using Hadoop, EMR & NoSQL Databases.

  • Experience creating/supporting production software/systems and a proven track record of identifying and resolving performance bottlenecks for production systems.

  • Experience with Unix/Shell and exposure to Scheduling tools like Oozie and Airflow.

  • Exposure to stream-processing systems like Apache Storm, Spark-Streaming.

Additional Information

Work Hours

Incumbent must make themselves available during core business hours.

Travel Requirements

This position requires incumbent to travel for work 0-5% of the time.

Mental/Physical Requirements

This position will be performed in an office setting.  The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers, and reach with hands and arms.

EEO Statement

Visa is an EEO Employer.  Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status.  Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Privacy Policy