Lead Software Engineer - IaaS, Data Platform (REF4730Z)
- Palo Alto, CA
Visa operates the world's largest retail electronic payments network and is one of the most recognized global financial services brands. Visa facilitates global commerce through the transfer of value and information among financial institutions, merchants, consumers, businesses and government entities.
We offer a range of branded payment product platforms, which our financial institution clients use to develop and offer credit, charge, deferred debit, prepaid and cash access programs to cardholders. Visa's card platforms provide consumers, businesses, merchants and government entities with a secure, convenient and reliable way to pay and be paid in 170 countries and territories.
The Data Platform Department is a key component of Visa's Technology organization that provides an enriched and valuable ecosystem of data platform and data services to drive innovation for our partners and clients, within Visa and globally. Data is the most valuable asset in Visa. The Data Platform Department is dedicated to systems and services to make data secure, high quality, rich, fast, and easy to use, therefore enabling Visa with the ability to leverage its data asset in an effective and timely manner to maximize technology/business development and differentiate Visa from others in the payment industry. The department maintains tens of petabytes of data supporting over 100 services for various internal lines of business and external clients. Our technical stack has two layers: Platform as a Service (PaaS) and Data as a service (DaaS).
The Infrastructure as Services team is part of Visa's Data Platform division. Our mission is to provide the enabling technology and processes to manage Visa data assets and deliver Value Added Information Products and Services to our customers. We are working very closely with PaaS team. 30% of the time team spend on development, 30% - on support, 30% - on administration and 10% - on improving business processes.
Data Platform organization is building the Next Generation Data processing engines with cost-effective and distributed applications on commodity hardware using best-in-class technology components. Building next generation applications require collaboration with exceptional group of highly skilled Data architects, software engineers, DevOps engineers, payment experts and infrastructure architects. This is an exciting time for a data professional to join our team to drive technology transformation.
A successful candidate needs to be highly technical, with architecture experience, and have demonstrated ability to lead. Success in this role will require working effectively in a matrix organization within Data Platform and across other departments within Visa. Prior experience must include leadership in engineering for mission-critical large scale data systems for analytic and operational use. Examples include real-time data collection systems, large scale data pipelines, warehousing, cloud technology like Hadoop and Spark, business intelligence, predictive analytics, and near real-time data systems.
We desire a candidate who has demonstrated success in building partnerships with the key stakeholders of the other technology functions such as operations, support, system administration, security, development, and engineering is required.
The ideal candidate will have a strong technical background in cloud technologies, big data, web technologies, large scale distributed platforms etc., and is a thought leader, is very familiar with the up to date development of the industry in these areas, written and verbal communication skills, and software solution delivery.
Responsible for building/maintaining application standard operating environment; help application development to articulate/measure/maintain non-functional requirements for applications within Data Platform
Spend 30% of the time on development with development teams
Partnering with application developers, architects, engineers, and various groups supporting Data Platform applications to drive new initiatives
Collaborating with project and development teams to ensure on time delivery of projects, production support plans, and knowledge transfer for long-term supportability of upgrades, enhancements, and deployments
Identifying existing productivity issues and opportunities, developing methods and systems to improve these functions and managing their implementation
Serving as liaison between the various organizational entities and building relationships with members of these organizations
Developing close working relationships and dependencies with members of teams within the organization
Manage infrastructure of applications utilizing all possible information delivery channels, including capacity planning, version upgrades and maintenance
Identify opportunities for further enhancements and refinements to standards and processes
Mentor/manage team members, develop procedures and best practices standards
Build and maintain relationships with global and virtual teams and third parties on software development or support issues
Participate in the overall strategy, standardization, analysis, design, and implementation of applications
Engages architects (both enterprise and domain) to ensure that overall Enterprise Architecture is inclusive of all stakeholder viewpoints
Master degree in Computer Science, Electrical Engineering, Information Systems or other technical discipline
Active experience with Java, C++, shell scripting, HBase, Spark, Kafka, Hive, Pig
Relational database and SQL development experience required
Understanding best practices for Big data, data warehousing, consumer analytics, knowledge management and near real time data processing
Demonstrate expertise in data warehouse development, management of information systems, enterprise data store approaches and operations in large, complex, and geographically diverse operations
8+ years of hands-on experience in developing and managing development of Data Integration applications for large corporations with experience in both batch and online systems
5+ or more years of hands-on experience with coding on languages like C/C++, Java; experience with ETL/ELT applications, open system platforms (UNIX: AIX, Linux)
In-depth knowledge of the software development life cycle required
Development experience in a cross-platform, multi-tier environment
Strong communication skills with ability to present complex ideas and document in a clear and concise way
Expert in best practices for Data Marts and Enterprise DW architectures
Quick learner; self-starter, detailed and thorough
Proactive sense of urgency and “can do” attitude
All your information will be kept confidential according to EEO guidelines.