Hadoop Administrator
- Full-time
- Job Family Group: Technology and Operations
Company Description
At Visa, your individuality fits right in. Working here gives you an opportunity to impact the world, invest in your career growth, and be part of an inclusive and diverse workplace. We are a global team of disruptors, trailblazers, innovators and risk-takers who are helping drive economic growth in even the most remote parts of the world, creatively moving the industry forward, and doing meaningful work that brings financial literacy and digital commerce to millions of unbanked and underserved consumers.
You're an Individual. We're the team for you. Together, let's transform the way the world pays.
Job Description
Job Description
•Person will be responsible to Perform Hadoop Administration on Production Hadoop clusters.
•Perform Tuning and Increase Operational efficiency on a continuous basis
•Monitor health of the platforms and Generate Performance Reports and Monitor and
provide continuous improvements
•Working closely with development, engineering and operation teams, jointly work on key deliverables ensuring production scalability and stability
•Develop and enhance platform best practices
•Ensure the Hadoop platform can effectively meet performance & SLA requirements
•Responsible for support of Hadoop Production environment which includes Hive, YARN, Spark, Impala, Kafka, SOLR, Oozie, Sentry, Encryption, Hbase, etc.
•Perform optimization, capacity planning of a large multi-tenant cluster.
Qualifications
Qualification:
• Minimum 3 years of work experience in maintaining, optimization, issue resolution of Hadoop clusters, supporting Business users and Batch.
• Experience in Configuring and setting up Hadoop clusters and provide support for - aggregation, lookup & fact table creation criteria's, Map Reduce tuning, data node, NN recovery etc.
• Experience in Linux / Unix OS Services, Administration, Shell, awk scripting
• Experience in building and scalable Hadoop applications
• Experience in Core Java, Hadoop (Map Reduce, Hive, Pig, HDFS, H-catalog, Zookeeper and OOzie)
• Hands-on Experience in SQL (Oracle ) and No SQL Databases (HBASE/Cassandra/Mongo DB)
• Excellent oral and written communication and presentation skills, analytical and problem solving skills
• Self-driven, Ability to work independently and as part of a team with proven track record developing and launching products at scale
• Minimum of four year technical degree required
• Experience on Cloudera distribution preferred
• Hands-on Experience as a Linux Sys Admin is a plus
• Knowledge on Spark and Kafka is a plus.
Additional Information
Visa will consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.