Sr Data Engineer
Company Description
Recruitment and Staffing Agency
Job Description
Job ID: 4209235
Job Title: Sr Data Engineer
Location: San Francisco, CA
Duration: 6+ months (Contract to Hire)
W-2 only
this is a sr manager role, but is standalone job-- must have lead level experience AS WELL AS CODING . 7 - 10 years overall experience -- seek hybrid type person with Java and Hadoop ideally looking for a person who will convert at a rate in the range of 130-140k +bonus.
Senior Business Intelligence engineer for Advanced Analytics overall theme. Guide and move forward an advanced system providing sophisticated and measurable business benefits. This person will work closely with our business analysts, as well as internal business users to understand their key business drivers and data needs, and scope out scalable and suitable solutions that will help our customers with their information needed for planning, analysis, and decision-making.
Responsibilities:
Ability to analyze business needs and translate into approach options with pro s cons of each approach
Design and implement next generation CRM applications in Hadoop that can handle high data volumes
Execute analysis through tools in a Hadoop distributed environment
Assist with supporting, migrating and refactoring reports and existing BI solutions.
Support a group of multi-disciplinary data professionals and analysts.
Assist in defining development project plans, including scoping, scheduling, providing time estimates for programming tasks and implementation plans and schedules.
Maintain a current awareness of technological developments and trends as it relates to development methodologies and tools, especially in the CRM-BI, Reporting and Hadoop space
Ensure that the data infrastructure can scale to meet defined performance, load, and functional objectives.
Manage execution of parallel projects of varying scope and duration.
Document and share knowledge with the team.
Knowledge, skills & abilities
8+ years of experience with software development
Strong knowledge of software development practices.
High proficiency in Java Development Practices
Solid Object Oriented Development Experience required.
Design and architecture experience within Big Data space.
Creating frameworks to sift through and process terabytes of data: create domain specific languages and natural language grammars to connect data science and end users to the company s vast data store.
Writing parallel algorithms against a petabyte Hadoop cluster to mine insight out of the company s historical webstream and transaction activity
Working knowledge of RDBMS systems (Oracle, SQL Server, etc)
General programming competency and experience in a Hadoop Big Data environment
Strong application engineering experience in designing Information/Analytics, highly scalable and available systems
Prior Hadoop and Java MapReduce Experience required.
Familiarity with Distributed Computing Platforms.
Strong conceptual and creative problem-solving skills; ability to work with considerable ambiguity; ability to learn new and complex concepts quickly
Demonstrated initiative and ability to work independently
Ability to build strong, collaborative working relationships with broad cross section of business partners
Strong oral and written presentation skills
Good to Have:
Hands on BI development experience or involvement with BI related projects
Previous experience working with Sales, Marketing, and Customer Relationship Management system data is a plus
Experience with various business apps like campaign management, ERP.
Experience in automotive marketing and/or CRM applications.
Experience working with offshore teams
Experience with column oriented database solutions.
Education:
BS/MS degree in Computer Science or a related discipline
Degree is required. CRM experience is a plus. Must have excnt communication skills to interact with C Level manager to gather information, may have to present.