Sr Data Engineer

Company Description

Recruitment and Staffing Agency

Job Description

Job ID: 4209235

Job Title: Sr Data Engineer

Location: San Francisco, CA

Duration: 6+ months (Contract to Hire) 


W-2 only        


this is a sr manager role, but is standalone job-- must have lead level experience AS WELL AS CODING . 7 - 10 years overall experience -- seek hybrid type person with Java and Hadoop ideally looking for a person who will convert at a rate in the range of 130-140k +bonus.


Senior Business Intelligence engineer for Advanced Analytics overall theme. Guide and move forward an advanced system providing sophisticated and measurable business benefits. This person will work closely with our business analysts, as well as internal business users to understand their key business drivers and data needs, and scope out scalable and suitable solutions that will help our customers with their information needed for planning, analysis, and decision-making.


Responsibilities:

Ability to analyze business needs and translate into approach options with pro s cons of each approach

Design and implement next generation CRM applications in Hadoop that can handle high data volumes

Execute analysis through tools in a Hadoop distributed environment

Assist with supporting, migrating and refactoring reports and existing BI solutions.

Support a group of multi-disciplinary data professionals and analysts.

Assist in defining development project plans, including scoping, scheduling, providing time estimates for programming tasks and implementation plans and schedules.

Maintain a current awareness of technological developments and trends as it relates to development methodologies and tools, especially in the CRM-BI, Reporting and Hadoop space

Ensure that the data infrastructure can scale to meet defined performance, load, and functional objectives.

Manage execution of parallel projects of varying scope and duration.

Document and share knowledge with the team.

Knowledge, skills & abilities

8+ years of experience with software development

Strong knowledge of software development practices.

High proficiency in Java Development Practices

Solid Object Oriented Development Experience required.

Design and architecture experience within Big Data space.

Creating frameworks to sift through and process terabytes of data: create domain specific languages and natural language grammars to connect data science and end users to the company s vast data store.

Writing parallel algorithms against a petabyte Hadoop cluster to mine insight out of the company s historical webstream and transaction activity

Working knowledge of RDBMS systems (Oracle, SQL Server, etc)

General programming competency and experience in a Hadoop Big Data environment

Strong application engineering experience in designing Information/Analytics, highly scalable and available systems

Prior Hadoop and Java MapReduce Experience required.

Familiarity with Distributed Computing Platforms.

Strong conceptual and creative problem-solving skills; ability to work with considerable ambiguity; ability to learn new and complex concepts quickly

Demonstrated initiative and ability to work independently

Ability to build strong, collaborative working relationships with broad cross section of business partners

Strong oral and written presentation skills

Good to Have:

Hands on BI development experience or involvement with BI related projects

Previous experience working with Sales, Marketing, and Customer Relationship Management system data is a plus

Experience with various business apps like campaign management, ERP.

Experience in automotive marketing and/or CRM applications.

Experience working with offshore teams

Experience with column oriented database solutions.


Education:

BS/MS degree in Computer Science or a related discipline

Degree is required. CRM experience is a plus. Must have excnt communication skills to interact with C Level manager to gather information, may have to present.


Additional Information