Data Engineer, (Big Data Oriented)

  • Full-time
  • Type of Contract: Permanent
  • Skills / Job Stream Ref: Data
  • Department: Ads

Company Description

Dailymotion is the leading video discovery destination & technology that learns about your tastes over time, constantly surfacing the best, most relevant content on the web. Our mission is to provide the best video user experience for consumers on the market, connecting publishers and advertisers to engaged viewers who turn to dailymotion for their daily fix of the most compelling music, entertainment, news and sports content around.

Through partnerships with the world's leading publishers and content creators, including CBS, CNN, Fox Sports, GQ, Mashable, Universal Music Group, VICE and more, dailymotion commands 4 billion monthly pageviews across its mobile app, desktop and connected TV experiences. Dailymotion is owned by Vivendi, one of the largest mass-media corporations in the world.

Job Description

As a Data Engineer, you will design, build and test highly scalable data pipelines and user profiling systems using cutting-edge big data technologies. 

Responsibilities:

Develop reusable tools for the management and manipulation of hundreds of terabytes of data
Build a user profiling system for ad profiling
Analyze and improve efficiency, scalability, and stability of data collection, storage, and retrieval processes
Interface with other teams to incorporate their innovations and vice versa
Work closely with data analysts to construct creative solutions for their analysis tasks
Optimize our infrastructure at both the software and hardware level
Ingest and store terabytes/ petabytes of data

Qualifications

Extensive experience working with large data stores 
Hands on experience with Spark, Spark Streaming, Kafka, Flume is very useful.
Advanced SQL query writing abilities and data understanding
Solid understanding of Distributed Computing Systems
Strong experience in developing and maintaining reliable ETL processes
Deep understanding of storage appliances and storage software internals
Experience with filesystems, server architectures, and distributed systems
Experience / Knowledge in Cloud Architectures
Ad Tech experience is a huge plus
Master’s Degree in Engineering or equivalent work experience required 

Additional Information

    We offer great health / dental / vision insurance
    401k (company Safe Harbor contribution) 
    summer hours, paid vacation, sick time, paid holidays, company sponsored Training Opportunities (upon eligibility) and much more.

Privacy Policy