Senior Data Engineer
- Contract
Company Description
Nine is Australia’s largest locally owned media company – the home of Australia’s most trusted and loved brands spanning News, Sport, Lifestyle, and Entertainment. We pride ourselves on creating the best content, accessed by consumers when and how they want – across Publishing, Broadcasting and Digital.
Nine’s assets include the 9Network, major mastheads such as The Sydney Morning Herald, The Age and The Australian Financial Review, radio stations 2GB, 3AW, 4BC and 6PR, digital properties such as nine.com.au, 9Now, 9Honey, Pedestrian.TV, Drive, subscription video platform Stan and a majority investment in Domain Group.
Our Purpose: We shape culture by sparking conversations, challenging perspectives, and entertaining our communities.
We bring people together by celebrating the big occasions and connecting the everyday moments. Australia belongs here. We bring our purpose to life via three shared values: We walk the talk, turn over every stone and keep it human.
Job Description
Nine's Data Engineering team is on a mission to modernise how we store, consume and process data to derive value from it. We're building and managing cutting-edge pipelines, applications, and infrastructure, handling hundreds of millions of daily events, and crafting rich data models that inform business decisions at every level.
Currently, we're embarking on an exciting journey to migrate our legacy data pipelines and services from AWS to GCP. This is a unique opportunity for a seasoned Data Engineer to play a pivotal role in modernising our data ecosystem, ensuring seamless data flow, and unlocking new possibilities for innovation and growth.
As a Senior Data Engineer specialising in cloud migration, you'll be:
Analysing and assessing our existing AWS data pipelines and services, identifying areas for optimization and standardisation, and formulating a comprehensive migration plan.
Collaborating with product and business stakeholders to create a plan for the 'future state', including data sources, sinks and transformations
Tracing the data lineage to understand how data moves through the system.
Identifying under-utilised assets that could be retired
Familiarity with the below areas would be beneficial:
Designing and implementing new data pipelines and infrastructure in GCP, leveraging the platform's full potential for scalability, efficiency, and reliability.
Adhering to Nine's data standards and industry best practices, ensuring our GCP environment is robust, secure, and primed for future growth.
Sharing your expertise with other team members, fostering a culture of continuous improvement, and contributing to our collective knowledge and skill set.
Qualifications
Technical Expertise:
A minimum of 4+ years of experience with a demonstrated track record of successfully migrating data pipelines and services from one cloud platform to another
Experience drafting SQL and Python
Hands-on experience with cloud data technologies. We’d love to see experience across AWS (Redshift, Lambda Functions, ECS) and GCP (BigQuery, Dataproc, Dataflow, Composer, Pub/Sub), but experience across all those technologies is not a must
Problem-Solving & Leadership:
A strong analytical mindset, a passion for tackling complex technical challenges, and the ability to find creative solutions to migration-related issues.
Excellent communication and interpersonal skills, with the ability to lead technical discussions, build consensus, and work effectively with cross-functional teams.
Deep understanding of cloud migration strategies, best practices, and potential pitfalls.
Desirables
A bachelor's or master's degree in computer science, software engineering, data engineering, data science, information technology or a related field.
Experience in both AWS and GCP environments.
Deep understanding of data warehousing principles, ETL/ELT processes, and data modelling techniques.
Proficiency with Airflow DAG syntax and orchestration tools like DBT.
Experience in deploying cloud infrastructure as code (IaC) using Terraform or similar
Additional Information
Our Commitment to Diversity and Inclusion:
At Nine, we are committed to fostering a workforce that embraces all aspects of diversity and inclusion and where practices are equitable to ensure our people experience a sense of belonging. From day one, you'll be encouraged to bring your whole self to work and will be supported to perform at your best. Should you require any adjustments to the recruitment process in order to equitably participate, we encourage you to advise us at the time of application.
We encourage applications from Aboriginal and Torres Strait Islander people, people with disabilities, and of all ages, nationalities, backgrounds and cultures.
Disclaimer: We do not accept unsolicited agency resumes and are not responsible for any fees related to unsolicited resumes.