Senior Data Engineer

Job Type IT
Location London - Victoria
Additional Locations Bracknell Campus
Partnership Level 6
Closing Date 27/11/2022
Vacancy Type Permanent
Salary £55,800.00 - £90,000.00
Salary Frequency Annual
Hours of Work 35


We want all of our Partners to have a good work-life balance and we support flexible working. This might mean flexible or compressed hours, job sharing or shorter hour contracts, where it is possible to do so. Please discuss this further with the hiring manager during your interview.


Working in Partnership for a happier world – our shared Purpose that guides us in everything we do and inspires 3 important principles; happier people, happier business, happier world. The John Lewis Partnership is a truly unique business, one that seeks to make a positive difference to the lives of everyone.

What’s the role about?

Working in Partnership for a happier world - our shared Purpose that guides us in everything we do and inspires 3 important principles; happier people, happier business, happier world. The John Lewis Partnership is a truly unique business, one that seeks to make a positive difference to the lives of everyone.

As the UK’s most successful omni-channel retailer, E-Commerce is a key part of Our Business - we run two of the busiest websites in the UK, driving a significant proportion of our sales. Our Engineering practice includes 60+ teams, working on everything from Cloud Platforms to Mobile Apps, from E-Commerce functionality to Machine Learning.

Our Engineers work collaboratively and share knowledge, and learning is extremely important to us. We support our Engineers to continuously improve their skills and keep abreast of the latest technologies. This role is known internally as Product Engineer (PL6)

Find out more about being a Software Engineer in the Partnership, and the technology we use.

What you’ll be doing?

This is an opportunity to join our John Lewis Partnership Data Platform (PDP) team working as a Senior Data Engineer. 

You will be using your excellent Data Engineering skills and experience in designing, implementing and supporting secure cloud-based data platforms to enhance our in-house data capabilities.

The vision for PDP is to embed data-driven decision making and analytics at scale, across the Partnership. We recognise the importance of data, and are backing a significant investment in developing the platform.

We are transforming our in-house Data Engineering capability, which has been at the heart of a move to a cloud-native data platform, to become Product delivery focused. Recent successes have been the PDP underpinning customer experience and loyalty outcomes such as myJL Rewards and the relaunch of myWaitrose.

As a Senior Engineer, you will also use your knowledge of Software Engineering to lead the shaping of new projects and support the professional development of less experienced Engineers. 

There are opportunities to become a people manager for your fellow engineers if that is something that appeals to you.

Successful candidates will have a passion for using technology to deliver outstanding and innovative software solutions, and will have a track record of working in teams delivering complex, performant, high quality software. They will thrive in a fast-paced environment and have a focus on quality, ensuring the delivery aligns with the needs of the business, whilst also being supportable and maintainable. You will be a champion for exceptional data DevSecOps for our Partners and customers. 


What you’ll already have:

  • Expert skills in building cloud-based data pipelines using data orchestration and workflow platforms. We use Airflow/Cloud Composer with Python but you may have experience of different orchestration/workflow tools or programming languages.

  • Advanced SQL skills, with a deep understanding of how to write performant SQL and debug problems

  • Experience with a cloud-based relational Data Warehousing product

  • Data transformation tools, preferably DBT

  • Cloud-Based data platforms, preferably Snowflake or Big Query

  • Designing secure data pipelines and fixing security/performance issues

  • Identification of data quality issues

  • Deploying to at least one major Cloud Platform such as AWS, GCP or Azure

  • Continuous Integration/Continuous Delivery

  • TDD, pair programming.

  • Agile development methods such as Scrum or Kanban


What else you could bring:

  • Containerisation, Kubernetes

  • Event-driven design

  • Gitlab CI, Jenkins, Circle CI, Jira

  • Data orchestration and workflow technologies such as Airflow

  • Visualisation & reporting tools such as Tableau or Looker

  • ETL tools such as Apache Beam or AbInitio

  • Knowledge or experience of DataVault (DV2)

  • Data Visualisation

  • Understanding of Data Management Concepts

Where will you be working?

We have opportunities at  both our John Lewis Head Office in London Victoria and Waitrose Head Office in Bracknell, Berkshire.

We have a blended hybrid approach of working from our offices and a home/remote UK location. You are contracted to a Partnership office location. If you choose to work remotely you should be aware that from time to time, you will need to come into the office. This decision is made within your team and may mean that you do not come into the office for weeks or months at a time unless you choose to. 

What benefits do we offer you?

We believe in rewarding our Partners for their time and energy. Find out about the benefits of working for the Partnership


How does our application process work?

Internal candidates only, click here

External candidates: In order to help you understand what to expect, we have added a PDF overview of our application process at the green attachment link below.

For internal use only:





We positively celebrate Diversity & Inclusion in the John Lewis Partnership. Our aim is to become the UK’s most inclusive business - for our Partners and for our customers, reflecting and connecting with the diverse communities that we serve. We want people from all walks of life to feel valued for their individuality, thrive in our business and share a sense of belonging. To find out more about D&I in the John Lewis Partnership visit this site -

Attachment: Application & Interview process.pdf 


Latest IT opportunities

Cyber Security Lead - Incident Response
  • Bracknell Campus,
  • £56700 - £83600
  • Closing Date: 09/10/2022
Front-end Software Engineer
  • London - Victoria,
  • £47100 - £69500
  • Closing Date: 27/11/2022
Back-end Software Engineer
  • London - Victoria,
  • £47100 - £69500
  • Closing Date: 27/11/2022