Principal Software Engineer - Big Data

Store Support Centre - London

Competitive plus benefits

Permanent - Full Time

17 December 2017

Related Positions

Senior Information Security Analyst- Project Assurance

Competitive plus benefits

Store Support Centre - London

30 December 2017

Senior Buyer - Commercial

Competitive Plus Benefits

Store Support Centre - London

24 December 2017

Senior Solution Architect - Marketing & Data

Competitive plus benefits

Store Support Centre - London

29 December 2017

Senior Solution Architect - Internal IT

Competitive plus benefits

Store Support Centre - Coventry Walsgrave

22 December 2017

Principal Software Engineer - Big Data

In a nutshell

Sainsbury’s, one of the UK’s largest retailers, is investing heavily in digital innovation. We have built a centralised Data Platform in the cloud which allows business users to make better and faster decisions, supported by accurate and up-to-date data from the business. The team is growing rapidly and looking for talented colleagues to continue to deliver an ambitious and market leading data platform that lives up to Sainsbury’s industry leading reputation.

We are looking for talented Principal Data Platform Engineers to lead the design, build, and automate activities for this Data Platform. You will work closely with other Data Engineers, Data Scientists, and Devops Engineers across multiple platforms and technologies to create a highly scalable, secure, and performant data platform.

What I need to do

  •  Design, test, and deploy large scale distributed systems using engineering best practices in the enterprise production context
  • Design smart and secure ways of storing, analysing, and processing complex data in the cloud, including in real-time
  • Care about your craft, be aware of new technologies, and be keen to use them when appropriate
  • Feed your insights to the product team to continuously improve the platform
  • Be the technical lead of an agile development team
  • Be diligent and positive about issue tracking, system monitoring, security, auditing, and other ways of ensuring the quality of the platform and the processes around it
  • Provide third level support for production issues following the "you build it, you fix it" philosophy
  • Define your career path, grow, and learn 

What I need to know

  • Technical leadership experience in an enterprise Hadoop production environment
  • Distributed computing, its advantages and disadvantages in Big Data analytical applications
  • Cloud computing and related challenges around security, bandwidth, etc.
  • Hadoop application architecture, understanding batch vs. streaming
  • Understanding statistics and data science to work closely with business analysts
  • Service oriented architecture and APIs
  • Unit, regression, and integration testing
  • Version control
  • Agile software development
  • DevOps and infrastructure-as-code

Technologies we are using:

  • Kafka, Spark, Hadoop, Hive, Impala
  • AWS, Terraform, Ansible
  • Scala, Java, R, Python

What I need to show

Communication and Influencing:

  • Uses range of techniques to influence, adapts to situation

Analytical Thinking:

  • Pushes boundaries in solving problems  

Aptitude to Learn:  

  • Actively seeks feedback from multiple sources
    Contributes to wider community in own area of expertise

Team Work:  

  • Supports a collective effort to resolve problems
  • Uses strengths of team to deliver increased value

Leadership and Mentoring:  

  • Values differences

Commitment and Planning:  

  • Delivers ahead of expectations

Resources available to me

Line manager providing on-going support through 121’s and SMART objectives
Agile coach providing on-going support in terms of Agile ways of working
Wider development community sharing knowledge and support

What decisions I can make

Lead on decisions regarding technology choices for multiple teams
Shape the technical landscape using your experience
Leads on architectural decisions across multiple teams


Apply now