Lead Big Data Developer

Store Support Centre - London

Competitive plus benefits

Permanent - Full Time

03 December 2017

Related Positions

Domain Architect

Competitive plus benefits

Store Support Centre - Coventry Walsgrave

30 November 2017

Delivery Manager - Bank

Competitive plus benefits

Store Support Centre - Coventry Walsgrave

26 November 2017

Software Engineering Manager

Competitive plus benefits

Store Support Centre - London

01 December 2017

Enterprise Data Architect

Competitive plus benefits

Store Support Centre - London

15 December 2017

Lead Big Data Developer


Sainsbury’s is a data rich business – with information collected from consumers, suppliers and colleagues.  We believe that there is huge value in these data in driving value for our customers and, in turn, value for our shareholders.

To-date, there has been some great work done which has started to realise some of this value, but there is significantly more opportunity bought about by developing the right information solutions to help solve often complex business challenges.

You will lead a team to undertake solution development utilising appropriate models, process, standard and principles, ultimately to make great quality, well understood data available to the applications and people that can then drive analytics and insights into the business.

You will be working across a mix of traditional RDBMS, Big Data and new open source platforms with a range of tools and technologies, utilising them in the most appropriate manner to deliver results while developing a strategic capability.

This is a critical role delivering against our aspiration to know our customers better than anybody else and underpins our strategies across the business – from how we work better with our suppliers through to how we sell our products to consumers.

The fundamental principle is that data is a corporate asset and, as such, we need to manage and govern it in a way which creates value from that asset.

What I need to do

Implement Best Practice

  • Utilise the appropriate data development (ETL & ELT, stream processing), test and release model(s) to best fit the needs and be flexible with your approach
  • A mixture of data ingestion and data transformation
  • Have flexibility to undertake standard solution development as well as support rapid discovery, prototyping and data science, subsequently turning successful variants into production solutions
  • Choose the appropriate solution to meet the need and determine how this should be developed
  • Help enhance the organisation model for the development team
  • Implement using demand and delivery processes, principles and standards
  • Update and manage artefacts to be created by the team
  • Deliver, cost effective, appropriate capabilities for the business
  • Develop and utilise your existing network within and outside of the open source community to share, learn, develop new and enhance existing capabilities
  • Help recruit and/or develop a high class data development team to the right level for success
  • Implement an operating model with D&T (IT) and DACE colleagues to deliver end to end solutions in a matrix manner
  • Manage on a day to day basis internal, contract and third party resources to deliver solutions
  • Manage the delivery to ensure we are achieving success
  • Where appropriate, look to remove technical debt and deliver in repeatable, re-usable patterns
  • Create a culture within the team of sharing and learning with each other, the open source community and wider networks
  • Ensure team members competencies, career aspirations and personal development needs are understood and work with them to put in place appropriate personal development plans

Manage a day-to-day delivery operation

  • Lead, set goals for and develop a team of approximately 6 colleagues
  • Work very closely and communicate with colleagues across the wider DACE and D&T teams to deliver solutions in a matrix manner
  • Responsible for deciding how best to deliver against the agreed requirements
  • Independently manage the completion of tasks and successful end to end delivery of solutions
  • Prioritise and manage resources to deliver against demand; complete tasks to achieve appropriate sprint burn down
  • Implement effective delivery and performance management and associated reporting, to understand progress and enable timely interventions
  • Manage a development team that focusses on value creation from data across the enterprise through deliveries of new capability on a regular basis (2-3 week sprints)
  • Manage a team that delivers change into our various data assets in a timely and cost-effective way
  • Ensure solutions are appropriately documented and prepared for release and handover for operational support
  • Clearly communicate any risks, dependencies and issues impacting delivery and take the necessary actions to mitigate them
  • Ensure those you and your team depend on are clear about the actions they need to take to ensure success

How I will succeed

  • Developing a great relationship with D&T (IT), peers and the end user community.
  • Recruiting, leading and inspiring a team capable of delivering great solutions
  • Being focused on driving value back into the business
  • Managing a complex mix of work within tight timescales and budgets in an agile way that ensures maximising our value opportunity (time to value)
  • Form part of the leadership team of DACE Development demonstrating the necessary leadership skills and style
  • Be a subject matter expert of all traditional and Big Data capabilities and understand which solutions to use in what context for the best outcome
  • Strive to become a luminary in data development leadership

What I need to know

  • Detailed knowledge of the tools, technologies, skills and processes required to deliver a complex and complete development solutions for the business
  • Detailed understanding of development of data stores and data warehouses and associated toolsets
  • Detailed knowledge of data development in a big data (Hadoop) and/or traditional data warehouses/toolsets using SQL or SQL based ETL capabilities
  • Technology stack includes Cloudera, Spark, Hive, Impala, Data Formats, Kafka,
  • Python, Scala, Teradata, AbInitio, WhereScape, SQL server etc.
  • Experience of leading expert teams in the use of these toolsets
  • An understanding of how to do development in the cloud (AWS a plus), and the services available
  • Experience of leading data development teams
  • Use of Adobe or related technologies and leading teams in this space a bonus
  • A clear understanding of Information Architecture and solution design
  • A strong user and advocate of continuous integration (CI, Jenkins a plus), continuous deployment and test driven development
  • A deep understanding and experience of using a mix of delivery methodologies including Agile, Scrum and Waterfall delivery
  • A broad understanding of the applications of data from reporting through to data science

    What I need to show

  • Exemplary technical and strong leadership skills
  • Strong communications skills
  • The passion, drive and commitment to succeed in a fast-moving, highly pressured environment
  • Flexibility of approach
  • A keenness to both learn and share your knowledge with others
  • The ability to deliver quality solutions at an appropriate pace
  • A proven track record of delivering solutions in a large scale, complex business.

Resources available to me

  • People – an appropriately sized and skilled team
  • Toolsets – A strong mix of more traditional and new big data, open source capabilities
  • A wholly engaged business – keen to have ‘data sorted’ and equally keen to help
  • The access to appropriate third party resources

    What decisions I can make

  • Team operating model
  • Recruitment
  • Team development
  • Day to day running of the team


Apply now