Data Engineer

  • Category
    IT and Telecoms - Consultant
  • Location
    London, Greater London
  • Salary
  • External Reference
  • OrganizationType

Location - London / Remote
Duration - 6 Months
Rate - £550 / Outside ir35

You will be working closely with cross-functional teams (data engineering, analytics, AI, governance and business) to build our Azure Cloud Infrastructure from the ground up, deliver new and reliable data streams, productionise our AI projects and maintain industry standard performance.

The responsibilities
*Align architecture and data feeds with business requirements
*Build and maintain GDPR compliant data pipelines
*Identify ways to improve data reliability, efficiency and quality in an automated way
*Deploy sophisticated analytics programs, machine learning and statistical methods
*Prepare data for predictive and prescriptive modelling
*Use data to discover tasks that can be automated

The requirements
*Can-do attitude and resilience
*Extensive experience with data modelling and cleaning
*Must have strong SQL/NoSQL, ETL/ELT, Python skills
*Experience building infrastructure as a code
*Experience building GDPR compliant infrastructure and pipelines
*Extensive experience with Azure product stack (Data Factory, Azure Data lake and blob, Azure DevOps - CI/CD, Azure analytics services, Azure Machine learning services and Container Registry, PySpark)
*Extra points for working on Salesforce and cloud-based big data solutions using Hadoop/Spark
*BSc/BA in Computer Science, Statistics, Data Management or a related field
Spring Technology acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers. The Spring Group UK is an Equal Opportunities Employer.

By applying for this role your details will be submitted to Spring. Our Candidate Privacy Information Statement explaining how we will use your information is available on our website.

To speak to a recruitment expert please contact George Worthy-lloyd