Data Engineer

Data Engineer 6 months Redhill, Surrey - hybrid working (2-3 days pw in office) Up to £500 per day (inside IR35) Reporting into the Head of Data & Analytics, this role sits in the Data & Analytics team alongside Data Developers and Data Engineers. Key Responsibilities: * Development and automation of ingestion flows, data curation and access layers - Define technical solutions and take part in the development and deployment of applications in accordance with central standard and guidelines - Contribute to the improvement of standards, compliance and processes to guide Data Lake evolution - Design, develop, test and deploy data ingestion flows, data marts and core target data components - Implement tools and end-to-end monitoring to ensure high availability of production data processing, data quality and reliability * Maintenance of data transformation routes in the Data Lake - Maintenance of BAU including reporting regularly on performance, risks and issues Key Skills: * Experience working within multi-disciplinary data teams * Fluent with the Big Data stack in cloud environment (ADLS, Databricks, ADF, Azure DevOps etc) * Knowledge and experience of reporting solution design including Azure platforms, Pegasus, Attunity, Wax, R, SQL, Python, Spark, Power BI, Business Objects * Proficient in RESTful API design, implementation and consumption * You have a deep understanding of data lake technologies, interrogation of structures and unstructured data, data warehouse and data schema design for optimised reporting performance * You have a very good understanding of spark processes * You are fluent in multiple development languages * You have a good understanding of the software development process (git, ci/cd etc.) *please note we cannot offer visa sponsorship We are committed to creating an inclusive recruitment experience.If you have a disability or long-term health condition and require adjustments to the recruitment process, our Adjustment Concierge Service is here to support you. Please reach out to us at to discuss further. ADZN1_UKTJ