Job Description
Data Engineer - London - Hybrid - Up to £100,000 I am currently working with a Leading Lloyd's Syndicate who are looking for a Data Engineer to build and run the core components of an effective Azure Data, Integration and Analytics/AI Platform. This position is paying up to £100,000 and would be based in the office 2/3 days per week. Duties and Responsibilities Leading and actively participating in hands-on design, development, and code review sessions, providing technical guidance to junior team members. Creating and maintaining documentation of data developments, best practices, and technical solutions. Designing, developing, and supporting core data engineering services such as data orchestration, data pipelines, ETL/ELT processes, data lakes, data warehouses, semantic models, and code deployment. Conducting impact assessments for changes to live systems and processes. Ensuring minimal technical debt and identifying opportunities for continuous improvement. Delivering high-quality work, including testing of data products, with a focus on automation where possible. Collaborating closely with the IT team and broader organization to govern and protect data, ensuring that all new developments align with best practices, technological standards, and agreed-upon designs. Keeping up-to-date with technological trends, state-of-the-art platforms, and industry advancements to provide input on the organization's strategic roadmap. Promoting innovation by rapidly building proofs of concept to validate new ideas and concepts. Skills and Experience Strong Azure data engineering expertise, contributing to platform growth while building deep technical knowledge of systems over time. Proven experience with Microsoft Data and Analytics components. Extensive experience in designing and building data platforms, including data warehouses and lakes. Comprehensive experience with the full data development lifecycle, including coding, testing, and managing code repositories using standard branching strategies and automated deployment methods. Familiarity with deployment activities such as release management, environment controls, CICD orchestration, DevOps, and ML Ops pipelines. Advanced skills in Structured Query Language (SQL) and a solid understanding of database administration. A commitment to developing world-class, reliable data solutions for critical business processes. The ability to quickly assimilate new and complex data sources, technologies, and concepts. Experience in the insurance industry is an advantage. If you would be interested in discussing this opportunity please apply now