Job Description
Job Title: Data Engineer Salary: £700 Umbrella (6 Months) We are looking for a forward thinking Data Engineer to build a robust Vault 2.0 architecture on Snowflake, to better serve and deliver valuable data products to our customers (internal and end-client). Key Responsibilities: 1. Data Vault 2.0 Implementation: o Design and implement Data Vault 2.0 architecture on the Snowflake data platform. o Develop and maintain hubs, links, and satellites in the Data Vault 2.0 model. 2. Data Integration: o Build robust and scalable data pipelines to ingest and process data from various sources (e.g., databases, APIs, streaming platforms). o Implement ETL/ELT processes to ensure efficient data loading, transformation, and storage. 3. Data Marts: o Design and build data marts to support business intelligence and analytical requirements. o Collaborate with business stakeholders to understand data needs and deliver tailored data products. 4. Performance Optimization: o Optimize data models, queries, and storage solutions for performance and cost efficiency. o Monitor and troubleshoot performance issues in data pipelines and data warehouses. 5. Collaboration&Communication: o Work closely with analysts, and business stakeholders to gather requirements and deliver data solutions. 6. Documentation&Standards: o Create and maintain comprehensive documentation- we use confluence o Adhere to industry best practices and company standards for data engineering and governance. Required Skills and Qualifications • Technical Expertise: o Proven experience with Data Vault 2.0 methodology. o Hands-on experience with Snowflake data platform. o Proficiency in SQL and ETL/ELT processes. o Experience with data streaming technologies (e.g., Kafka, Kinesis). • Programming&Tools: o Strong programming skills in Python, Java, or similar languages. o DBT hands on experience would be preferred. • Analytical Skills: o Strong analytical and problem-solving skills. o Ability to design scalable and efficient data models. • Communication: o Independent minded/self starter- We are a small team, with a lot to work out still. o Excellent written and verbal communication skills. o Ability to work effectively in a collaborative team environment. Would suit a data engineer with good exposure to architecture. Vault exposure within FS would be good. A pragmatic self starter, who is comfortable working in a small team.