Manager, Data Engineering Turnmill Street, London, EC1M Company Description Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally-enabled state, both in the way they work and the way they serve their customers. We help unlock value through a start-up mindset and modern methods, fusing strategy, consulting and customer experience with agile engineering and problem-solving creativity. United by our core values and our purpose of helping people thrive in the brave pursuit of next, our 20,000 people in 53 offices around the world combine experience across technology, data sciences, consulting and customer obsession to accelerate our clients’ businesses through designing the products and services their customers truly value. Job Description As Manager with our Data Engineering group, you will be responsible for consulting clients on data solutions. You will architect, design, estimate, developing and deploy cutting edge software products and services that leverage large scale data ingestion, processing, storage and querying, in-stream&batch analytics for Cloud and on-prem environments. Your role will be focused on delivering high quality solutions while driving design discussions across Data Engineering topics (ingestion, consumption, storage, computation, data models, performance, DevOps, Test automation&Security) to enables enterprise scale digital transformation of many of the biggest companies in the world. As a hands-on technologist you will be excited to join super talented and supportive community of Data Engineers who are passionate about building the best possible solutions for our clients and endorse a culture of life-long learning and collaboration. Qualifications Your Skills&Experience • Extensive experience with Data related technologies, to include knowledge of Big Data Architecture Patterns and Cloud services (AWS / Azure / GCP) • Experience delivering end to end Big Data solutions on premise and/or on Cloud • Knowledge of the pros and cons of various database technologies like Relational, NoSQL, MPP, Columnar databases • Expertise in the Hadoop eco-system with one or more distribution-like Cloudera and cloud specific distributions • Proficiency in Java and Scala programming languages (Python a plus) • Expertise in one or more NoSQL database (Mongo DB, Cassandra, HBase, DynamoDB, Big Table etc.) • Experience of one or more big data ingestion tools (Sqoop, Flume, NiFI etc.), distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub etc.) • Expertise with at least one distributed data processing framework e.g. Spark (Core, Streaming, SQL), Storm, Flink etc. • Knowledge of flexible, scalable data models addressing a wide variety of consumption patterns including random-access, sequential access including necessary optimisations like bucketing, aggregating, sharding • Knowledge of performance tuning, optimization and scaling solutions from a storage/processing standpoint • Experience building DevOps pipelines for data solutions, including automated testing Set yourself apart with • Knowledge of containerization, orchestration and Kubernetes engine • An understanding of how to setup Big data cluster security (Authorization/ Authentication, Security for data at rest, data in transit) • A basic understanding of how to manage and setup Monitoring and alerting for Big data clusters • Experience of orchestration tools – Oozie , Airflow , Ctr-M or similar • Experience of MPP style query engines like Impala, Presto, Athena etc. • Knowledge of multi-dimensional modelling like start schema, snowflakes, normalized and de-normalized models • Exposure to data governance, catalog, lineage and associated tools would be an added advantage • A certification in one or more cloud platforms or big data technologies • Any active participation in the Data Engineering thought community (e.g. blogs, key note sessions, POV/POC, hackathon) About You • You will enjoy client facing and/or consulting roles • You’ll have proven experience engaging with client technology architects to help shape solutions • You’ll have good communication, presentation, coordination, facilitation and negotiation skills • You’ll have good general analytical and problem solving skills • You will pick up new technologies quickly, compare/contrast by way of POCs as well as research • You’ll be a self-starter who requires minimal oversight and be able to prioritize and manage multiple tasks • You’ll demonstrate some mentoring skills • You will likely have a Bachelor’s/Master’s Degree in Computer Engineering, Computer Science, or a related field Additional Information As part of our dedication to an inclusive and diverse workforce, Publicis Sapient is committed to Equal Employment Opportunity without regard for race, colour, national origin, ethnicity, gender, disability, sexual orientation, gender identity, or religion. Publicis Sapient UK is a disability confident employer and is dedicated to fostering an inclusive and accessible work environment. We encourage individuals with disabilities and long-term conditions to apply for this position and we will provide adjustments where possible throughout the recruitment process. If you require any adjustments at any point on the process, please get in touch as soon as possible by emailing hiringukpublicissapient.com . Publicis Sapient UK will then work with you explore and implement adjustments as and where these are possible. If you have any questions regarding adjustments, please email us: hiringukpublicissapient.com Publicis Sapient fosters an inclusive environment through our inspirational business resource groups, to learn more please visit https://careers.publicissapient.com/life-at-ps/diversity-inclusion Benefits We have got you and your family covered with 25 days paid annual leave (plus bank holidays), life assurance, dental insurance, income protection, critical illness cover, private healthcare (pre-existing conditions included) and a pension We know the importance of health and wellbeing so offer you extensive retail discount offers and further reimbursement towards activities that contribute to a healthier lifestyle Free and delicious coffee served by our very own in-house baristas We are proud to actively invest in your learning through various learning platforms We work with you to give back to the local community through CSR efforts