3998 lead data engineer jobs found

We're seeking a Lead Data Engineer, experienced in GCP, to join our Technology team here at N Brown Group! This role is a balance of hands-on data engineering alongside technical leadership and coaching, working within an agile operating environment.  What will you do as a Lead Data Engineer at N Brown? Lead a team of engineers in creating, maintaining, and extending our analytics platform  Data ETL - Design patterns for ingesting, transforming, and exposing data Drive adoption of strong CI/CD practices to reduce deployment risks Coach your team in best practices and coding standards Develop your team's software development capabilities Collaborate across technology squads and teams Work within an agile operating model with cross-functional teams Manage the Analytics Platform, ensuring reliability, scalability, and security What skills and experience will you have? Strong communication skills, able to convey complex technical concepts to various audiences Experience delivering...

Lead Data Engineer - Outside IR35 - Remote with occasional travel to Newcastle - 3 months+ All applicants must hold an active SC clearance. My client is a global IT consultancy. They are on the hunt for a Lead Data Engineer to join a central government client in Newcastle. This role is predominately remote, requiring a couple days a month in Newcastle. The successful candidate will have experience with Quantexa and/or Data Bricks. Lead Data Engineer - Outside IR35 - Remote with occasional travel to Newcastle - 3 months+ Damia Group Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept our Data Protection Policy which can be found on our website. Please note that no terminology in this advert is intended to discriminate on the grounds of a person's gender, marital status, race, religion, colour, age, disability or sexual orientation. Every candidate will be assessed...

Lead Data Engineer, SC Clearance required, outside IR35, travel once/ twice a month to newcastle  Role Overview:   We are seeking a Lead Data Engineer to join our team. In this role, you will be responsible for designing, implementing, and maintaining data pipelines and frameworks that support data-driven decision-making. You will work collaboratively with cross-functional teams to ensure data integrity and accessibility while providing technical leadership to junior engineers. This position is outside IR35. Responsibilities:   - Design and develop robust data pipelines using Quantexa and Databricks.   - Collaborate with data scientists and analysts to understand data requirements and provide solutions.   - Ensure the reliability, scalability, and performance of data systems.   - Lead and mentor a team of data engineers, fostering a culture of continuous improvement.   - Manage data integration processes and maintain data quality standards.   - Implement best practises...

Company Summary DISH, an EchoStar company, has been reimagining the future of connectivity for more than 40 years. Our business reach spans satellite television service, live-streaming and on-demand programming, smart home installation services, mobile plans and products and now we are building America's First Smart Network™. Today, our brands include EchoStar, Hughes, DISH TV, Sling TV, Boost Mobile and Gen Mobile. Summary Our Technology teams challenge the status quo and reimagine capabilities across industries. Whether through research and development, technology innovation or solution engineering, our people play vital roles in connecting consumers with the products and platforms of tomorrow. Job Duties and Responsibilities Develop enterprise-ready, secure and compliant data-oriented solutions leveraging Data Warehouse and Big Data frameworks Optimizing data engineering pipelines Reviews architectural designs to ensure consistency & alignment with defined...

Razorpay was founded by Shashank Kumar and Harshil Mathur in 2014. Razorpay is building a new-age digital banking hub (Neobank) for businesses in India with the mission is to enable frictionless banking and payments experiences for businesses of all shapes and sizes. What started as a B2B payments company is processing billions of dollars of payments for lakhs of businesses across India. We are a full-stack financial services organisation, committed to helping Indian businesses with comprehensive and innovative payment and business banking solutions built over robust technology to address the entire length and breadth of the payment and banking journey for any business. Over the past year, we've disbursed loans worth millions of dollars in loans to thousands of businesses. In parallel, Razorpay is reimagining how businesses manage money by simplifying business banking (via Razorpay X) and enabling capital availability for businesses (via Razorpay Capital). The Role: We are...

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose - the relentless pursuit of a world that works better for people - we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Senior Principal Consultant- Lead Data Engineer! Responsibilities • (The primary tasks, functions and deliverables of the role) • Design and build reusable components, frameworks and libraries at scale to support analytics products • Design and implement product features in collaboration with business and Technology stakeholders • Identify and solve issues concerning data management to improve data...

Who We Are At Kenvue, we realize the extraordinary power of everyday care. Built on over a century of heritage and rooted in science, we're the house of iconic brands - including NEUTROGENA®, AVEENO®, TYLENOL®, LISTERINE®, JOHNSON'S® and BAND-AID® that you already know and love. Science is our passion; care is our talent. Our global team is made by 22,000 diverse and brilliant people, passionate about insights, innovation and committed to deliver the best products to our customers. With expertise and empathy, being a Kenvuer means to have the power to impact life of millions of people every day. We put people first, care fiercely, earn trust with science and solve with courage - and have brilliant opportunities waiting for you! Join us in shaping our future-and yours. What You Will Do The Lead Data Engineer is responsible for Software Development Engineering and performing work in the following areas:• Data Engineering & Data Modelling: Creating data architectures and...

Our team members are at the heart of everything we do. At Cencora, we are united in our responsibility to create healthier futures, and every person here is essential to us being able to deliver on that purpose. If you want to make a difference at the center of health, come join our innovative company and help us improve the lives of people and animals everywhere. Apply today! Job Details PRIMARY DUTIES AND RESPONSIBILITIES: • Leads design, development, and automation of scalable Analytic data engineering products leveraging Machine Learning, cloud infrastructure • Leads the design, build and operationalization of monitoring and tracking of data quality and data flow dynamics • Optimizes existing data processes and implements best-in-class data transformation capabilities • Leverages advanced statistical and computational methodologies to deliver insights and identify strategic opportunities • Implements Data Ingestion Framework and other re-usable components leveraged for...

Nasdaq Technology is looking for a passionate Lead Data Engineer with a focus on software development, to join the Bangalore technology center in India. If Innovation and effectiveness drive you forward this is the place for you! Nasdaq is continuously revolutionizing markets and undergoing transformations while we adopt new technologies to develop innovative solutions, constantly aiming to rewrite tomorrow. As a Lead Data Engineer, you will play a key role in the delivery of complex technical systems of varying sizes to new and existing customers and will be part of discovering new technologies within the FinTech industry. We are now looking for a Lead Data Engineer to strengthen the Corporate Access Platform's AI COE team in Bangalore. You will be responsible for driving the execution of initiatives across the Capital Access Platform's AI COE program to help various business operations and process simplification and introduce automation via Artificial Intelligence and drive...

Lead Data Engineer Are you passionate to work with the team on commercially-facing development projects, typically involving large, complex data sets? Are you interested in driving business analytics to a new level of predictive analytics while leveraging big data tools and technologies. Join our Data Engineering Team! The Data Engineering team helps solve our customers' toughest challenges; making flights safer, power cheaper, and oil & gas production safer for people and the environment by leveraging data and analytics. The Data Engineer will work with the team to create state-of-the-art data and analytics driven solutions, working across Baker Hughes to drive business analytics to a new level of predictive analytics while leveraging big data tools and technologies. Partner with the best As a Staff Data Engineer, you will be part of a data engineering or cross-disciplinary team on commercially-facing development projects, typically involving large, complex data...

About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now as an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging proprietary business & consumer databases. Data Axle Pune is pleased to have achieved certification as a Great Place to Work ! Roles & Responsibilities: We are looking for a Tech Lead Data Engineer who will be responsible for the following. Design, implement and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power. Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies. Creation and support of real-time data pipelines built on AWS technologies...

Category Essential for this role Good to have Work Experience Minimum 10 years of experience in data analytics field Minimum 6 years of experience in running operation and support in Cloud Data Lakehouse environment Experience with Azure Databricks Experience in building and optimizing data pipelines, architectures and data sets Excellent experience in Scala or Python Ability to troubleshoot and optimize complex queries on the Spark platform Knowledgeable on structured and unstructured data design / modeling, data access and data storage techniques Experience with DevOps tools and environment Data Engineering expertise in Big Data Management using Cloudera, Python, Hive, Scala, Data Warehouse, Data Lake Technical / Professional Skills Please provide at least 3 Azure Databricks Python / Scala / Java HIVE / HBase / Impala / Parquet Sqoop, Kafka, Flume SQL and RDBMS Airflow Jenkins / Bamboo Github /...

Job Description Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development of processing and analysis algorithms fit for the intended data complexity and volumes. Collaboration with data scientist to build and deploy machine learning models. Assistant Vice President Expectations To advise and influence decision making, contribute to policy development and take responsibility for operational effectiveness. Collaborate closely with other functions/ business divisions. Lead a team...

Who We Are At Kenvue, we realize the extraordinary power of everyday care. Built on over a century of heritage and rooted in science, we're the house of iconic brands - including NEUTROGENA®, AVEENO®, TYLENOL®, LISTERINE®, JOHNSON'S® and BAND-AID® that you already know and love. Science is our passion; care is our talent. Our global team is made by 22,000 diverse and brilliant people, passionate about insights, innovation and committed to deliver the best products to our customers. With expertise and empathy, being a Kenvuer means to have the power to impact life of millions of people every day. We put people first, care fiercely, earn trust with science and solve with courage - and have brilliant opportunities waiting for you! Join us in shaping our future-and yours. What You Will Do The Lead Data Engineer is responsible for Software Development Engineering and performing work in the following areas:• Data Engineering & Data Modelling: Creating data architectures and...

Lead Data Engineer As an employee at Thomson Reuters, you will shape and lead the global knowledge economy. Our technology drives global markets and helps professionals worldwide make decisions that matter. Whether solving for today's challenges or tomorrow's aspirations, you will work with the industry's brightest thinkers on diverse projects, creating next-generation solutions that deliver powerful results. As the world's leading provider of intelligent information, we want your unique perspective to create the solutions that advance our business-and your career. About the Role As a Lead Data Engineer, you will: Actively engage in building robust ETL solutions using Informatica. Senior-level expertise in Informatica ETL development. Understand source data and map sources to target design using the Informatica ETL tool. Develop data movement processes for the data warehouse. Collaborate closely with IT and business team members on the design and implementation of...

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, we're a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth - bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future. We are looking forward to hire PySpark Professionals in the following areas : Experience 8+ years Job Description 8+ years of professional experience in development and support 4+ years of experience in hands on work on PySpark Areas of expertise include Big Data Technologies like Hadoop, Spark, Impala, HDFS, Hive, Sqoop, Yarn, Java, Oracle database. Good knowledge on Cloud technologies like Azure and AWS Worked on Azure data factory, blobs, Azure SQL, and Azure Data Lake...

Know us a little better! The Landmark Group, founded in 1973, has a diverse portfolio of retail and hospitality brands. It has successfully grown into one of the largest and most successful retail conglomerates in the MENA region with an entrepreneurial culture focused on delivering exceptional value. The Group employs over 45,000 people and operates over 1,600 outlets covering 22 million square feet across 19 countries in the Middle East, North Africa, and India region. Built with love and loads of effort by many smart, talented, and passionate Landmarks, our goal is simple: to deliver high impact to all business functions and institutionalize data driven decision making. The Landmark Group is one of the leading retail and hospitality organizations in the Middle East and India. Its vast portfolio of successful businesses includes award-winning household brands like Lifestyle, Max, Splash and Home Centre. Culturally we are an open organization with No Cabin culture and with Lean...

CES has 26+ years of experience in delivering Software Product Development, Quality Engineering, and Digital Transformation Consulting Services to Global SMEs & Large Enterprises. CES has been delivering services to some of the leading Fortune 500 Companies including Automotive, AgTech, Bio Science, EdTech, FinTech, Manufacturing, Online Retailers, and Investment Banks. These are long-term relationships of more than 10 years and are nurtured by not only our commitment to timely delivery of quality services but also due to our investments and innovations in their technology roadmap. As an organization, we are in an exponential growth phase with a consistent focus on continuous improvement, process-oriented culture, and a true partnership mindset with our customers. We are looking for the right qualified and committed individuals to play an exceptional role as well as to support our accelerated growth. You can learn more about us at: http://www.cesltd.com/ Job Role: We are...

Job Description Position Overview: We are seeking a skilled and experienced Lead Data Engineer to join our growing data team. This role will involve designing, building, and maintaining scalable data pipelines and ETL processes. You will lead a team of data engineers and collaborate with data scientists, analysts, and stakeholders across the organization to deliver solutions that drive business insights. Key Responsibilities: Lead the design, development, and implementation of data pipelines and ETL workflows using Matillion and Databricks. Architect and implement data solutions in AWS, including but not limited to Amazon S3, AWS Glue, Amazon Redshift, and Amazon RDS. Manage and optimize workflow orchestration using Apache Airflow to ensure reliable data processing and job scheduling. Collaborate with cross-functional teams to gather requirements and translate them into scalable data architecture and process designs. Mentor and guide junior data engineers, providing...

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential. We are searching for a skilled Lead Data Engineer to enhance our energetic team. In the role of Lead Data Engineer, you will take charge of creating, building, and sustaining data integration solutions for our clientele. Your leadership will guide a team of engineers towards achieving high-quality, scalable, and efficient data integration solutions. This role presents a thrilling challenge for...

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential. We are looking for a skilled Lead Data Engineer to become an integral part of our vibrant team. In this role, you will take charge of designing, developing, and maintaining data integration solutions tailored to our clients' needs. You will oversee a team of engineers, ensuring the delivery of high-quality, scalable, and efficient data integration solutions. This role presents a thrilling...

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential. We are looking for a skilled Lead Data Engineer to enhance our dynamic team. In this role, you will focus on designing, developing, and maintaining data integration solutions for our clients. Your leadership will guide a team of engineers in delivering scalable, high-quality, and efficient data integration solutions. This role is perfect for an experienced data integration expert who is...

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential. We are looking for a skilled Lead Data Engineer to become an integral part of our vibrant team. In this role, you will take charge of designing, developing, and maintaining data integration solutions tailored to our clients' needs. You will oversee a team of engineers, ensuring the delivery of high-quality, scalable, and efficient data integration solutions. This role presents a thrilling...

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential. We are searching for a skilled Lead Data Engineer to enhance our energetic team. In the role of Lead Data Engineer, you will take charge of creating, building, and sustaining data integration solutions for our clientele. Your leadership will guide a team of engineers towards achieving high-quality, scalable, and efficient data integration solutions. This role presents a thrilling challenge for...