802 data engineer jobs found in Indore

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : GCP Dataflow Good to have skills : Google BigQuery, Google Cloud Platform Architecture, Google Cloud DevOps Services Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary: A Data Engineer is a developer responsible for working with the Data Warehouse team to design, build and maintain new data warehouse hosted in Google Cloud for our independence initiative. This work includes all aspects of developing ETUELT data pipelines for the data warehouse. You will work closely with other smart data engineers that enjoy being productive and making a difference in a friendly and pragmatic environment in which each...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : GCP Dataflow Good to have skills : Google BigQuery, Google Cloud Platform Architecture, Google Cloud DevOps Services Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary: A Data Engineer is a developer responsible for working with the Data Warehouse team to design, build and maintain new data warehouse hosted in Google Cloud for our independence initiative. This work includes all aspects of developing ETUELT data pipelines for the data warehouse. You will work closely with other smart data engineers that enjoy being productive and making a difference in a friendly and pragmatic environment in which each...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : GCP Dataflow Good to have skills : Google BigQuery, Google Cloud Platform Architecture, Google Cloud DevOps Services Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary: A Data Engineer is a developer responsible for working with the Data Warehouse team to design, build and maintain new data warehouse hosted in Google Cloud for our independence initiative. This work includes all aspects of developing ETUELT data pipelines for the data warehouse. You will work closely with other smart data engineers that enjoy being productive and making a difference in a friendly and pragmatic environment in which each...

Big Data Engineer Responsibilities: Big Data Engineer with 5+ years of experience Experience in leading a team of engineers and a good attitude toward learning the domain and implementation Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS. Finalizing the scope of the system and delivering Big Data solutions. Collaborating with the software research and development teams. Training staff on data resource management. Engineering/Master's degree in computer engineering or computer science. In-depth knowledge of Hadoop, Spark, and similar frameworks. Excellent Interpersonal and communication skills. Ability to solve complex networking, data, and software issues.

Inviting Applications for Azure Data Engineer (Databricks) Job Title: Azure Data Engineer (Databricks) Experience Required: 5 to 10 Years Joining Location: Bangalore Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark Proficient with Databricks & Python Senior developers with Full Database/ Datawarehouse/ DataMart development capabilities Senior SME with SQL Server required. Proficiency with standard file formats and markup language technology such as JSON, XML, XSLT. Proficiency with Azure Cloud data environments highly desired. Excellent verbal communication skills. Good problem-solving skills. Attention to detail. Proficiency with Data Warehousing principals and design

At Skillsoft, we propel organizations and people to grow together through transformative learning experiences. We believe every team member has the potential to be AMAZING. Join us in our quest to transform learning and help individuals unleash their edge. Principal Data Engineer At Skillsoft, we are all about making work matter. We believe every team member has the potential to be AMAZING. We are bold, sharp, driven and most of all, true. Join us in our quest to democratize learning and help individuals unleash their edge. OVERVIEW : Reporting to the Sr. Director, Enterprise Data Strategy & Execution, the Principal - Data Management will act as a corporate data steward and resident expert in data availability, logical organization and relationships between data elements and business practices. The Principal-Data Management will be responsible for supporting Skillsoft strategic studies by ensuring data hygiene processes are followed by business partners, data assets are...

What this Job Entails: We are looking for a Data Engineer to lead in the creation, expansion, and optimization of our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The Data Engineer will support our data analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. Your Roles and Responsibilities: Create and maintain optimal data pipeline architecture Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources Build analytics tools that utilize the data pipeline to provide actionable insights into customer...

phData is revolutionizing how our clients use data and artificial intelligence. As thepremier services provider specializing in data application and data platform services, we partner with the leading technology companies across the modern data stack to deliver cutting-edge solutions. We are technology evangelists around critical ecosystem tools like Snowflake, AWS, Azure, dbt, Sigma, Tableau, and Power BI. We are passionate about helping global enterprises overcome their toughest challenges by building AI solutions and data applications and then getting these solutions into production. phData is a remote-first global company with employees based in the United States, Latin America and India. We celebrate the culture of each of our team members and foster a community of technological curiosity, ownership and trust. Even though we're growing extremely fast, we maintain a casual, exciting work environment. We hire top performers and allow you the autonomy to deliver results. 5x...

Sr.Data Engineer REQUIREMENTS Demonstrate knowledge and real-world experience on Big data technologies. A successful history of handling performance issues, processing, extracting issues and fixing bugs. • Experience managing and optimizing 'big data' data pipelines, architectures and data sets. • We are looking for a candidate with 7 + years of experience in a Data Engineer role. They should also have experience using the following software/tools: o Experience working on Azure data factory, Azure Synapse, Power Apps, Logic Apps. o Experience with relational SQL databases such as Oracle, SQL Server, MySQL and reading, writing and deducing technical logics from stored procedures o Experience on visualization tools such as PowerBI/Tableau o Experience supporting and working with cross-functional teams in a dynamic environment. Good Academic track record preferred. Certified DP-203, PL-300 and AZ-900 preferred. QUALIFICATIONS • Degree in Computer Science, Statistics,...

About the Role: We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing and scaling both stream and batch processing systems, and a solid understanding of public cloud technologies, especially GCP. This role involves working in a remote environment, requiring excellent communication skills and the ability to solve complex problems independently and creatively. What you will be doing Build a reusable, and reliable code for stream and batch processing systems at scale. This includes working with technologies like Pub/Sub, Kafka, Kinesis, DataFlow, Flink, Hadoop, Pig, Hive, and Spark. Implementing automation/DevOps best practices for CI/CD, IaC, Containerization, etc. Requirements About the Role: We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing batch...

As a Data Engineer with expertise in PySpark, Databricks, and Microsoft Azure, SQL you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and processing systems. You will work closely with data scientists, analysts, and other stakeholders to ensure our data solutions are efficient, reliable, and scalable. Responsibilities: • Design, develop, and optimize ETL pipelines using PySpark and Databricks to process large-scale data on the Azure cloud platform. • Implement data ingestion processes from various data sources into Azure Data Lake and Azure SQL Data Warehouse. • Develop and maintain data models, data schemas, and data transformation logic tailored for Azure. • Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets. • Ensure data quality and integrity through robust testing, validation, and monitoring procedures. • Optimize and tune PySpark jobs for performance and scalability...

Your Title :Data Engineer/Scientist Job Location: [Job Location] Our Department: Are you an enthusiastic and self-motivated Data Engineer eager to contribute their expertise to our dynamic and innovative team? Join us in leveraging data to drive meaningful business outcomes and contribute to the success of Trimble's data-driven initiatives. What You Will Do Unleash Your Potential as a Trimble Data Engineer! Craft data integration frameworks that sync with business needs and uphold security standards. The pivotal Trimble DataHub fuels our data strategy, impacting user satisfaction and company growth. Explore challenges across data domains, team up cross-functionally, and visualize crucial insights. Embrace multitasking and tech adaptability to thrive. Your path to impactful action starts here. Design, develop, and program methods, processes, and systems to analyze and consolidate diverse and unstructured "big data" sources. Generate actionable insights...

About Mindcurv (Part of Accenture Song) We help our customers rethink their digital business, experiences, and technology to navigate the new digital reality. We do this by designing sustainable and accountable solutions for humans living in a digital world. Mindcurv holistically covers the market's need to digitalise business processes and customer experiences and take advantage of the cloud following DevOps and agile principles. Your role The ideal candidate will have a strong background in working with SQL DB's, ETL processes, and cloud technologies, with a focus on building scalable data solutions. You will translate technical and business requirements into automated, operable, scalable and robust solutions. Your responsibilities will include: Designing, developing and optimizing SQL Database used for Analytics purposes Modeling SQL DB based on business requirements. Develop complex SQL queries, stored procedures (dynamic stored procedures), views, and triggers to support...

What we expect Work closely with data scientists, business analysts and other stakeholders to understand their data requirements and translate them into technical specifications and data models. Collaborate with data architects to design and implement cloud-based data solutions that align with business needs. Facilitate internal knowledge sharing to ensure team members are informed about the latest best practices Implement scalable and robust data pipelines from various enterprise source systems like SAP, Salesforce or similar Apply business rules and transformations using SQL or Python. Secure data models applying object and row level security. Develop and document best practices and ensure they are effectively implemented across the team Analyze and address issues related to data integrity, data design and both functional and technical aspects of the Cloud Data Warehouse. Communicate effectively about issues, solutions, and best practices with relevant stakeholders....

About Birlasoft: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a multibillion-dollar enterprise, we boast a 12,500+ professional team committed to upholding the Group's 162-year legacy. Our core values prioritize Diversity, Equity, and Inclusion (DEI) initiatives, along with Corporate Sustainable Responsibility (CSR) activities, demonstrating our dedication to building inclusive and sustainable communities. Join us in shaping a future where technology seamlessly aligns with purpose. About the Job: As a Data engineers you will work with Data Scientists to improve the quality and accuracy of the information, enabling businesses to make more responsible business decisions. You will also...

ABOUT US: LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across financial markets, we enable businesses and economies around the world to fund innovation, manage risk and create jobs. It's how we've contributed to supporting the financial stability and growth of communities and economies globally for more than 300 years. Through a comprehensive suite of trusted financial market infrastructure services - and our open-access model - we provide the flexibility, stability and trust that enable our customers to pursue their ambitions with confidence and clarity. LSEG is headquartered in the United Kingdom, with significant operations in 65 countries across EMEA, North America, Latin America and Asia Pacific. We employ 25,000...

Thank you for considering the Lead Data Engineer position at Reveal Health Tech. We are an early-stage IT startup based in the US and India, focused on leveraging technology to deliver transformative healthcare solutions. Location: India Working Hours: we would ideally like the candidate to be able to work with us until 11:30 am PST. The shift timing would be from 4PM IST - 12.00AM IST. This is a completely remote opportunity. ABOUT THE ROLE We are seeking a skilled Lead Data Engineer proficient in AWS services to join our dynamic team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines to support our growing data processing needs. The ideal candidate is independent, detail-oriented, and capable of performing data validation and debugging to ensure high data quality and reliability. Find out more about our mission and why we started Reveal Health Tech on our website. Requirements Responsibilities...

Responsibilities: Analyze and organize raw data Evaluate business needs and objectives Build data pipelines to convert the raw data into data products using ETL / ELT tools Manage data, metadata and pipeline stability Work with data analytics experts and SME to strive for greater functionality in our data system Work with Stakeholders including Product, Data and Design teams to assist with data related technical issues and support their data engineering needs Qualification: Expert Level in SQL Python Programming Between 5 and 10 years of experience in similar roles Proficient in writing complex SQL, Stored Procedures Familiar with Snowflake architecture and warehouse implementation and management Working experience of cloud computing architecture Git VCS hands-on Experience with data pipeline and workflow management tools like Airflow Proficient in performing root cause analysis of existing models and proposing a solution Dev-ops experience...

Data Engineer, Data Engineering Headquartered in Dublin, Ohio, Cardinal Health, Inc. (NYSE: CAH) is a global, integrated healthcare services and products company connecting patients, providers, payers, pharmacists and manufacturers for integrated care coordination and better patient management. Backed by nearly 100 years of experience, with more than 50,000 employees in nearly 60 countries, Cardinal Health ranks among the top 20 on the Fortune 500. Department Overview: AAA (Advanced Analytics & Automation) builds automation, analytics and artificial intelligence solutions that drive success for Cardinal Health by creating material savings, efficiencies and revenue growth opportunities. The team drives business innovation by leveraging emerging technologies and turning them into differentiating business capabilities. Job Overview: Designing, building and operationalizing large-scale enterprise data solutions and applications using one or more of Google Cloud...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Job Description: - Our Technology team builds innovative digital solutions rapidly and at scale to deliver the next generation of Financial and Non- Financial services across the globe. The Position is a senior technical, hands-on delivery role, requiring the knowledge of data engineering, cloud infrastructure and platform engineering, platform operations and production support using ground-breaking cloud and big data technologies. The ideal candidate with 6-8 years of experience, will possess strong technical skills, an eagerness to learn, a keen interest on 3 keys pillars that our team support i.e. Financial Crime,...

Overview of 66degrees 66degrees is a leading consulting and professional services company specializing in developing AI-focused, data-led solutions leveraging the latest advancements in cloud technology. With our unmatched engineering capabilities and vast industry experience, we help the world's leading brands transform their business challenges into opportunities and shape the future of work. At 66degrees, we believe in embracing the challenge and winning together. These values not only guide us in achieving our goals as a company but also for our people. We are dedicated to creating a significant impact for our employees by fostering a culture that sparks innovation and supports professional and personal growth along the way. Overview of Role 66degrees is looking for driven, passionate data engineering professionals who want to make an impact with their work. As a Cloud Data Engineer at 66degrees, you'll have the opportunity to grow and apply your expertise with...

Company Description Miratech helps visionaries change the world. We are a global IT services and consulting company that brings together enterprise and start-up innovation. Today, we support digital transformation for some of the world's largest enterprises. By partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and create technology that helps our clients further enhance their business. We are a values-driven organization and our culture of Relentless Performance has enabled over 99% of Miratech's engagements to succeed by meeting or exceeding our scope, schedule, and/or budget objectives since our inception in 1989. Miratech has coverage across 5 continents and operates in over 25 countries around the world. We currently have R&D centers in Ukraine, India, Poland, Spain, Canada and our headquarters in the US. As we continue to expand globally, we are seeing India, the United States, Canada,...

Vacancy Name Cloud Data Engineer Vacancy No VN1121 Business Unit EMEA Job Location India Employment Type Full Time Job Details and Responsibilities We are seeking an experienced Cloud Data Engineer with a strong background in AWS, Azure, and GCP. The ideal candidate will have extensive experience in data platform migration and building modern data platform with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for legacy data platform/data warehouses migrations like Hadoop, Teradata, Oracle etc and designing, implementing, and maintaining robust data pipelines and building scalable data lakes. Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential. Design and Development: Migration of Data and ETL workflows to modern data platform on cloud. Design, develop, and...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Position Description Summary Position Details: Job Title : Associate - EDS Job purpose As an Associate, you will collaborate with business, reporting, and other teams to understand business requirements and perform data analysis. Get involved in project transition from different teams, do enhancements, modifications and support post transition as needed. This opportunity will allow you to be instrumental in leading, designing, mentoring, and implementing our next generation of reporting and data analytic business solutions. You will work with back end data teams to construct data objects necessary for supporting...