884 python pyspark developer jobs found

TCS Inviting Application for Python / Pyspark developer Exp 5 Yrs to 10 Yrs "Proficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL. - Experience in data processing and manipulation using Spark transformations and actions. - Knowledge of Spark architecture and optimization techniques for performance tuning. - Competence in programming languages such as Scala, Python, or Java for Spark development. - Experience in working with big data technologies and distributed computing environments. - Strong problem-solving skills and the ability to troubleshoot issues in Spark applications. - Proficiency in version control systems like Git for collaborative development projects"

Exp : Lead Data Engineers : Python+Cloud+SQL with exposure to Snowflake (8 Year+ Exp) Sr. Data Engineer : Python+Cloud+SQL with exposure to Snowflake (6 Years + Exp) Data Engineers : Python+Cloud+SQL with exposure to Snowflake Mid Level ( 3-6 Years Exp)

Job Description Summary -The primary responsiblity is to support the Strategy team in projects and operational tasks. The position holder ensures full transparency of ongoing projects progress and budget overview. -Support Senior Strategy Managers and Directors in projects around key Novartis products in major markets, that -Deliver substantially greater outcome improvement than from the product alone -Deliver substantially greater financial rewards for Novartis based on this Job Description Data Analyst Location - Hyderabad #LI Hybrid About the Role: Data Analyst needs to support multiple data centric activities such as data engineering, data quality, data analytics other data management activities by working closely with business, data strategy teams and IT. Work under the guidance of Data Manager in agile team to build the data solutions using approved tech stack and should be able to support the ongoing engagements with Novartis business teams. Key...

Job Description Mandatory Skills Bachelor's or higher degree in Computer Science or a related discipline; or equivalent (minimum 2+ years work experience). At least 1+ years of consulting or client service delivery experience on Azure At least 1+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server and data warehouse solutions such as Synapse/Azure Databricks Hands-on experience implementing data ingestion, ETL and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Databricks, Azure Purview, Cosmo DB etc. Minimum of 1+ years of hands-on experience in Azure and Big Data technologies such as Java, Python, SQL, ADLS/Blob, pyspark/SparkSQL, Databricks. Minimum of 1+ years of RDBMS experience Experience in using Big Data File Formats and compression...

Python Developer Category: Software Development/ Engineering Main location: India, Karnataka, Bangalore Position ID:J0924-0260 Employment Type: Full Time Position Description: At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72,000 professionals located in 40 countries. Founded in 1976, CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise, stability and dedicated professionals needed to achieve. At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72,000 professionals located in 40 countries. Founded in 1976, CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise, stability and dedicated professionals needed to achieve...

Job Description Summary As a Data Engineer you will builds data intensive products, pipelines and systems leveraging data engineering best practices and strength in data ingestion, modeling, extraction, and highly scalable data management systems Job Description Where data is the primary challenge (quantity of data, the complexity of data, or the speed at which it is changing), increasing business value, enhancing BR decision-making and enabling a data-centric culture by implementing data-intensive products, platforms, pipelines, and systems sharing data-intensive expertise, tools, and techniques implementing and improving the health, security, integrity, and quality of our interconnected data ecosystem Major Accountabilities: Build and deploy production systems for scientists who have high expectations for quality, turnaround, performance and reliability. Contribute to the creation of a reusable, reliable, observable platform for ingesting a large number of...

Job Description Summary As a Data Engineer you will work with Architects and builds data intensive products, platforms, and leveraging data engineering best practices and strength in data ingestion, extraction, and highly scalable data management systems. Job Description Where data is the primary challenge (quantity of data, the complexity of data, or the speed at which it is changing), focusing on increasing business value, enhancing BR decision-making and enabling a data-centric culture by designing and implementing data-intensive products, platforms, pipelines, and systems sharing data-intensive expertise, tools, and techniques implementing and improving the health, security, integrity, and quality of our interconnected data ecosystem Major Accountabilities: Build and deploy production systems for scientists who have high expectations for quality, turnaround, performance and reliability. Create and promote reusable and interoperable systems and the...

Company Description Who we are Miratech is a global IT services and consulting company that brings together global enterprise innovation and start-up innovation. Today we support digital transformation for the largest enterprises on the planet. Our highly professional team achieves success with 99% of IT projects in financial, telecommunication and technology domains since Miratech inception in 1989. Technical complexity is our passion, stability is our standard, friendly work environment is our style. We empower our employees to grow together with the company, to achieve ambitious goals, to be a part of international relentless team which helps the visionaries to change the world. Job Description Our client is dedicated to developing products and capabilities that quantify the impact of climate risk and other sustainability factors on financial assets. This initiative is central to our technology strategy, providing a common language and a main point of reference for our...

Description PySpark Developer Strong experience in technical leadership, mentoring MDM team of size approx. 10. Work experience 6+ years with skillset in Python (Pandas/ NumPy), PySpark Developer. Minimum 3 years of experience in build & deployment of Bigdata applications using SparkSQL. Hands-on experience in generating/parsing XML, JSON documents, and REST API request/responses Hands-on experience writing complex SQL queries, exporting and importing large amounts of data using utilities. Strong in Algorithms and Data structures.Hands-on experience in building MDM solutions using technologies, such as Reltio or similar. Experience in design, implement and deploying AWS Lambda and triggers. Good to have: Proficient in MDM technical design, industry standards, best patterns, and unit test automation practices.

Job Description Bachelors or higher degree in Computer Science or a related discipline; or equivalent (minimum 5 years work experience). At least 2+ years of consulting or client service delivery experience on Azure At least 2+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server and data warehouse solutions such as Azure Synapse Extensive experience providing practical direction with using Azure Native services. Extensive hands-on experience implementing data ingestion, ETL and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Azure Logic App Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Databricks, Cosmo DB etc. Minimum of 2+ years of hands-on experience in Azure and Big Data technologies such as Java, Python, SQL, ADLS/Blob, PySpark and SparkSQL, Databricks, HD Insight and live streaming...

Data Engineer M2C Pune This is Worldline We are the innovators at the heart of the payments technology industry, shaping how the world pays and gets paid. The solutions our people build today power the growth of millions of businesses tomorrow. From your local coffee shop to unicorns and international banks. From San Francisco to Auckland. We are in every corner of the world, in every part of commerce. And just as we help our customers accelerate their business, we are committed to helping our people accelerate their careers. Together, we shape the evolution. The O pportunity At Worldline, our technology addresses the persistent challenges of the payment world. We design and operate leading digital payment and transactional solutions that enable sustainable economic growth and reinforce trust and security in our societies. If you are a highly skilled Product Owner who has a creative mind and passionate about delivering quality code, then get ready to join our...

Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : BE Summary: As a Software Development Lead, you will be responsible for developing and configuring software systems using Python. Your typical day will involve applying your knowledge of technologies, methodologies, and processes to support a client or project in Bengaluru. Roles & Responsibilities: - Lead the development and configuration of software systems using Python, applying knowledge of technologies, applications, methodologies, processes, and tools. - Strong exposure to Python/R programming language with exposure to NLP...

Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : BE Summary: As a Software Development Lead, you will be responsible for developing and configuring software systems using Python. Your typical day will involve applying your knowledge of technologies, methodologies, and processes to support a client or project in Bengaluru. Roles & Responsibilities: - Lead the development and configuration of software systems using Python, applying knowledge of technologies, applications, methodologies, processes, and tools. - Strong exposure to Python/R programming language with exposure to NLP...

Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : BE Summary: As a Software Development Lead, you will be responsible for developing and configuring software systems using Python. Your typical day will involve applying your knowledge of technologies, methodologies, and processes to support a client or project in Bengaluru. Roles & Responsibilities: - Lead the development and configuration of software systems using Python, applying knowledge of technologies, applications, methodologies, processes, and tools. - Strong exposure to Python/R programming language with exposure to NLP...

Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : BE Summary: As a Software Development Lead, you will be responsible for developing and configuring software systems using Python. Your typical day will involve applying your knowledge of technologies, methodologies, and processes to support a client or project in Bengaluru. Roles & Responsibilities: - Lead the development and configuration of software systems using Python, applying knowledge of technologies, applications, methodologies, processes, and tools. - Strong exposure to Python/R programming language with exposure to NLP...

Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : BE Summary: As a Software Development Lead, you will be responsible for developing and configuring software systems using Python. Your typical day will involve applying your knowledge of technologies, methodologies, and processes to support a client or project in Bengaluru. Roles & Responsibilities: - Lead the development and configuration of software systems using Python, applying knowledge of technologies, applications, methodologies, processes, and tools. - Strong exposure to Python/R programming language with exposure to NLP...

It's fun to work in a company where people truly BELIEVE in what they are doing! We're committed to bringing passion and customer focus to the business. JOB DESCRIPTION: If you are an extraordinary developer and who loves to push the boundaries to solve complex business problems using creative solutions, then we wish to talk with you. As a Data Engineer -Azure, you will work in the Technology team that helps deliver our Data Engineering offerings at large scale to our Fortune clients worldwide. The role is responsible for innovating, building and maintaining technology services. RESPONSIBILITIES: Be an integral part of large scale client business development and delivery engagements Develop the software and systems needed for end-to-end execution on large projects Work across all phases of SDLC, and use Software Engineering principles to build scaled solutions Build the knowledge base required to deliver increasingly complex technology projects Team handling, problem...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS - Data and Analytics (D&A) - Azure Data engineers - Staff As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We are currently seeking a seasoned Azure Data Engineer with proven experience in Databricks PySpark to join our team of professionals. The successful candidate will play a key...

Job Description Mandatory Skills Bachelor's or higher degree in Computer Science or a related discipline; or equivalent (minimum 2+ years work experience). At least 1+ years of consulting or client service delivery experience on Azure At least 1+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server and data warehouse solutions such as Synapse/Azure Databricks Hands-on experience implementing data ingestion, ETL and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, Databricks, Azure Purview, Cosmo DB etc. Minimum of 1+ years of hands-on experience in Azure and Big Data technologies such as Java, Python, SQL, ADLS/Blob, pyspark/SparkSQL, Databricks. Minimum of 1+ years of RDBMS experience Experience in using Big Data File Formats and compression...

Python Developer Category: Software Development/ Engineering Main location: India, Andhra Pradesh, Hyderabad Position ID:J0824-0083 Employment Type: Full Time Position Description: At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72,000 professionals located in 40 countries. Founded in 1976, CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise, stability and dedicated professionals needed to achieve. At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72,000 professionals located in 40 countries. Founded in 1976, CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise, stability and dedicated professionals needed to achieve...

JOB Description - Cloud Data Engineer Greetings from CG Infinity!! Please find below the JD for Cloud Data Engineer . Company Name: CG Infinity ( www.cginfinity.com ) Job Location- Noida Sector 3 Job title: Cloud Data Engineer No. of Positions: Multiple Work Location: Noida Years of experience: 4 years above Full-time opportunity About the role: CG Infinity is looking for a Software Engineer to join our engineering team and help us develop and maintain various software products. As a developer, you will help us in the development of new applications and delivery using CI/CD pipelines. We offer an inspiring environment full of talented people and rich culture. You also get freedom to implement your owns designs, solutions and creativity. Desired Skills: Technology graduate with min 3 years of development experience in Cloud and data - Azure SQL, Azure Data factory, Azure Data Pipeline, Data Lakes, Terraform, Database Design, Cloud Infrastructure...

Project Role : Software Development Lead Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : BE Summary: As a Software Development Lead, you will be responsible for developing and configuring software systems using Python. Your typical day will involve applying your knowledge of technologies, methodologies, and processes to support a client or project in Bengaluru. Roles & Responsibilities: - Lead the development and configuration of software systems using Python, applying knowledge of technologies, applications, methodologies, processes, and tools. - Strong exposure to Python/R programming language with exposure to NLP...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS - Data and Analytics (D&A) - Azure Data engineers - Senior As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We are currently seeking a seasoned Azure Data Engineer with proven experience in Databricks PySpark to join our team of professionals. The successful candidate will play a key...

Requisition Number: 98013 Data Scientist - DATA About Insight: Founded in 1998, Insight is headquartered in Chandler, Arizona, USA and has more and has more than 13000+ Teammates worldwide with global presence in Canada, United Kingdom, Germany, Australia, India, Singapore and many more. With offices in the prime location -Gurgaon and Bangalore we have 1000+ teammates operating from India. As a Fortune 500-ranked global provider of Digital Innovation, Cloud Data Center Transformation and Supply Chain Optimization solutions and services, we help clients successfully manage their IT today while transforming for tomorrow, recognized for its excellence. About the team Join us at the Data & AI Division , where we're not just another tech Division-we're the driving force behind empowering businesses to unlock the full potential of their data. Our mission is crystal clear: to harness the power of data through scalable solutions and repeatable...