pepronics Logo

pepronics

DE&A - Core - Cloud Data Engineering - Azure Data Engineering

Posted 14 Days Ago
Be an Early Applicant
In-Office
Pune, Mahārāshtra
Mid level
In-Office
Pune, Mahārāshtra
Mid level
Design, build, and maintain ETL pipelines using Azure services, optimize data processing, and ensure data quality and governance while collaborating with teams.
The summary above was generated by AI
Key Responsibilities
  • Design, build, and maintain ETL pipelines for ingesting, transforming, and processing structured & semi‑structured data.
  • Develop and optimize Azure Data Factory pipelines, data flows, and triggers.
  • Work with Azure Databricks, Azure Synapse, or Azure Functions for data processing and transformation.
  • Manage and optimize MongoDB collections, indexes, schema design, and performance tuning.
  • Implement best practices for data governance, metadata management, and data quality.
  • Monitor pipeline performance, troubleshoot failures, and optimize compute & storage costs in Azure.
  • Collaborate with Data Architects, Analysts, and Application teams to understand data requirements and design scalable solutions.
  • Ensure data security, compliance, and efficient access controls across environments.
Required Skills & ExperienceTechnical Skills
  • Strong experience in ETL tools (ADF, SSIS, Talend, Informatica or similar).
  • Hands-on expertise with Azure Cloud services, especially:
    • Azure Data Factory
    • Azure Databricks / Synapse
    • Azure Storage (ADLS Gen2, Blob)
    • Azure SQL / Cosmos DB (optional)
  • Solid understanding of MongoDB, including:
    • Collection design
    • Aggregation pipelines
    • Index management
    • Performance tuning
  • Strong programming skills in Python or PySpark.
  • Good knowledge of SQL and query optimization.
  • Experience working with CI/CD pipelines (Azure DevOps preferred).
Good to Have
  • Experience with Kafka / Event Hub for streaming ingestion.
  • Knowledge of Data Lakehouse architecture.
  • Familiarity with Docker / Kubernetes deployments.
  • Exposure to BI reporting tools like Power BI.
Soft Skills
  • Strong analytical and problem‑solving skills.
  • Excellent communication and documentation abilities.
  • Ability to work in agile, fast‑paced environments.

 

ResponsibilitiesKey Responsibilities
  • Design, build, and maintain ETL pipelines for ingesting, transforming, and processing structured & semi‑structured data.
  • Develop and optimize Azure Data Factory pipelines, data flows, and triggers.
  • Work with Azure Databricks, Azure Synapse, or Azure Functions for data processing and transformation.
  • Manage and optimize MongoDB collections, indexes, schema design, and performance tuning.
  • Implement best practices for data governance, metadata management, and data quality.
  • Monitor pipeline performance, troubleshoot failures, and optimize compute & storage costs in Azure.
  • Collaborate with Data Architects, Analysts, and Application teams to understand data requirements and design scalable solutions.
  • Ensure data security, compliance, and efficient access controls across environments.
Required Skills & ExperienceTechnical Skills
  • Strong experience in ETL tools (ADF, SSIS, Talend, Informatica or similar).
  • Hands-on expertise with Azure Cloud services, especially:
    • Azure Data Factory
    • Azure Databricks / Synapse
    • Azure Storage (ADLS Gen2, Blob)
    • Azure SQL / Cosmos DB (optional)
  • Solid understanding of MongoDB, including:
    • Collection design
    • Aggregation pipelines
    • Index management
    • Performance tuning
  • Strong programming skills in Python or PySpark.
  • Good knowledge of SQL and query optimization.
  • Experience working with CI/CD pipelines (Azure DevOps preferred).
Good to Have
  • Experience with Kafka / Event Hub for streaming ingestion.
  • Knowledge of Data Lakehouse architecture.
  • Familiarity with Docker / Kubernetes deployments.
  • Exposure to BI reporting tools like Power BI.
Soft Skills
  • Strong analytical and problem‑solving skills.
  • Excellent communication and documentation abilities.
  • Ability to work in agile, fast‑paced environments.

 

Qualifications

.

About UsAt Zensar, we’re “experience-led everything”. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus.
Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. Explore Life at Zensar and join us to Grow. Own. Achieve. Learn. to be the best version of yourself.
We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.

Top Skills

Azure Data Factory
Azure Databricks
Azure Synapse
Docker
Kafka
Kubernetes
MongoDB
Power BI
Pyspark
Python
SQL

Similar Jobs

One Month Ago
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
App development
Lead cloud data engineering and architecture initiatives focused on Azure. Design and implement scalable, secure, AI-ready enterprise data platforms, guiding cloud data strategy and best practices.
Top Skills: Azure
10 Days Ago
Easy Apply
In-Office
India
Easy Apply
Senior level
Senior level
Aerospace • Transportation • Travel • Virtual Reality • Esports • Telehealth
The software tester designs usability test scenarios, runs tests, and prepares effectiveness reports for large-scale infrastructures, ensuring reliability.
Top Skills: Infrastructure ReliabilityInfrastructure ScalabilitySoftware TestingUsability Testing
11 Days Ago
Remote or Hybrid
India
Mid level
Mid level
AdTech • Appliances
Lead the Foundations: Import engineering team at GitLab, managing projects, supporting professional growth, recruiting talent, and improving productivity.
Top Skills: GitGitlabRuby on RailsRuby

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account