Senior BigData Engineer
Locations: Pune
Experience: 5 - 7 Years
Mode of Work: Hybrid
About the role:
Senior BigData Engineer
IF YOU ARE:
- 5+ years of industrial experience in Big Data Engineering
- Strong proficiency in SQL and at least one programming language: Python, Scala, or Java
- Hands-on experience with AWS and Snowflake
- Strong Experience in Data Build Tool (DBT)
- Experience with cloud storages: AWS S3, Azure Storage, Google Cloud Storage
- Practical skills with Hadoop-like environments (EMR, HDInsight, Dataproc)
- Experience with Big Data frameworks: Apache Spark, Databricks, Apache Flink, Apache Beam
- Knowledge of orchestration tools: Airflow, NiFi, AWS Glue, Azure Data Factory, Cloud Composer
- Experience with streaming platforms: Kafka, Kinesis, SQS, Event Hub, Pub/Sub, IoT Hub
- Familiarity with data warehousing and analytics: Snowflake, Redshift, Athena, Synapse
- Experience working with containerization & serverless technologies (Docker, Lambda, Fargate, Functions, Cloud Run)
- Understanding of data governance, data quality, and data lifecycle processes
- Strong communication and collaboration skills
- English at Upper?Intermediate level
- Bachelor’s degree in Computer Science or similar (preferred)
- AWS or Snowflake certifications (preferred)
AND YOU WANT TO:
- Design and optimize distributed computing architectures for scalable Big Data processing
- Build and enhance batch and streaming data pipelines
- Implement advanced data processing: real?time analytics, ML-driven models, predictive insights
- Develop reusable, parameterized ETL/ELT pipelines for DWH and lakehouse solutions
- Conduct end?to?end data flow validation and performance optimization
- Implement best practices for data quality, lineage, and governance
- Configure and maintain CI/CD flows and release pipelines
- Work with containerized and multi-container development environments
- Troubleshoot complex data infrastructure and processing issues
- Contribute to architectural decisions and technology selection
- Ensure secure customer data management throughout the entire project lifecycle
- Follow data retention, deletion, and off-boarding procedures
- Mentor junior engineers and support technical decision-making