Job Overview:

As a Data Engineer, we expect you to solve real-life complex problems and create compelling experiences for our users

Responsibilities:

  • Collaborate with cross-functional teams, including data scientists and analysts to understand data requirements and implement effective data solutions.
  • Troubleshoot, fix production issues involving petabytes of data in Warehouses.
  • Build and maintain data integration workflows using airflow to ensure reliable and automated data pipelines.
  • Develop and optimize SQL queries and data models to support data analysis and Reporting needs.
  • Monitor and troubleshoot data pipelines, identifying and resolving performance issues.
  • Focus on scalability, performance, service robustness, and cost trade-offs.
  • Continuous drive to explore, improve, enhance, automate, and optimize systems and tools to best meet evolving business and market needs.
  • Attention to detail, coupled with ability to think abstractly.
  • Take complete ownership of projects and their development cycle.
  • Required Skillset:

  • 4 to 9+ Years of experience as a Data Engineer.
  • Data Engineering with a focus on Python, Airflow, dbt, SQL, BigQuery, Google Cloud Platform, ELT.
  • Strong proficiency in handling complex data pipelines using Airflow, dbt etc.
  • Strong expertise with Python, writing DAGs.
  • Experience with relational SQL and NoSQL databases like Mysql, Postgres, Mongodb and Cassandra.
  • Strong expertise in SQL, unpacking json & working with multiple formats, clustering, partitioning, optimizing queries to run efficiently in BigQuery and/or RedShift.
  • Experience with Google/AWS cloud services: BigQuery, CloudFunctions, PubSub, Kubernetes, EC2, S3, RedShift, Google Cloud Storage, EMR, RDS.
  • Other requirements:

  • You have worked in one or more of GCP, AWS, Azure.
  • Experience with big data tools: Spark, Kafka, PubSub, Fink, Hive, Sqoop etc.
  • Strong problem-solving skills and the ability to work in a fast-paced, collaborative Environment.
  • Excellent communication and interpersonal skills to effectively collaborate with team Members and stakeholders.
  • You collaborate with Compassion.
  • © 2023, Gettr Technologies (OPC) Pvt. Ltd. All Rights Reserved.