Senior Data Engineer

Job description

About Snapp

Snapp is the pioneer provider of ride-hailing mobile solutions in Iran that connects smartphone owners in need of a ride to drivers who use their private cars offering transportation services. We are ambitious, passionate, engaged, and excited about pushing the boundaries of the transportation industry to new frontiers and be the first choice of each user in Iran.


About the Role

We are seeking a Senior Data Engineer to design, implement, and maintain scalable data pipelines and storage solutions that enable company-wide data-driven decision-making. You'll manage real-time analytics systems, collaborate with cross-functional teams, and ensure efficient, reliable data flow. 


Responsibilities

  • Design, implement, and maintain scalable real-time and batch data pipelines that handle billions of records.
  • Develop and manage real-time analytics systems, ensuring their reliability, performance, and maintenance.
  • Propose and refine data architecture to meet evolving business needs.
  • Collaborate with Business Intelligence, Ventures, and Data Science teams to ensure their data requirements are met.
  • Monitor and troubleshoot data services, resolving any issues that arise.
  • Set up real-time analytics solutions tailored to specific services and business demands.
  • Ensure highly efficient data pipelines by identifying and fixing performance bottlenecks.
  • Design, implement and maintain data infrastructure to ensure steady and undisrupted data flow


Requirements

  • Bachelor's or Master's degree in Computer Engineering/Science or equivalent experience.
  • Expertise in designing and maintaining scalable data pipelines and big data systems.
  • Proficiency in Hadoop ecosystem (HDFS, Yarn, Hive, Spark).
  • Hands-on experience with Kafka and Zookeeper for data streaming and coordination.
  • Strong programming skills in Python, Java, Scala, or Go (minimum 2 years of experience).
  • Familiarity with monitoring systems such as Grafana, Prometheus, and Exporters.
  • Experience working with Linux, virtualization, Docker, and Kubernetes.
  • Proven experience in setting up and maintaining real-time analytics and big data systems.