Job Description

Sansar Tec LLC is seeking a Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and implementing scalable data pipelines and architectures. You will work closely with data scientists and analysts to ensure that data is accessible, reliable, and efficiently processed, enabling us to deliver insightful analytics and drive data-driven decision-making across the organization.
Responsibilities:

• Design and implement robust data pipelines to process large volumes of data efficiently.
• Collaborate with data scientists and analysts to understand data requirements and provide solutions.
• Optimize existing data architectures for performance and scalability.
• Ensure data quality and integrity through comprehensive testing and validation processes.
• Monitor and troubleshoot data pipeline performance and implement necessary improvements.
• Develop and maintain documentation for data engineering processes and data flow diagrams.
• Mentor and guide junior data engineers to foster their development and enhance team performance.

REQUIREMENTS

• A minimum of 5 years of experience in data engineering or a related field.
• Exposure to big data workflows and analytics tools (Spark/EMR/Databricks/Cassandra).
• Deep proficiency in Python with experience using Spark, Pandas or PySpark.
• An understanding of CI/CD pipelines and experience with DevOps
• Proficiency in SQL and experience with relational databases such as MySQL, PostgreSQL, or similar.
• Experience with big data technologies such as Apache Hadoop, Spark, or Kafka.
• Strong programming skills in languages like Python, Java, or Scala.
• Knowledge of cloud platforms (AWS, Azure, or GCP) and experience with data services within those ecosystems.
• Familiarity with data modeling, ETL processes, and data warehousing concepts.
• Excellent problem-solving skills and the ability to work independently and in a team environment.
• Deep experience working with big data including cleaning/transforming/cataloguing/mapping/ etc.
• Experienced in cloud technology best practices to enable the distribution and analysis of big data on the cloud (formatting/partitioning/etc.)
• Familiarity working with data lakes using S3/Redshift
• Experience building flexible solutions that can adapt quickly to changing requirements.

Job Tags

Flexible hours,

Similar Jobs