Senior Data Engineer
We are a team of experienced entrepreneurs, technologists, and domain experts still operating in stealth mode, building a revolutionary AI-based platform to disrupt and modernize the Hiring/Recruitment space.
We are looking for a Data Engineer who is passionate about building large-scale data processing systems and motivated to make an impact in creating a robust and scalable data platform used by every team, come join us.
Qualifications
High proficiency in Python/PySpark
High proficiency in Spark framework (resource management, configurations, optimizations)
High proficiency in SQL
Experience with AWS (IAM, S3, EMR, Redshift, DynamoDB, Athena, Glue…)
Proficiency with modern source control systems, especially Git
Advantage:
Experience with Databricks
Experience with big data solutions like Kafka/Kinesis
Experience with Containers (Docker/Kubernetes)a