Job Description & Work Exp.

We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources.

Responsibilities

• Collaborate with Product Management and other stakeholders within Engineering/Business to maintain a high bar for quality in a fast-paced, iterative environment
• Writing clean, scalable & efficient code
• Optimizing performance of applications for full scale production deployments.
• Troubleshooting and debugging to optimise performance.
• Solve technical problems of moderate scope and complexity
• Provide guidance and share best practices to other team members (assists in orienting, training, assigning), thus aid in development of domain knowledge

Skills and Qualifications

Soft Skills:

• Strong analytical and critical thinking with problem solving ability
• Responsive and leads by example
• Capable of prioritizing multiple project in order to meet goals without management oversight
• Project managing initiatives by working with other team members
• High adaptability to changing requirements customers dynamics work demands
• Positive and solution-oriented mindset

Technical Skills :

• 2+ years of hand on experience in a related field
• Proficiency in Python with hands-on experience in developing APIs with Flask or Django
• Develop and maintain web crawling solutions to collect data from diverse online sources using Python, BeautifulSoup, Selenium.
• Design and implement scalable data pipelines for data extraction, transformation, and loading (ETL) processes, with a focus on Python/PySpark based solutions.
• Comfortable with Linux development environment
• Familiarity with frontend platforms such as HTML/CSS would be a plus
• Experience with: MySQL, Postgres, AWS Services (Redshift, EC2 & S3)