Fulltime
Fulltime
Data Engineer
View below the job description in addition to the application form.
Job Description:
- Database Management:
- Optimize and manage relational (SQL) and/or non-relational (NoSQL) databases.
- Explore and implement best practices for database performance on large datasets.
- Data Pipeline Architecture:
- Design, implement, and optimize data pipelines for ingesting, transforming, and serving large-scale location data.
- Propose pipeline architecture improvements, ensuring scalability and efficiency.
- ETL/ELT Development:
- Build and operate ETL/ELT workflows to process large datasets for location-based analytics.
- Perform data quality checks and optimize workflows for performance and reliability.
- Cloud Services:
- Manage cloud-based data infrastructure
- Optimize cloud resource usage for cost-efficiency, scalability, and security.
- Distributed Data Processing:
- Use tools like Apache Spark or Hadoop to process large volumes of location data in a distributed environment.
- Data Governance:
- Ensure data quality, security, and compliance with company-wide governance policies
Job Qualifications:
- Bachelor/Master Computer Science, Data Science education background
- Has 2-4 year of experience in Data Engineer
- Has 1 year of experience in Pipeline Architceture (ETL/ELT, Distributed Data Processing)
- Has 1 year of experience in Cloud Services
- Has 2 year of experience in Database Management
- Prior experience working in a location-based analytics environment is a plus.
- Proficiency in Python for data manipulation, pipeline automation, and analytics.
