Data Engineer – Python
Tổng quan
Mức lương: Thoả thuận
Loại công việc: Toàn thời gian
Kinh nghiệm: 4 năm kinh nghiệm
Số lượng tuyển: 1
Hạn nộp hồ sơ: 2025-12-31
Ngày đăng: 2025-11-07 21:44
Danh mục: Công nghệ thông tin
Mô tả công việc
• Build ingestion workflows for APIs, web data, and files.
• Handle structured and semi-structured formats (JSON, XML, HTML, CSV).
• Apply resilient scraping practices, including session handling, proxies, and request
automation.
• Ensure compliance with security and access restrictions when integrating external
data sources.
• Optimize SQL queries and transformations for analytics.
• Design, build, and maintain robust Python-based data pipelines.
• Implement testing frameworks and good engineering practices for reliability.
• Ensure data quality, consistency, and scalability across workflows.
Yêu cầu
• Expert-level Python for data engineering and workflow automation.
• Knowledge of web scraping, ingestion workflows, and handling varied data formats.
• Experience designing and maintaining production-grade data pipelines.
• Familiarity with best practices in testing, monitoring, and pipeline reliability.
• Proficiency with version control (Git/GitHub/Azure DevOps).
• Strong SQL skills for ETL and analytics.
Qualifications
• BSc or MSc in Computer Science, Data Engineering, Software Engineering, or related fields.
• Equivalent practical experience will also be considered
Phúc lợi
• Salary: Negotiation
• Join a global team and work directly with many talents around the world.
• Opportunities for onsite work in Japan, Singapore, Australia, and many other countries.
• Work and grow in a dynamic, creative, and professional environment.
Healthcare: Premium Health Insurance TECHVIFY Care
• 13 months’ salary per year.
• Annual salary evaluation.
• Sponsor and encourage staff to study courses by covering tuition fees, such as Udemy, Coursera.