Data Engineer
Talentport
Sign up free: we match you to jobs like this, tailor your application and fill the form. 2 free applications every day.
Responsibilities:
Develop and optimize data pipelines and architecture for cross-functional teams
Design and maintain robust ETL pipelines to ingest large-scale real estate data
Manage external data acquisition systems including IP proxy rotation and automated ingestion workflows
Ensure data accuracy and integrity through automated monitoring processes
Support the EdgeProp AI team in implementing technical solutions and NLP initiatives
Collaborate with Product and Engineering teams to architect data solutions
Solve daily operational data problems to ensure consistent delivery across projects
Requirements:
BS/MS in Computer Science or a related technical field.
Minimum 3-5 years of professional data engineering experience
Hands-on experience with SQL, Relational databases, MongoDB, and Elastic Search
Proficient in Python for data processing
Experience managing IP proxy rotation and automated data ingestion
Experience with AWS, Linux Server and Apache Airflow is an advantage
Strong communication skills in English and a "can-do" attitude