Data Engineer

The Opportunity Berkadia Services India Pvt Ltd     -----------------------------------------------------------------------------------------------            Integrity is Everything I We Take the Long View I We believe People Matter I We Stand for Excellence I We Love our Jobs I We Innovate         Job title:     Department:     Location:         Data Engineer Innovation Technology Bengaluru Terms:     Full Time – Hybrid work model (subject to Berkadia policy changes)  Split Shift (3:00pm to 12:00am) Working Hours          Reports To                                      The Opportunity  As a member of the Data Pipeline team you will be at the Center of building our platform that enables us to redefine the Commercial Real Estate industry. We are building a data pipeline that merges with the tested design of data warehousing and the latest big data technologies. You will own features and modules end to end — designing basic solutions, delivering high-quality maintainable code, and securing core data elements. In this role, individual will be required to work on one or multiple aspects of Innovation verticals with the following key responsibilities –    Essential Duties (Primary Responsibilities) include the following: Conduct data research of companies in the commercial real estate industry Research new knowledge and collaborate on solutions for assigned projects; share learnings with the team and peers Implement and release data applications in AWS using big data technologies for owned features and modules Provide valuable input and support during design and planning; help teammates ensure design specifications are met Deliver high-quality, easy-to-maintain code; debug and resolve issues within the feature or module area of responsibility Identify feature and module dependencies, critical paths, and risks; propose mitigation plans Mentor co-workers within areas of expertise; present knowledge informally to peers Other duties as assigned Your Qualification Education:     Any bachelor’s degree (Computer Science, Engineering, Information Systems, or a closely related technology field; or equivalent practical experience) Preferably Post Graduate degree including MBA/PGDBM Qualifications: Qualifications to perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the experience required: Bachelor’s degree or higher 2–5+ years of professional experience in data engineering or a closely related field. 2–4 years of hands-on Apache Spark experience (PySpark preferred) Proven experience building and maintaining ETL/ELT pipelines using tools/frameworks such as PostgreSQL, Docker, Apache Airflow, AWS Step Functions, or similar. Working knowledge of scalable languages such as Python, Scala, or R for data processing and algorithm implementation Strong expertise in SQL (complex queries, joins, constraints,…