Lead Data Engineer
Python, Palantir Foundry
About the role:
As the Lead Data Engineer, you will design and oversee data models, pipelines, and workflows that power enterprise-scale applications and reporting. You’ll partner closely with product managers, analysts, and program leadership to translate business requirements into scalable technical solutions. Beyond hands-on engineering, you will mentor other engineers, establish coding and delivery standards, and ensure that Foundry is used at its fullest potential to support the client’s accounting, reporting, and real estate operations.
About the project:
Our client is a leading, $35B global commercial real estate services and investment firm. To accelerate its digital transformation, the organization is adopting Palantir Foundry as a core data and application platform. The focus is on building scalable solutions that showcase Foundry’s value, drive adoption, and create a pipeline of business-funded initiatives. These efforts aim to enable efficient data transformation and client-specific reporting at enterprise scale. Together, they will strengthen reporting capabilities, improve efficiency, and establish a foundation for data-driven applications across global operations.
Who are we looking for?
Skills & Experience:
- Bachelor's degree in Computer Science, Engineering, or related field;
- 7+ years of experience in data engineering roles;
- Database management and SQL proficiency, Knowledge of modern data warehousing tools like Snowflake, Databricks, Redshift (hands-on);
- Experience with Palantir Foundry using: Ontology, Ontology manager, Ontology functions /Actions, HyperAuto and AIP.
- Strong knowledge of Palantir Foundry features Pipeline builder, Workshop, Code repository, Builds, Security.
- Data modeling and design;
- Programing skills (Python, Spark);
- Experience of data governance frameworks and compliance requirements;
- Knowledge of big data technologies, machine learning integration or API development;
- Proficiency with cloud platforms ( at least one AWS, Azure, GCP) for scalable solutions;
- Expertise in streaming pipeline design and complex data transformation;
- Ability to analyze system requirements and translate them into effective technical designs;
- Experience with performance optimization for large-scale databases;
- Knowledge of CI/CD practices;
- Understanding the Real estate industry domain specifics and integrations with ERP data are a plus;
- Problem-solving mindset to address technical challenges in dynamic environments;
- Collaboration skills to work effectively with cross-functional teams;
- Expertise in using and/or introducing AI-based coding practices to the projects.
Responsibilities:
- Design and maintain the organization’s data architecture, including databases, data warehouses, and data lakes;
- Develop and implement data models to structure and organize data for storage and access;
- Design data pipeline architectures to handle real-time data processing;
- Define and implement Changed Data Capture (CDC) pipelines;
- Ensure data security, integrity and compliance, and assist in implementing data governance practices;
- Monitor system health, identify bottlenecks, and recommend improvements to ensure scalability and efficiency;
- Collaborate with cross-functional teams on data relation topics;
- Stay updated on emerging technologies to continuously improve the organization's data infrastructure.
What we offer
Work:
- Flexible working hours;
- Collaborative, friendly team environment;
- Remote/Hybrid work;
Life:
- Company social events;
- Annual corporate parties;
Health:
- Comprehensive medical insurance;
Education:
- Allowances for professional education;
- English language courses with native speakers;
- Internal knowledge-sharing sessions.
About Proxet
Proxet is a professional software development firm trusted by clients from around the world. With our expertise in AI and machine learning, we help businesses reimagine their possibilities and transform ideas into tangible digital solutions. By providing core services with an emphasis on data practices, we shape the future, one step at a time.
If you’d like to join our Proxet Nation and work closely with high-level professionals and our engineers, fill in the form!
Our offices:
Interested? Let's get in touch!
Tell us about yourself, then leave a link or upload your resume and we will get back to you soon!
💌
Thank you!
Interested in this closed position? Let's get in touch!
Tell us about yourself, then leave a link or upload your resume and we will get back to you soon!
💌
Thank you!
Is your friend a good fit?
Tell us about your friend - send their resume to our email hr@proxet.com!
Please Note: Your friend must be aware of the referral. The referral bonus is paid out after the end of the trial period.