Senior Data Engineer
Microsoft Azure, Azure DataLake, Azure App Service, SQL, Spark, Databricks, Python, FastAPI, Pandas, Streamlit, GitHub Actions, Palantir Foundry, OpenAI, LLMs
About the role
We are seeking a skilled Data Engineer to build and maintain our data warehouse and efficiently process data from various 3rd party platforms, ensuring it is transformed into well-structured data products for further business use. You will play a pivotal role in shaping the data infrastructure for a finance-related project, focusing on transforming raw data into reliable, accessible formats that meet the organization’s needs.
As a Data Engineer, you will be responsible for designing and maintaining scalable data pipelines that ingest and transform data from external platforms. You’ll ensure the quality, reliability, and availability of data to support business requirements. You will collaborate directly with engineering, product, and business teams to understand their data needs and deliver tailored technical solutions that address those requirements.
About the project
This project focuses on building a centralized data platform for a leading investment firm that supports data-driven decision-making for high-growth companies. Currently, data is sourced from multiple locations, including Excel files, third-party tools, and custom applications, managed within separate systems. This decentralized approach creates inefficiencies and introduces the potential for data inaccuracies.
The objective is to integrate these data sources into a single, unified platform that streamlines access and reduces manual errors. By transforming financial, legal, and operational data into structured data marts, the platform will enable advanced analytics and real-time visualization through BI tools on both web and mobile interfaces.
Who are we looking for?
Skills & Experience
- Possess a Bachelor’s degree in Computer Science or Software Engineering, or demonstrate substantial experience as a seasoned app developer.
- Demonstrate a minimum of 5 years of proficiency in Python, SQL, and data systems development life cycle.
- Experience with Palantir Foundry.
- Advanced experience using different kinds of databases (for example, PostgreSQL, BigQuery, Redis) including experience with query and optimization techniques.
- Display a comprehensive understanding and practical experience with Google Cloud services.
- Profound experience with unit and integration testing methodologies.
- Hands-on experience working with Docker
- Proven background in collaborative efforts with product managers and fellow engineers, particularly within distributed multicultural teams.
- An excellent command of the English language, both written and verbal.
- Possess outstanding communication skills, coupled with a sense of humor, and express a keen interest in the domains of personal and corporate finance.
Nice to have
- Experience with Databricks.
- Experience with Microsoft Azure.
- Knowledge of the financial domain and understanding of wealth management, and investment concepts.
- Contributions to open-source projects or personal projects showcasing data engineering skills.
Responsibilities
- Collaborate with cross-functional teams to understand business requirements
- Design, implement, and maintain scalable and reliable data pipelines, data warehouses, and data lakes.
- Develop and enforce best practices for data governance, data quality, and data security.
- Help maintain code quality, organization, and automation.
- Collaborate with other teams as needed to ensure interoperability, stability, and code reusability.
- Optimize data processing and querying for better performance and cost-efficiency.
- Stay up-to-date with the latest trends and technologies in the data engineering field (Modern Data Stack) and propose improvements to the existing architecture.
What we offer
Work:
- Flexible working hours;
- Direct communication with C-levels;
- Collaborative, friendly team environment;
- Hybrid work;
- Company equipment provision;
Life:
- Maternity and paternity leaves;
- Proxet Culture Club events;
- Company social events;
- Annual corporate parties;
Health:
- Comprehensive medical insurance and sports benefits;
- Mental health program with private consultations;
- Live webinar with therapists;
- Paid sick leaves;
Education:
- Allowances for professional education;
- English language courses with native speakers;
- Internal knowledge-sharing sessions.
About Proxet
Proxet is a professional software development firm trusted by clients from around the world. With our expertise in AI and machine learning, we help businesses reimagine their possibilities and transform ideas into tangible digital solutions. By providing core services with an emphasis on data practices, we shape the future, one step at a time.
If you’d like to join our Proxet Nation and work closely with high-level professionals and our engineers, fill in the form!
Our offices:
Interested? Let's get in touch!
Tell us about yourself, then leave a link or upload your resume and we will get back to you soon!
💌
Thank you!
Interested in this closed position? Let's get in touch!
Tell us about yourself, then leave a link or upload your resume and we will get back to you soon!
💌
Thank you!
Is your friend a good fit?
Tell us about your friend - send their resume to our email hr@proxet.com and get a referral bonus {bonus}!
Please Note: Your friend must be aware of the referral. The referral bonus is paid out after the end of the trial period.