We are seeking a skilled Principal Data Engineer / Lead to build and maintain our data platform and efficiently process data from various 3rd party platforms, ensuring it is transformed into well-structured data products for further business use. You will play a pivotal role in shaping the data infrastructure for a finance-related project, focusing on transforming raw data into reliable, accessible formats that meet the organization’s needs.
As a Principal Data Engineer / Lead, you will be responsible for designing and maintaining scalable batch and stream data pipelines that ingest and transform data from external platforms. You’ll ensure the quality, reliability, and availability of data to support business requirements. You will collaborate directly with engineering, product, and business teams to understand their data needs and deliver tailored technical solutions that address those requirements.
We’re looking for a proactive, hands-on leader who can drive innovation within our data platform, continuously evolve our data architecture, and support the growing demands of the business. Strong communication skills, the ability to translate complex technical concepts into actionable insights, and a collaborative mindset are key to success in this position.
About the project:
The client is a renowned venture capital firm that manages its fund using Salesforce as the central data repository, alongside various other platforms for additional data sources. These sources range from Excel spreadsheets to external commercial tools and custom-built user-facing applications. Different departments rely on multiple siloed systems for data management, leading to a fragmented data landscape.
The major challenge is the suboptimal time to make the final decision as analysts can't rely on the existing data due to possible human errors and complicated data management. The solution is to build a unified data platform that will be integrated with CRMs, fund accounting solutions, and other existing systems to efficiently transform financial, legal, and ops data to data marts that are ready for interaction and comprehensive visualization with BI tools on web and mobile platforms.
Who are we looking for?
Skills
- Bachelor's degree in Computer Science, Engineering, or related field
- 7+ years of experience in data engineering/ architecture roles
- Proficiency with GCP, AWS cloud platform for scalable solutions
- Database management and SQL proficiency, knowledge of modern data warehousing: BigQuery, PostgreSQL
- Programing skills - Python
- Knowledge of data transformation processes and workflow orchestration tools - DBT, Airbyte, Airflow;
- Advanced data modeling and metadata systems design, data streaming (experience with solutions like PubSub, Kinesis, SQS, Kafka)
- Strong knowledge of data governance frameworks and compliance requirements
- Strategic thinking and data strategy development
- Expertise in emerging technology and industry trends
- Interpretation of high-level business needs into effective data architecture solution
- Oversight and standardization of data architecture practices
- Knowledge of CI/CD practices
- Working experience with OpenAI and LLMs
- Strong problem-solving skills for complex data challenges and attention to detail
- Excellent communication and collaboration abilities
- Expertise in using and/or introducing AI-based coding practices to the projects.
What we offer
Work:
- Flexible working hours;
- Collaborative, friendly team environment;
- Remote/Hybrid work;
Life:
- Company social events;
- Annual corporate parties;
Health:
- Comprehensive medical insurance;
Education:
- Allowances for professional education;
- English language courses with native speakers;
- Internal knowledge-sharing sessions.
About Proxet
Proxet is a professional software development firm trusted by clients from around the world. With our expertise in AI and machine learning, we help businesses reimagine their possibilities and transform ideas into tangible digital solutions. By providing core services with an emphasis on data practices, we shape the future, one step at a time.
If you’d like to join our Proxet Nation and work closely with high-level professionals and our engineers, fill in the form!
Our offices:
Interested? Let's get in touch!
Tell us about yourself, then leave a link or upload your resume and we will get back to you soon!
Interested in this closed position? Let's get in touch!
Tell us about yourself, then leave a link or upload your resume and we will get back to you soon!
Is your friend a good fit?
Tell us about your friend - send their resume to our email hr@proxet.com!
Please Note: Your friend must be aware of the referral. The referral bonus is paid out after the end of the trial period.