Data Engineer
Google Cloud, BigQuery, GCS, DBT, SQL, Airbyte, Airflow, Python, FastAPI, Pandas, Terraform, GitHub Actions, Sigma Computing, Open Metadata, Monte Carlo Data, OpenAI, LLMs
About the role
We are seeking a skilled Data Engineer to build and maintain our data warehouse and efficiently process data from various 3rd party platforms, ensuring it is transformed into well-structured data products for further business use. You will play a pivotal role in shaping the data infrastructure for a finance-related project, focusing on transforming raw data into reliable, accessible formats that meet the organization’s needs.
As a Data Engineer, you will be responsible for designing and maintaining scalable data pipelines that ingest and transform data from external platforms. You’ll ensure the quality, reliability, and availability of data to support business requirements. You will collaborate directly with engineering, product, and business teams to understand their data needs and deliver tailored technical solutions that address those requirements.
We are seeking a proactive individual who can be responsible for a big part of our data platform, drive innovation, and continuously enhance the data architecture to support the growing needs of the business. Your ability to effectively communicate technical concepts, provide constructive feedback, and facilitate knowledge sharing among team members at all levels will be highly valued.
About the project
The client is a renowned venture capital firm that manages its fund using Salesforce as the central data repository, alongside various other platforms for additional data sources. These sources range from Excel spreadsheets to external commercial tools and custom-built user-facing applications. Different departments rely on multiple siloed systems for data management, leading to a fragmented data landscape.
The major challenge is the suboptimal time to make the final decision as analysts can't rely on the existing data due to possible human errors and complicated data management. The solution is to build a unified data platform that will be integrated with Salesforce, fund accounting, and other existing systems to efficiently transform financial, legal, and ops data to data marts that are ready for interaction and comprehensive visualization with BI tools on web and mobile platforms.
Who are we looking for?
Skills & Experience
- Possess a Bachelor’s degree in Computer Science or Software Engineering, or demonstrate substantial experience as a seasoned app developer.
- Demonstrate a minimum of 3 years of proficiency in Python, SQL, data systems development life cycle.
- Advanced experience using different kinds of databases (for example, PostgreSQL, BigQuery, Redis) including experience with query and optimization techniques.
- Display a comprehensive understanding and practical experience with Google Cloud services.
- Profound experience with unit and integration testing methodologies.
- Hands-on experience working with Docker
- Proven background in collaborative efforts with product managers and fellow engineers, particularly within distributed multicultural teams.
- An excellent command of the English language, both written and verbal.
- Possess outstanding communication skills, coupled with a sense of humor, and express a keen interest in the domains of personal and corporate finance.
Nice to have
- Experience with Airflow
- Experience with Airbyte and its integration with data platforms.
- Familiarity with Google Cloud
- Familiarity with data observability tools like Monte Carlo Data and data discovery tools like Open Metadata.
- Knowledge of the financial domain and understanding of wealth management, investment concepts.
- Contributions to open-source projects or personal projects showcasing data engineering skills.
Responsibilities
- Collaborate with cross-functional teams to understand business requirements
- Design, implement, and maintain scalable and reliable data pipelines, data warehouses, and data lakes.
- Develop and enforce best practices for data governance, data quality, and data security.
- Help maintain code quality, organization, and automation.
- Collaborate with other teams as needed to ensure interoperability, stability, and code reusability.
- Optimize data processing and querying for better performance and cost-efficiency.
- Stay up-to-date with the latest trends and technologies in the data engineering field (Modern Data Stack) and propose improvements to the existing architecture.
What we offer
Work:
- Flexible working hours;
- Direct communication with C-levels;
- Collaborative, friendly team environment;
- Hybrid work;
- Company equipment provision;
Life:
- Maternity and paternity leaves;
- Proxet Culture Club events;
- Company social events;
- Annual corporate parties;
Health:
- Comprehensive medical insurance and sports benefits;
- Mental health program with private consultations;
- Live webinar with therapists;
- Paid sick leaves;
Education:
- Allowances for professional education;
- English language courses with native speakers;
- Internal knowledge-sharing sessions.
About Proxet
Proxet is a professional software development firm trusted by clients from around the world. With our expertise in AI and machine learning, we help businesses reimagine their possibilities and transform ideas into tangible digital solutions. By providing core services with an emphasis on data practices, we shape the future, one step at a time.
If you’d like to join our Proxet Nation and work closely with high-level professionals and our engineers, fill in the form!
Our offices:
Interested? Let's get in touch!
Tell us about yourself, then leave a link or upload your resume and we will get back to you soon!
💌
Thank you!
Interested in this closed position? Let's get in touch!
Tell us about yourself, then leave a link or upload your resume and we will get back to you soon!
💌
Thank you!
Is your friend a good fit?
Tell us about your friend - send their resume to our email hr@proxet.com and get a referral bonus {bonus}!
Please Note: Your friend must be aware of the referral. The referral bonus is paid out after the end of the trial period.