Data Engineer

Holisticon Insight is a division of http://nexergroup.com focused on IoT, AI, and advanced analytics. We assist our customers in developing IoT services, portals, and mobile apps and, above all, analyze data using AI and advanced analytics to reduce costs, streamline, and find new opportunities for the business. Our goal is to grow strong but rather in competencies than in numbers. We get things done and, on the way, we build a dynamic company culture to create the best place for our development. We love the atmosphere of a family business with its flat structure and self-organized teams where every opinion matters and influences our way of working

Check us out!

👇https://holisticon.pl/holisticon-insight/

🚀 We are looking for a Data Engineers who will serve as the foundational builder of this project. You will build and maintain the data infrastructure to ingest, standardize and move data into the ML training environment. The core challenge is dealing with highly sparse, fragmented biological data across disconnected systems (like Genesys, GRIN-Global, and GIGWA).

As a Data Engineer, you will:

• Develop API and SQL-based connectors for diverse data sources and build automated ingestion scripts to centralize tables.

• Standardize raw data into a unified staging format, implement version control for raw datasets, and establish data lineage tracking from
  source to staging.

• Map data schemas across different tables to identify overlaps, quantify sparsity levels, and identify missingness patterns.

• Implement secure credential management for database access.

You might be the perfect match if you possess the following competencies:

• Core Tech: Advanced SQL, Python (Pandas, PySpark), and deep experience building REST API connectors.

• Data Architecture: Proven track record of designing data staging environments and managing complex data topologies.

• Domain Context: Previous experience handling fragmented, sparse datasets; familiarity with biological or agricultural data schemas is a strong plus.

By joining Holisticon Insight you will get:

• Life insurance

• Multisport card

• Fully remote job

• Private medical care

• Flexible working hours

• B2B contract

• Amazing integration events on a regular basis

• Training budget (e.g. Microsoft Azure Certifications)

• Opportunity to impact our company culture build-up

• Work equipment (laptop, 2 monitors, and accessories)