Our Client Currently looking for Data Platform Engineer with PostgreSQL + Supabase + Ingestion Experience
What You’ll Work On
Audit & Stabilize the Existing Data Platform
- Independently audit the live Supabase/PostgreSQL database, including its schemas, functions, ingestion processes, and data integrity.
- Compare findings against known defects and identify additional sources of incorrect, incomplete, stale, or silently missing data.
- Investigate issues across the complete data lifecycle:Source Data → Ingestion → Translation → Enrichment → Combination → Database → Dashboard/API
- Repair broken enrichment fields, missing writes, incorrect filters, and mismatched record counts.
- Perform safe historical corrections and backfills where required.
- Identify root causes and implement safeguards that prevent the same classes of failures from recurring.
Build Reliable Data Pipelines
- Migrate existing locally running scrapers and ingestion jobs to hosted infrastructure capable of running unattended on a daily schedule.
- Build ingestion workflows that are idempotent, observable, and safe to retry.
- Implement reconciliation and validation processes to verify that external source records are represented accurately downstream.
- Improve monitoring and failure reporting so missing or incorrect data is detected before it reaches customers.
- Build safe processes for incremental updates and historical backfills.
- Over time, create ingestion pipelines for additional international clinical-trial registries, including sources in Europe, the UK, Japan, and other markets.
Professionalize the Data Infrastructure
- Bring database schemas and functions under version control.
- Establish declarative database migrations and reliable code review/deployment workflows.
- Create clear separation between staging and production environments.
- Establish and test a reliable point-in-time recovery process.
- Improve PostgreSQL performance through indexing, query-plan analysis, and database optimization.
- Introduce engineering controls that make production database changes reproducible, reviewable, and safer.
Data Delivery
- Build and maintain daily full-corpus exports to cloud object storage.
- Develop and maintain a customer-facing REST API.
- Ensure exported and API-delivered datasets remain consistent with the underlying database and original source records.
Required Experience
PostgreSQL & Database Engineering
Strong production experience with PostgreSQL, including:
- Complex schema design and maintenance
- Advanced SQL and PL/pgSQL
- Query-plan analysis and performance optimization
- Indexing strategies
- Transaction boundaries and data consistency
- Schema migrations
- Production database troubleshooting
- Safe data corrections and backfills
-
Are you interested in this position?
Apply by clicking on the “Apply Now” button below!
#AlbionarcJobs#FintechJobs
#AsiaJobs#MiddleEastCareers
#TechTalent#FintechRecruitment
#FinanceOpportunities#
