We are seeking a highly talented Senior Data Engineer to design, build, and maintain high-volume data architecture supporting critical retail pricing strategy and physical store space planning. Operating within our modern cloud ecosystem (Databricks on AWS), you will automate data pipelines connecting internal store management software with large external CPG vendor feeds (e.g., major beverage, packaged goods, and grocery suppliers) and market-matching datasets.
- 100% remote work. Full-time
- Long-term service contract (contractor).
- Salary range: 4,000–4,500 USD
Responsibilities:
- Pipeline Automation & Data Ingestion: Design, build, and optimize automated data feeds for external CPG vendor cost updates, competitor market pricing, and store spatial layout data.
- Modern Data Stack Governance: Manage and structure modular pipelines using dbt, Databricks Unity Catalog, and Python, ensuring high performance, proper data governance, and schema control.
- Complex Data Transformations: Write advanced, production-grade SQL and Python scripts to clean, structure, and stitch disparate vendor datasets into scalable data models.
- CI/CD & Code Quality: Enforce continuous integration, unit testing, version control, and automated deployment practices using GitHub.
- Cloud Architecture Optimization: Monitor and tune compute performance, data storage, and pipeline execution within AWS and Databricks.
Technical Skills:
- Experience: 5+ years of hands-on data engineering experience, ideally in retail, CPG, e-commerce, or supply chain environments.
- Core Tech Stack: Expert proficiency in SQL, Python, dbt, Databricks Unity Catalog, and AWS data infrastructure.
- Automation & Version Control: Proven success building automated ingestion frameworks and utilizing GitHub for repository management and CI/CD pipelines.
- Data Modeling: Solid understanding of dimensional modeling, Star Schema, and building unified enterprise catalog spaces.
- Soft Skills: Excellent remote communication skills, proactive problem-solving mindset, and the ability to work independently in a nearshore setup.
- Proficiency in English: C1–C2
Soft Skills:
- Creativity and innovation.
- Attention to detail.
- Accountability and ownership.
- Time management and prioritization.
- Adaptability in high-volume environments.
Benefits:
- US holidays.
- 15 vacation days per year.
- Professional growth opportunities within the company.
Job Types: Full-time, Permanent
Application Question(s):
- ¿Posees un nivel de inglés avanzado C1 - C2?
- Dominio avanzado de SQL, Python, dbt, Databricks Unity Catalog e infraestructura de datos en AWS:
- Experiencia comprobada construyendo frameworks automatizados de ingesta de datos y utilizando GitHub para la gestión de repositorios y pipelines de CI/CD.
- ¿Has trabajado o entiendes los entornos de retail, CPG, e-commerce o cadena de suministro? (no excluyente)
- Mencione aspiración de ingreso mensual en USD:
Work Location: Remote
