Senior Data Engineer
10Pearls
Medellin, CO
hace 14 horas

About 10Pearls

10Pearls is an end-to-end digital technology services partner that helps businesses with innovative product development, digitalization of existing business processes, modernization and acceleration through augmentation of existing teams. We leverage our deep understanding of the latest technologies and the nuances of the digital landscape in your specific industry to drive company growth, no matter where you are on your digital journey.

10Pearls is proud to have a diverse clientele including large enterprises, SMBs, and high growth startups. We work with clients across industries, including but not limited to healthcare/life sciences, energy, communications/media, financial services, technology and education. Our many long-term, successful partnerships are built upon trust, integrity, and successful delivery and execution. To learn more, visit our

Essential Job Duties and Responsibilities

Architect, design, implement and maintain our BI datainfrastructure (Spark)

●Build high performing and scalable systems to supportmultiple data pipelines

●Collaborate with stakeholders to design and implementbusiness data models

●Own the uptime, management and reliability of ourdata warehouse

●Work with technical stakeholders to optimize dataflow across the systems

●Implement processes and systems to monitor data quality,ensuring data is alwaysaccurate and available for key stakeholders and businessprocesses that depend on it

●Perform data analysis to troubleshoot data relatedissues and assist in the resolution

●Create high impact dashboards, tools and data visualizations

●Work closely with engineering, product management, and other stakeholders to designand optimize data models for our Production environment- web and cloud services

●Work with software architects to design our overalldata strategy consistent with industrybest practices

●Define tooling strategy for engineer productivity

●Partner with techops to build tools for managing dataoperations

●Work with techops to resolve data related issues inproduction databases

●Act as a consultant to engineering and product managementin writing and optimizingcomplex SQL queries

●Design of alerting and streaming workflows

Job Requirements

●5+ years experience developing data warehouse solutionspreferably in Python

●5+ years experience developing in Spark & Kafka(preferred),Hadoop, Hive, Airflow, etc.

●5+ years of experience with schema design and dimensionaldata modeling

●5+ years of SQL experience (No-SQL experience is aplus)

●Experience with Snowflake, Postgres, RDS and otherAWS technologies

●Experience with data quality and consistency monitoring

●Ability to collaborate with teams across the company

●Excellent problem solving and troubleshooting skills

 

Powered by JazzHR

Reportar esta oferta
checkmark

Thank you for reporting this job!

Your feedback will help us improve the quality of our services.

Inscribirse
Mi Correo Electrónico
Al hacer clic en la opción "Continuar", doy mi consentimiento para que neuvoo procese mis datos de conformidad con lo establecido en su Política de privacidad . Puedo darme de baja o retirar mi autorización en cualquier momento.
Continuar
Formulario de postulación