data engineer.

Position ObjectiveAs a Data Engineer, you will be responsible for designing, building, and optimizing complex data pipelines that support our data-driven initiatives. You will work closely with cross-functional teams to deliver high-quality, reliable data solutions in a cloud environment. You will work on collecting, storing, processing, and analyzing huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company. Because we work on the cutting edge of a lot of technologies, this job requires a creative problem solver, resourced in getting things done, and productive working independently or collaboratively.Position SummaryProgramming & Code WritingDesign and implementation of scalable data pipelines using GCP services.Write clean, efficient, modular and well-documented code using python, SQL and other programming languagesPerform performance tuning and optimisation of data pipelinesFollow industry best practices for building data pipelinesCompletes work with some independence and some guidance from senior members of the team. Build and implement ETL processes. Modify ETL jobs to improve performance and efficiencyUtilize agile and DevOps methodologiesConsulting & PartnershipPartner with business analysts and other business stakeholders to plan project execution, including appropriate product and technical specifications, direction, and resources, and establishing realistic completion times.Understand data technology trends and identify opportunities to implement new technologies and provide forward-thinking recommendationsProactively partner with internal stakeholders to bridge gaps, provide historical references, and design the appropriate processes.Mentor junior data engineers and provide technical guidanceTroubleshooting & Continuous ImprovementResolve escalated reporting requests and communicate proactively and timelyMaintain new release, migration, and sprint schedules for software upgrades, enhancements, and fixes to aid with product evolution.Write QA/QC Scripts to conduct the first round of testing and partner with the BA team for test validation for new developments before moving to production.Use industry knowledge & feedback to aid in developing a technology roadmap and future product(s) vision.Document standard ways of working via QRGs, intranet pages, and video series

Experience 2+ yrs of experience on Google cloud platform, Google BigQuery, Google cloud composer (A

Knowledge, Skills and AbilitiesStrong data engineering (ETL) experience in any cloud platform (AWS/GCP/Azure). Google cloud platform experience is preferredExperience with integration of data from multiple data sources utilizing Apache Airflow, Google CloudRun, Cloud dataform, etc.Strong experience and understanding of databases, data warehouses, data lakes, etc.Strong knowledge of and experience with database systems (Oracle, PSQL. MySQL, Google BigQuery, Elastic Search etc.)Advanced knowledge of Python, Java, SQL, and software engineering best practices.Experience in CICD frameworksGood understanding and experience with GitExcellent interpersonal communication skills and intrinsic motivationProactive leadership, project management, time management, and problem solving skillsExtensive experience with data analysis , modeling and data pipelining including : data cleaning, standardizing, scaling, tuning , scheduling and deploymentAbility to prioritize and manage multiple projects, tasks, and meeting deadlines while maintaining qualityStrong drive and commitment for delivering outstanding resultsExperience with TDDEffective verbal and written communication skillsCurious and willing to learn.

EducationBachelor’s degree in Computer Science or related fieldMaster’s degree a plus

Universidad