Big Data Engineer (Buenaventura)

Big Data Engineer

Big Data Engineers will face numerous business-impacting challenges, so they must be ready to use state-of-the-art technologies and be familiar with different IT domains such as Machine Learning, Data Analysis, Mobile, Web, IoT, etc. They are passionate, active members of our community who enjoy sharing knowledge, challenging, and being challenged by others and are genuinely committed to improving themselves and those around them.

What You'll Do
- Work alongside Developers, Tech Leads, and Architects to build solutions that transform users' experience.
- Impact the core of business by improving existing architecture or creating new ones.
- Create scalable and high-availability solutions, and contribute to the key differential of each client.

Here Is What We Are Looking For
- 6+ years of experience working as a Developer (Ruby, Python, Java, JS, preferred).
- 5+ years of experience in Big Data (Comfortable with enterprises' Big Data topics such as Governance, Metadata Management, Data Lineage, Impact Analysis, and Policy Enforcement).
- Proficient in analysis, troubleshooting, and problem-solving.
- Experience building data pipelines to handle large volumes of data (either leveraging well-known tools or custom-made ones).
- Advanced English level.

Desirable
- Building Data Lakes with Lambda/Kappa/Delta architecture.
- DataOps, particularly creating and managing batch and real-time data ingestion and processing processes.
- Hands-on experience with managing data loads and data quality.
- Modernizing enterprise data warehouses and business intelligence environments with open-source tools.
- Deploying Big Data solutions to the cloud (Cloudera, AWS, GCP, or Azure).
- Performing real-time data visualization and time series analysis using open-source and commercial solutions.

How We Make Your Work (and Your Life) Easier
- 100% remote work (from anywhere).
- Excellent compensation in USD or your local currency if preferred
- Hardware and software setu Postúlate en Kit Empleo: kitempleo.com.co/empleo/1aeqd0