Data Engineer

Updated: 3 months ago
Deadline: 28 Mar 2021

At Datu (a) Smart Digital we put data at the service of the business, providing comprehensive Big Data Analytics & Data Science services focused on the treatment and analysis of data through Data Mining, Text Mining, Machine Learning and Artificial Intelligence techniques.

[MAIN FUNCTIONS]

  • Implement data pipelines through Python and open source ETL tools, integrating, cleaning, homogenizing and transforming raw data from different sources.

  • Design and develop Big Data solutions in multidisciplinary projects.

  • Design and implement mechanisms to improve and control data quality.

  • Solve scalability and performance issues.

  • Manage direct contact with the client, proposing solutions to their needs.

[REQUIREMENTS]

Minimum studies: Engineering - Telecommunications Engineer, Software Engineering or other engineering

Master's degree in Big Data or related will be positively valued.

Minimum experience: At least 1 year.

Necessary knowledge:

  • Data engineering.

  • ETL.

  • Phython.

  • Big data.

  • Pandas.

  • Pyspark.

Minimum requirements:

  • Skill in Python and in managing libraries for data processing (Pandas, numPy, pyspark ...).

  • Experience programming in Jupyter Notebooks environments.

  • Experience planning and implementing ETL-s in Python and open source tools.

  • Knowledge and experience in managing SQL databases (PostgreSQL, MySQL,…) and noSQL (Elasticsearch, mongoDB,…).

  • Knowledge of version control systems (Git, ...).

  • Experience in Bash and Linux.

  • Knowledge of Big Data technologies (HDFS, Spark, Hive, Kafka ...).

Knowledge in:

  • Big Data architecture and design.

  • Tools for workflow management (Airflow, ...).

  • Architectures based on microservices (Kubernetes, Docker, ...).

  • Big Cloud AWS platforms.

  • Project planning and coordination.

Aptitudes:

  • Passionate about programming and technology.

  • Commitment to quality.

  • Teamwork.

  • Skills to deal with clients.

  • Proactive attitude.

  • Initiative and autonomy of work.

[BENEFITS]

  • Motivating projects with application in the real world.

  • Working conditions that adapt to your experience.

  • Career plan

  • Remote working.

  • Multidisciplinary work team.

  • Salary: Salary: € 18,000 - € 26,000 Gross / year.

  • Social benefits:

  • Flexible timetable.


View or Apply

Similar Positions