Data Engineer [Medior/Senior] - Portugal

About DEUS

Are you obsessed with the possibilities of the emerging fields of artificial intelligence? Do you believe we can design & develop our own futures? Are you proactive and passionate?

We’re looking for an experienced Data Engineer (medior/senior) who has a talent for problem-solving, a keen interest in technology, and wants to help deliver real-world solutions.

We are the DEUS initiative, and we are all about exploring AI in the service of humanity. Our name is a reference to ‘deus ex machina’ (or god from the machine in Latin). We believe that artificial intelligence technologies such as machine learning, computer vision, and natural language processing will have a massive impact on the way we live, and we want to make sure that we create a positive impact on the world with these AI services.

DEUS is also an acronym representing the quadrivium of key disciplines we believe are important to building successful AI-powered services: Data / Engineering / User-experience design / Strategy.

DEUS is a new initiative, but the founders have been working together very successfully for years, so there is a comfortable family feel to the company. We have an amazing set of international client partnerships (and projects/challenges). Our headquarters is located in the heart of the city center of Amsterdam. We also have a team in Portugal that is based out of the beautiful city of Porto with an office close to the beach, and our Spanish team is based out of the charming center of A Coruña!

The Role

As a Data Engineer at DEUS, you will be responsible for the technical aspects of various AI projects. You will join a small but fast-growing data team (the D in DEUS), responsible for the technical aspects of various AI projects. Some examples of tasks would be setting up a data warehouse, extracting, transforming and loading data, and above all task automation. You will also collaborate closely with the other teams to conceptualize, and most of all to make things happen.

Job Responsibilities

• Design and implement data warehouses.
• Extract, transform, and load data.
• Automate tasks.
• Collaborate with other teams to conceptualize and implement AI projects.
• Implement MLops in NLP and Computer Visions projects.
• Bring a Proof of Concept ML model into production.

Who You Are

• You have a degree in Computer Science, Artificial Intelligence, with experience in Data Ops combined with in-depth knowledge of SQL/NoSQL databases.
• You like working with large amounts of data.
• You are interested in helping us implement MLops in the NLP and Computer Visions projects we are currently working on.
• You have experience bringing a Proof of Concept ML model into production.

Required Skills and Experience

• Proficiency in SQL is essential for effective data manipulation, querying, and reporting within our data systems.
• Databricks as a platform, including Unity Catalog and Delta Protocol.
• PySpark/Spark for distributed data processing.
• Distributed data processing techniques.
• Azure data services like ADF, Synapse, and EventHubs. Familiarity with Microsoft Fabric is also valuable.
• Excellent written and verbal English is the only language requirement.
• Programming experience with Python.
• Experience with databases, cloud computing, version control, best practices in data engineering, and software development.

Nice-to-have

• Apache Airflow
• Snowflake
• Apache Flink
• Knowledge of ML fundamentals, an interest in NLP and computer vision applications.

Benefits and Perks

• Top hardware [macbook pro etc] and the latest software.
• Friendly and inclusive workplace.
• Trips, conferences, and events together.
• Flexibility and freedom in managing your own priorities.
• Flexible hours’ scheme.

We are dedicated to making a friendly and inclusive workplace. To put it bluntly, there is an unwritten ‘no assholes’ policy that applies to both ourselves and our clients, as we always want to enjoy our team dynamic. We do trips, conferences, and events together. We are always committed to cultivating a company that celebrates differences and maintains a strong team culture. We fundamentally believe in flexibility, and you will be given a lot of freedom while translating complicated problems into easy-to-use products. This means managing your own priorities, trying out new things, and working a flexible hours’ scheme.