Hello, I'm Daniel

Data Engineer · Azure & Databricks · AI-Ready Data Platforms

In Research Notes I write about enterprise AI platforms, agentic systems, and data architecture — and Lab Notes documents my personal multi-agent systems lab.

Read my research Explore the lab Get in touch

▹Azure
▹Databricks
▹Spark
▹Data Architecture
▹RAG
▹Agentic Systems
▹Agent Harnesses

Experience

Viewnext · IBM Group

Data Engineer

2025 – Present

Málaga, Spain · Full Remote

Assigned full-time to Repsol's ARiA data platform, building end-to-end pipelines from source ingestion to curated analytical layers in Azure Data Lake, with Unity Catalog as the governance and data-discovery layer.
Develop batch and streaming ingestion across heterogeneous sources: Oracle, Teradata, SQL Server, APIs, Salesforce, sFTP, Event Hubs and industrial PI System signals.
Build transformation and data-quality workflows with Python, PySpark, SQL, Azure Databricks and Azure Data Factory; support modelling across Bronze, Silver and Gold layers, including Synapse Dedicated Pool models.
Work with Solution Architects to turn architecture designs into robust, scalable implementations, and deliver across Development, Test, Acceptance and Production, including UAT and post-release stability.
Integrate pipelines with observability, monitoring and orchestration to track ingestion health, dependencies and SLA compliance.
Apply governance and security practices (metadata cataloguing, ACLs, Azure Key Vault, Service Principals) within Agile delivery on Azure DevOps and ServiceNow, including CI/CD and Git workflows.

BeoneBe

Data & Cloud Engineer

January 2024 – July 2024

Marbella, Spain

Built an Azure-backed document intelligence pipeline for automated metadata extraction and authenticity verification at scale
Deployed processing services with Docker on Linux, including TLS/SSL termination and reverse-proxy routing
Designed REST APIs exposing pipeline outputs to downstream applications, with CI/CD for automated testing and deployment

Education & Credentials →

Research Notes

View all research notes →

Agentic AI · Governance1 Apr 2026

ServiceNow in the Age of Agentic AI: AI Control Tower, AI Agent Fabric, and the New Moat of Governed Execution

A strategic analysis of ServiceNow's repositioning as a governance and execution layer for autonomous agents, examining AI Control Tower and AI Agent Fabric as enterprise AI infrastructure.

Lab Notes · Multi-Agent Systems

Building a Local Multi-Agent Systems Lab

Exploring agentic systems, LLM orchestration, MCP tooling, and harness engineering for reliable multi-agent workflows.

Living technical documentation for a local multi-agent systems lab — orchestration, research workflows, tooling, operations, and architecture.

Tech Stack

The tools I work with daily — from ingestion to analytics.

Python

PySpark

SQL

Azure

Databricks

Azure DevOps

Docker

Git

Linux

Bash

TypeScript

Scala

.NET

Next.js

Postman

Interested in working together?

Get in Touch

Hello, I'm DanielHello, I'm Daniel