Data engineering for the European power system.

I'm Luis Jimenez Rubia, an independent data engineer based in Brussels. I build and run the pipelines that turn grid and market data – capacity calculation results, ENTSO-E and JAO files, regulatory KPIs – into numbers people can trust.

A day on the European grid

96 quarter-hour market time units. This is the day most code is written for.

Getting days like these right, every time, is most of the job.

What I do

Energy data

Regulatory and KPI reporting
CACM and IDCC KPIs, monthly data quality indicators and the reports built on them, with figures you can trace back to the source file.
Grid and market data pipelines
Ingesting ENTSO-E, JAO and TSO files over SFTP and APIs, with time zones, clock changes and late or corrected files handled on purpose.
Lakehouse and medallion architecture
Bronze, silver and gold layers on PostgreSQL or Delta Lake, including migrations away from a legacy warehouse without breaking the reports that depend on it.

Platform and delivery

dbt and Apache Airflow
Models, tests and DAGs your team can maintain after I leave. Code review and coaching for junior engineers.
PostgreSQL performance
Slow queries, materialized view refreshes, disk and vacuum problems, monitoring that warns you before users do.
Analysis and project management
Turning a regulation or a business need into a specification, a plan and a delivered pipeline.

Experience

More than 30 years in IT since 1996: data engineering, database administration, business analysis and project management.

  • A Regional Coordination Centre serving European transmission system operators
  • A European financial market infrastructure
  • Directorates-General of the European Commission
  • Energy, telecoms, airline, automotive and public sector companies in Spain

Tools I use every day

dbt, Apache Airflow, PostgreSQL, Python, Delta Lake, MinIO, Git, Oracle PL/SQL, Power BI

How we work together

  1. A short call

    You explain the problem; I tell you honestly whether I'm the right person for it.

  2. A written proposal

    Scope, deliverables, timeline and price on one page.

  3. Delivery

    In your repositories and your environments, on site in Brussels or remote, with regular check-ins.

  4. Handover

    Documentation and a walkthrough, so your team owns what was built.

Get in touch

info@magicbyte.eu

The fastest way to reach me is email. I work in English, French and Spanish.

Brussels, Belgium